Christoph Auer 1e9dc43b72 feat: Repetition-based StoppingCriteria for GraniteDocling (#2323) ...

* Experimental code for repetition detection, VLLM Streaming

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Update VLLM Streaming

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Update VLLM inference code, CLI and VLM specs

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Fix generation and decoder args for HF model

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Fix vllm device args

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Cleanup

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Bugfixes

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Remove streaming VLLM for the moment

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Add repetition StoppingCriteria for GraniteDocling/SmolDocling

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Make GenerationStopper base class and port for MLX

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Add streaming support and custom GenerationStopper support for ApiVlmModel

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Fixes for ApiVlmModel

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Fixes for ApiVlmModel

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Fix api_image_request_streaming when GenerationStopper triggers.

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Move DocTagsRepetitionStopper to utility unit, update examples

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

---------

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

2025-09-30 15:26:09 +02:00

..

data

feat: Rich tables support for HTML backend (#2324)

2025-09-29 18:12:16 +02:00

data_scanned

feat: Repetition-based StoppingCriteria for GraniteDocling (#2323)

2025-09-30 15:26:09 +02:00

__init__.py

fix: Add unit tests (#51)

2024-08-30 14:08:20 +02:00

test_asr_pipeline.py

feat: Support audio input (#1763)

2025-06-23 14:47:26 +02:00

test_backend_asciidoc.py

fix(asciidoc): set default size when missing in image directive (#1769)

2025-06-16 10:38:46 +02:00

test_backend_csv.py

chore: fix or ignore runtime and deprecation warnings (#1660)

2025-05-28 17:55:31 +02:00

test_backend_docling_json.py

feat: add Docling JSON ingestion (#783)

2025-01-24 18:05:23 +01:00

test_backend_docling_parse_v2.py

ci: add coverage and ruff (#1383)

2025-04-14 18:01:26 +02:00

test_backend_docling_parse_v4.py

chore: Safer unloading of DPv4 backend (#1867)

2025-06-30 14:41:21 +02:00

test_backend_docling_parse.py

ci: add coverage and ruff (#1383)

2025-04-14 18:01:26 +02:00

test_backend_html.py

feat(html): Support formatting tags in HTML texts (#2111)

2025-08-22 10:37:34 +02:00

test_backend_jats.py

fix: fix HTML table parser and JATS backend bugs (#1948)

2025-07-16 10:49:24 +02:00

test_backend_markdown.py

fix: support escaped characters in markdown backend (#2304)

2025-09-23 18:00:16 +02:00

test_backend_mets_gbs.py

feat: add backend for METS with Google Books profile (#1989)

2025-08-18 11:43:20 +02:00

test_backend_msexcel.py

feat(msexcel): set ContentLayer.INVISIBLE for invisible sheet (#1876)

2025-09-01 13:53:45 +02:00

test_backend_msword.py

fix(docx): ensure list items have a list parent (#1827)

2025-06-20 14:47:25 +02:00

test_backend_patent_uspto.py

feat: enable precision control in float serialization (#1914)

2025-07-09 16:39:17 +02:00

test_backend_pdfium.py

fix(pypdfium2): Fix OCR bounding box misalignment caused by mismatched rotation metadata (#2039)

2025-09-01 17:22:43 +02:00

test_backend_pptx.py

feat: leverage new list modeling, capture default markers (#1856)

2025-06-27 16:37:15 +02:00

test_backend_vtt.py

feat: add a backend parser for WebVTT files (#2288)

2025-09-22 15:24:34 +02:00

test_backend_webp.py

feat: Upgrade to RapidOCR 3.x (#2088)

2025-08-25 12:10:33 +02:00

test_cli.py

fix: Test cases for RTL programmatic PDFs and fixes for the formula model (#903)

2025-02-07 08:43:31 +01:00

test_code_formula.py

fix: formula conversion with page_range param set (#1791)

2025-06-17 13:58:45 +02:00

test_data_gen_flag.py

fix(markdown): handle nested lists (#910)

2025-02-07 12:55:12 +01:00

test_document_picture_classifier.py

fix: use only backend for picture classifier (#1904)

2025-07-07 16:23:16 +02:00

test_e2e_conversion.py

feat: Heron layout model as new default (#1971)

2025-09-03 12:45:22 +02:00

test_e2e_ocr_conversion.py

feat(RapidOcr): Support generic extra arguments for RapidOcr (#2266)

2025-09-16 07:26:10 +02:00

test_extraction.py

feat: [Beta] Extraction with schema (#2138)

2025-09-01 16:09:48 +02:00

test_input_doc.py

feat: add a backend parser for WebVTT files (#2288)

2025-09-22 15:24:34 +02:00

test_interfaces.py

perf: Clean up resources with docling-parse v4, no parsed_page output by default (#2105)

2025-08-20 10:46:31 +02:00

test_invalid_input.py

ci: add coverage and ruff (#1383)

2025-04-14 18:01:26 +02:00

test_legacy_format_transform.py

feat: enable precision control in float serialization (#1914)

2025-07-09 16:39:17 +02:00

test_ocr_utils.py

fix(ocr-utils): unit test and fix the rotate_bounding_box function (#1897)

2025-07-08 18:03:29 +02:00

test_options.py

feat: new vlm-models support (#1570)

2025-06-02 17:01:06 +02:00

test_settings_load.py

feat: Threaded PDF pipeline (#1951)

2025-07-26 11:49:37 +02:00

test_threaded_pipeline.py

feat: Threaded PDF pipeline (#1951)

2025-07-26 11:49:37 +02:00

verify_utils.py

feat: Heron layout model as new default (#1971)

2025-09-03 12:45:22 +02:00