docs: Add details and examples on optimal GPU setup (#2531)

* docs for GPU optimizations

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* improve time reporting and improve execution

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* fix standard pipeline

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* tune examples with batch size 64

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* add benchmark results

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* improve docs

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* typo in excluded tests

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* explicit pipeline in table

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

---------

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
This commit is contained in:
Michele Dolfi
2025-10-30 13:22:05 +01:00
committed by GitHub
parent d9c90eb45e
commit 97aa06bfbc
5 changed files with 291 additions and 1 deletions

View File

@@ -64,6 +64,7 @@ nav:
- Supported formats: usage/supported_formats.md
- Enrichment features: usage/enrichments.md
- Vision models: usage/vision_models.md
- GPU support: usage/gpu.md
- MCP server: usage/mcp.md
- Jobkit: usage/jobkit.md
- FAQ:
@@ -116,6 +117,9 @@ nav:
- "Figure enrichment": examples/develop_picture_enrichment.py
- "Formula enrichment": examples/develop_formula_understanding.py
- "Enrich a DoclingDocument": examples/enrich_doclingdocument.py
- ⚡️ GPU optimization:
- "Standard pipeline": examples/gpu_standard_pipeline.py
- "VLM pipeline": examples/gpu_vlm_pipeline.py
- 🗂️ More examples:
- examples/dpk-ingest-chunk-tokenize.ipynb
- examples/rag_azuresearch.ipynb