mirrors/docling
1
0
Fork 0
mirror of https://github.com/DS4SD/docling.git synced 2025-12-11 22:28:31 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix: Clear word/char cells when force_full_page_ocr is used

Browse Source 
When force_full_page_ocr=True, the OCR model correctly replaces
textline_cells with OCR-extracted text. However, word_cells and
char_cells were not cleared, causing downstream components like
TableStructureModel to use unreliable PDF-extracted text containing
GLYPH artifacts (e.g., GLYPH<c=1,font=/AAAAAH+font000000002ed64673>).

This fix clears word_cells and char_cells when force_full_page_ocr
is enabled, ensuring TableStructureModel falls back to the OCR-
extracted textline cells via its existing fallback logic.

Fixes issue where PDFs with problematic fonts (Type3, missing
ToUnicode CMap) produced GLYPH artifacts in table content despite
force_full_page_ocr being triggered.
This commit is contained in:
Myles McNamara
2025-12-05 17:03:47 -05:00
parent aebe25cf00
commit 4197a4e273
1 changed files with 9 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
docling/models/base_ocr_model.py
View File

@@ -154,6 +154,15 @@ class BaseOcrModel(BasePageModel, BaseModelWithOptions):
page.parsed_page.textline_cells = final_cells page.parsed_page.textline_cells = final_cells
page.parsed_page.has_lines = len(final_cells) > 0 page.parsed_page.has_lines = len(final_cells) > 0
# When force_full_page_ocr is used, word/char-level cells from PDF
# are also unreliable. Clear them so downstream components (e.g., table
# structure model) fall back to OCR-extracted textline cells.
if self.options.force_full_page_ocr:
page.parsed_page.word_cells = []
page.parsed_page.char_cells = []
page.parsed_page.has_words = False
page.parsed_page.has_chars = False
def _combine_cells( def _combine_cells(
self, existing_cells: List[TextCell], ocr_cells: List[TextCell] self, existing_cells: List[TextCell], ocr_cells: List[TextCell]
) -> List[TextCell]: ) -> List[TextCell]: