mirrors/docling
1
0
Fork 0
mirror of https://github.com/DS4SD/docling.git synced 2025-07-27 04:24:45 +00:00
Code Issues Packages Projects Releases Wiki Activity
139 Commits 36 Branches 112 Tags 287 MiB
544f298fb4
Commit Graph

139 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Michele Dolfi
544f298fb4 add missing install 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2024-10-03 19:05:48 +02:00
Michele Dolfi
b3293ffc75 update test results 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2024-10-03 19:04:02 +02:00
Michele Dolfi
2784d9c3b5 Merge remote-tracking branch 'origin/main' into feat-multiple-ocr-engines 2024-10-03 19:02:01 +02:00
Michele Dolfi
f57e4b2afb add tesseract in CI, improve error messages and allow to specify the tesseract cmd 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2024-10-03 18:59:29 +02:00
Maxim Lysak
2422f706a1
feat: new torch-based docling models (#120) 
---------

Signed-off-by: Maxim Lysak <mly@zurich.ibm.com>
Co-authored-by: Maxim Lysak <mly@zurich.ibm.com>
 2024-10-03 18:42:33 +02:00
Nikos Livathinos
e571ab50ee fix(tests): Extend test_e2e_ocr_conversion to cover all OCR engines (easyocr, tesserocr, tesseract) 
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
 2024-10-03 16:49:23 +02:00
Nikos Livathinos
7ab3b62c18 chore(data_scanned): Simplify the OCR test images. Add GT for easyocr, tesserocr, tesseract 
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
 2024-10-03 16:46:51 +02:00
github-actions[bot]
9ebbbc1245 chore: bump version to 1.17.0 [skip ci] 2024-10-03 13:44:52 +00:00
Rui Dias Gomes
dde0aff8bd
update examples (#123) 
Signed-off-by: rmdg88 <rmdg88@gmail.com>
 2024-10-03 14:28:25 +02:00
Michele Dolfi
d44c62d7ce
feat: windows support (#122) 
* feat: windows support

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* add Windows in README

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

---------

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2024-10-03 14:23:47 +02:00
Nikos Livathinos
1d4517ffb4 fix(TesserOcrModel): Refactor code to catch exception in case of import error 
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
 2024-10-03 14:23:07 +02:00
Michele Dolfi
81d176cd3d add message for failed easyocr import 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2024-10-03 13:38:01 +02:00
Nikos Livathinos
c28846a866 feat: Implement the TesserOcrModel. Introduce the test_e2e_ocr_conversion.py unit test. 
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
 2024-10-02 18:12:32 +02:00
Nikos Livathinos
a0e72655f7 chore: Update the data_scanned to have recognitions per ocr engine 
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
 2024-10-02 18:12:32 +02:00
Peter Staar
fed3323e25 tesseract is working 
Signed-off-by: Peter Staar <taa@zurich.ibm.com>
 2024-10-02 17:23:50 +02:00
Peter Staar
a3e2cf5473 fixed conflicts 
Signed-off-by: Peter Staar <taa@zurich.ibm.com>
 2024-10-02 17:01:34 +02:00
Michele Dolfi
0b76211eed add examples for swtching OCR engine and CLI support 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2024-10-02 16:57:48 +02:00
Peter Staar
8d1c1d6dd5 added the tesseract_model.py 
Signed-off-by: Peter Staar <taa@zurich.ibm.com>
 2024-10-02 16:40:24 +02:00
Nikos Livathinos
bfdc4e32cc chore: Add test data with scanned documents and their conversions usinga EasyOCR 
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
 2024-10-02 13:35:38 +02:00
Nikos Livathinos
c211808742 feat: tesseract and tesserocr models. WIP. 
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
 2024-10-02 13:35:00 +02:00
Nikos Livathinos
455d6ff70f chore: Add tesserocr in poetry 
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
 2024-10-02 13:27:34 +02:00
Michele Dolfi
bbfc0617f2 feat: add options for choosing OCR engine 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2024-10-02 10:47:20 +02:00
github-actions[bot]
cde671cf34 chore: bump version to 1.16.1 [skip ci] 2024-09-27 14:36:40 +00:00
Michele Dolfi
34bd887a7f
fix: allow usage of opencv 4.6.x (#110) 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2024-09-27 15:51:43 +02:00
Panos Vagenas
c05b692d69
docs: document chunking (#111) 
[skip ci]

Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>
 2024-09-27 11:16:04 +02:00
github-actions[bot]
6760571fe1 chore: bump version to 1.16.0 [skip ci] 2024-09-27 06:21:15 +00:00
Christoph Auer
d6df76f90b
feat: Support tableformer model choice (#90) 
* Support tableformer model choice

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Update datamodel structure

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Update docs

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Cleanup

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Add test unit for table options

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Ensure import backwards-compatibility for PipelineOptions

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Update README

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Adjust parameters on custom_convert

Signed-off-by: Christoph Auer <60343111+cau-git@users.noreply.github.com>

* Update Dockerfile

Signed-off-by: Christoph Auer <60343111+cau-git@users.noreply.github.com>

---------

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>
Signed-off-by: Christoph Auer <60343111+cau-git@users.noreply.github.com>
 2024-09-26 21:37:08 +02:00
Panos Vagenas
39977b5631
chore: move examples extras to respective group (#103) 
Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>
 2024-09-25 15:47:48 +02:00
github-actions[bot]
3dfd02a7e9 chore: bump version to 1.15.0 [skip ci] 2024-09-24 15:58:16 +00:00
Michele Dolfi
6a03c208ec
feat: add figure in markdown (#98) 
* feat: add figures in markdown

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* update to new docling-core and update test results with figures

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* update with improved docling-core

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

---------

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2024-09-24 17:28:23 +02:00
github-actions[bot]
001d214a13 chore: bump version to 1.14.0 [skip ci] 2024-09-24 13:38:23 +00:00
Panos Vagenas
d96b96c848
fix: fix OCR setting for pypdfium, minor refactor (#102) 
Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>
 2024-09-24 14:36:00 +02:00
Panos Vagenas
f8f2303348
docs: document CLI, minor README revamp (#100) 
Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>
 2024-09-24 09:21:28 +02:00
Panos Vagenas
f555815343
chore: add RAG notebook titles (#101) 
[skip ci]

Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>
 2024-09-24 09:17:46 +02:00
Panos Vagenas
3c46e4266c
feat: add URL support to CLI (#99) 
Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>
 2024-09-24 08:47:53 +02:00
github-actions[bot]
c65a01c9b7 chore: bump version to 1.13.1 [skip ci] 2024-09-23 19:04:01 +00:00
Peter W. J. Staar
4794ce460a
fix: updated the render_as_doctags with the new arguments from docling-core (#93) 
* updated the render_as_doctags with the new arguments from docling-core

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* ensuring that docling-core is >1.5.0 to accomodate with the latest export-to-doctags parameters

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* added the doctags tests

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* updated the README

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* fix poetry lock

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* Fix formatting problems

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* fixed the doctag export in docling/utils/export.py

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* propagate xsize and ysize

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

---------

Signed-off-by: Peter Staar <taa@zurich.ibm.com>
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
Signed-off-by: Christoph Auer <cau@zurich.ibm.com>
Co-authored-by: Michele Dolfi <dol@zurich.ibm.com>
Co-authored-by: Christoph Auer <cau@zurich.ibm.com>
 2024-09-23 20:12:18 +02:00
Maxim Lysak
dce9934a0f
Updated to new, clean vector logo, svg and rendered png are provided (#96) 
Signed-off-by: Maxim Lysak <mly@zurich.ibm.com>
Co-authored-by: Maxim Lysak <mly@zurich.ibm.com>
 2024-09-23 15:31:21 +02:00
Michele Dolfi
1f4b224ab6
chore: switch to gh apps user (#92) 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2024-09-20 17:02:27 +02:00
github-actions[bot]
6dd1e91c4a chore: bump version to 1.13.0 [skip ci] 2024-09-18 09:26:03 +00:00
Maxim Lysak
0da7519896
docs: updated Docling logo.png with transparent background (#88) 
Signed-off-by: Maxim Lysak <mly@zurich.ibm.com>
Co-authored-by: Maxim Lysak <mly@zurich.ibm.com>
 2024-09-18 10:39:11 +02:00
Michele Dolfi
f19bd43798
feat: add table exports (#86) 
* feat: expose docling-core table exporters and add examples

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* remove temp internal implementation of html export

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* pin latest docling-core 1.4.0 with table exports

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

---------

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2024-09-18 08:44:13 +02:00
Peter W. J. Staar
442443a102
fix: bumped the glm version and adjusted the tests (#83) 
* bumped the glm version and adjusted the tests

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* updated the poetry lock

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* fix hooks

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* fixed the tests

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* reformatted the code

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* added the tests for tables

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

---------

Signed-off-by: Peter Staar <taa@zurich.ibm.com>
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
Co-authored-by: Michele Dolfi <dol@zurich.ibm.com>
 2024-09-18 07:43:49 +02:00
github-actions[bot]
8242bce4fa chore: bump version to 1.12.2 [skip ci] 2024-09-17 16:01:34 +00:00
Nikos Livathinos
fa9699fa3c
fix(tests): Adjust the test data to match the new version of LayoutPredictor (#82) 
* fix(tests): Adjust the test data to match the new version of LayoutPredictor from docling-ibm-models

Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>

* chore: Update poetry to use `docling-ibm-models` at version `v1.2.0`

Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>

---------

Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
 2024-09-17 15:50:35 +02:00
Michele Dolfi
30a0ef69b4
chore: Add PR template (#81) 
Signed-off-by: Michele Dolfi <97102151+dolfim-ibm@users.noreply.github.com>
 2024-09-16 18:36:26 +02:00
github-actions[bot]
f1932fd8c5 chore: bump version to 1.12.1 [skip ci] 2024-09-16 10:58:09 +00:00
Michele Dolfi
2870fdc857
fix: CLI compatibility with python 3.10 and 3.11 (#79) 
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
 2024-09-16 12:32:45 +02:00
github-actions[bot]
34b2772a2e chore: bump version to 1.12.0 [skip ci] 2024-09-13 12:34:15 +00:00
Peter W. J. Staar
98990784df
feat: add docling cli (#75) 
* chore: add simple convert script

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* reformatted all

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* reformatted all

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* added default arg

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* use typer for the docling CLI

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* describe output when saving

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* add tests for CLI

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* add export options

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

---------

Signed-off-by: Peter Staar <taa@zurich.ibm.com>
Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
Co-authored-by: Michele Dolfi <dol@zurich.ibm.com>
 2024-09-13 14:03:09 +02:00