-
Notifications
You must be signed in to change notification settings - Fork 3.3k
docs: Example on how to apply external OCR as post processing #2517
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
✅ DCO Check Passed Thanks @maxmnemonic, all your commits are properly signed off. 🎉 |
Merge ProtectionsYour pull request matches the following merge protections and will not be merged until they are valid. 🟢 Enforce conventional commitWonderful, this rule succeeded.Make sure that we follow https://www.conventionalcommits.org/en/v1.0.0/
|
Codecov Report❌ Patch coverage is
📢 Thoughts on this report? Let us know! |
40ed3b8 to
44f81c9
Compare
PeterStaar-IBM
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm!
PeterStaar-IBM
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm!
…with "nanonets-ocr2-3b" via LM Studio Signed-off-by: Maksym Lysak <[email protected]>
Signed-off-by: Maksym Lysak <[email protected]>
Signed-off-by: Maksym Lysak <[email protected]>
Signed-off-by: Maksym Lysak <[email protected]>
Signed-off-by: Maksym Lysak <[email protected]>
Signed-off-by: Maksym Lysak <[email protected]>
Signed-off-by: Maksym Lysak <[email protected]>
…functions Signed-off-by: Maksym Lysak <[email protected]>
Signed-off-by: Christoph Auer <[email protected]>
Signed-off-by: Christoph Auer <[email protected]>
Signed-off-by: Maksym Lysak <[email protected]>
…reserving original text from json Signed-off-by: Maksym Lysak <[email protected]>
…ble cells, form items), these are not sent to OCR Signed-off-by: Maksym Lysak <[email protected]>
Signed-off-by: Maksym Lysak <[email protected]>
Signed-off-by: Maksym Lysak <[email protected]>
4dec258 to
d90f285
Compare
Example on how to apply OCR with "nanonets-ocr2-3b" via LM Studio in a post-processing of Docling Document.
It respects bounding boxes of layout, table cells, and key-values, and re-populate existing text (if any) with the text obtained from OCR for a given bounding box of an element.
This requires LM Studio running inference server with "nanonets-ocr2-3b" model pre-loaded.
Includes fix that ensures correct PIL image as an input in
api_image_request.pyChecklist: