Add oi_parser parse provider and pipeline - #81
Open
thiagosantos1 wants to merge 1 commit into
Open
Conversation
thiagosantos1
force-pushed
the
feature/oi-parser-provider
branch
from
July 20, 2026 06:16
427ce0f to
8365d0e
Compare
Author
|
@boyang-zhang1 Please let me know if there's anything missing from our side to move the PR forward |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This resubmits #77, which was closed because oi-parser API keys required manual admin approval (not self-serve). That's now fixed — details below. Opening a new PR since closed PRs can't be reopened.
Adds an
oi_parserparse provider + pipeline for the hosted oi-parser document-parsing API (POST /v1/extract,X-API-Keyauth, returns markdown + layout). Also includes a layout cross-eval adapter + label mapper so the pipeline can be scored on the layout-detection dataset.Getting an API key: sign up at https://oi-parser.ai/ — keys are now issued instantly and active on signup, with no admin review or "Pending approval" step. One active key per user, valid 14 days, and a new key can be self-issued anytime — also with no approval. Set it via
OI_PARSER_API_KEY(optionally override the endpoint withOI_PARSER_BASE_URL).Recommended run flags:
--max_concurrent 20— the per-API-key concurrency cap on the default key; exceeding it only wastes retries. Raise it if your key is provisioned with a higher limit.--per_file_timeout 900— the service allows up to ~900s per document; the default 600s can cut off the slowest documents.Example: