--- type: "post" id: "llamaindex-liteparse-adds-minicpm-ocr-integration-from-openbmb-a2efd7" slug: "llamaindex-liteparse-adds-minicpm-ocr-integration-from-openbmb-a2efd7" title: "LlamaIndex LiteParse adds MiniCPM-OCR integration from OpenBMB" description: "LiteParse now has a FastAPI adapter that connects its OCR API to OpenBMB’s MiniCPM-OCR 1.0." retrieval_nugget: "LiteParse now has a FastAPI adapter that connects its OCR API to OpenBMB’s MiniCPM-OCR 1.0. For teams building document pipelines, the integration offers a self-hosted OCR option for Chinese and English, but it requires a separately hosted inference server and carries important confidence-reporting limitations." published_at: "2026-11-05" updated_at: "2026-11-05" record_date: "2026-11-05" date_kind: "published_at" topics: ["api-design"] entities: ["LlamaIndex","LiteParse","MiniCPM-OCR","OpenBMB","PP-DocLayoutV3"] related_patterns: ["agent-ready-software-exposes-capabilities"] novelty_label: "new_fact" what_changed: "LiteParse adds an integration for OpenBMB’s MiniCPM-OCR, extending the model’s ecosystem beyond its release and SDK availability." prior_refs: ["https://newruntime.com/posts/openbmb-open-sources-minicpm-ocr-1-0-and-457493/","https://newruntime.com/posts/minicpm-ocr-sdk-first-published-to-pypi-with-f0faaf/"] source_url: "https://github.com/run-llama/liteparse/tree/main/ocr/minicpmocr" source_urls: ["https://github.com/run-llama/liteparse/tree/main/ocr/minicpmocr"] schema_version: "newruntime-agent-readable-v0.2" stable_id: "post:llamaindex-liteparse-adds-minicpm-ocr-integration-from-openbmb-a2efd7" status: "published" visuals: [] editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]} routes: {"html":"https://newruntime.com/posts/llamaindex-liteparse-adds-minicpm-ocr-integration-from-openbmb-a2efd7/","markdown":"https://newruntime.com/posts/llamaindex-liteparse-adds-minicpm-ocr-integration-from-openbmb-a2efd7.md","json":"https://newruntime.com/posts/llamaindex-liteparse-adds-minicpm-ocr-integration-from-openbmb-a2efd7.json"} markdown_url: "https://newruntime.com/posts/llamaindex-liteparse-adds-minicpm-ocr-integration-from-openbmb-a2efd7.md" --- # LlamaIndex LiteParse adds MiniCPM-OCR integration from OpenBMB ## Retrieval answer LiteParse now has a FastAPI adapter that connects its OCR API to OpenBMB’s MiniCPM-OCR 1.0. For teams building document pipelines, the integration offers a self-hosted OCR option for Chinese and English, but it requires a separately hosted inference server and carries important confidence-reporting limitations. ## Summary LiteParse now has a FastAPI adapter that connects its OCR API to OpenBMB’s MiniCPM-OCR 1.0. For teams building document pipelines, the integration offers a self-hosted OCR option for Chinese and English, but it requires a separately hosted inference server and carries important confidence-reporting limitations. ## What happened The `ocr/minicpmocr` directory in the `run-llama/liteparse` GitHub repository contains a FastAPI service that wraps MiniCPM-OCR 1.0 and conforms to LiteParse’s OCR API specification. The repository describes MiniCPM-OCR as a 1.3-billion-parameter document-parsing model for Chinese and English. The service operates at block level: it runs the bundled PP-DocLayout layout detector in-process, crops detected blocks, then sends each crop to a MiniCPM-OCR inference server using a recipe for the detected block type, such as text, table, or formula recognition. The adapter does not bundle MiniCPM-OCR’s model weights. Users must run the model separately and set `MINICPM_OCR_BASE_URL` to the inference server root; the README gives a vLLM serving example and points to deployment options including vLLM, SGLang, llama.cpp, and Ollama. A `MINICPM_OCR_BACKEND` setting identifies supported serving interfaces (`vllm`, `sglang`, `openai`, `llamacpp`, or `ollama`). Other settings cover the served model name, optional bearer token, reported context length, startup and request timeouts, and the device used for layout detection. The service can be installed and run with `uv run server.py`, or built into a Docker image. The image contains the API and layout model, not the separate inference server. On the first `POST /ocr`, the service downloads the PP-DocLayoutV3 layout model to its configured cache directory and connects to the inference server. A `GET /health` endpoint responds before either action occurs. The README also gives an example using LiteParse’s CLI to process a PDF through the local OCR endpoint. Several caveats matter in production. The API accepts a language field for compatibility, but the README says it is unused because one MiniCPM-OCR model handles both Chinese and English. The service reports confidence as `1.0`; it explicitly warns that MiniCPM-OCR supplies no recognition confidence and that the layout score is not a substitute. If a block’s generation ends with an explicit non-`stop` finish reason such as `length`, the adapter skips it with a warning rather than returning a truncated prefix. The supplied source does not state a price or quantify accuracy or throughput for the integration. ## What the archive adds This is a new integration detail in a continuing MiniCPM-OCR story. [OpenBMB open-sources MiniCPM-OCR 1.0 and the MiniCPM-OCR Jev parse-checking model](https://newruntime.com/posts/openbmb-open-sources-minicpm-ocr-1-0-and-457493/) covered the model release; [MiniCPM-OCR SDK first published to PyPI with a minicpmvocr parse CLI and vLLM, llama.cpp and Ollama backends](https://newruntime.com/posts/minicpm-ocr-sdk-first-published-to-pypi-with-f0faaf/) covered the SDK and serving backends. This LiteParse adapter is a distinct integration, not a restatement of either release. ## Trend signal This supports [agent-ready software exposes capabilities](https://newruntime.com/patterns/agent-ready-software-exposes-capabilities) only weakly: the adapter exposes a defined OCR endpoint that another document-processing system can call, but the source does not describe agent permissions or broader composability. The stronger signal here is practical interoperability between a parsing tool and a separately served OCR model, rather than a new agent capability boundary. ## Why now The repository page presents this adapter as a current part of LiteParse’s codebase, and the supplied archive shows recent coverage of MiniCPM-OCR’s release and SDK. The available material does not explain the timing of the integration or give a publication date, so no further timing claim is established. ## Why it matters A document pipeline often needs OCR only for pages or regions where native text extraction is inadequate. This adapter gives LiteParse users a route to invoke a self-hosted model through the OCR API it already defines, while keeping the inference engine replaceable among supported serving options. That can matter to teams trying to avoid a cloud OCR dependency or to keep document processing within their own deployment boundary, though the source does not make performance or cost comparisons. The operational split is also consequential: running the adapter is not equivalent to running the model. Teams need to provision the inference server and layout model, persist the layout cache if using containers, and monitor skipped blocks. They should not interpret the reported confidence field as evidence of recognition quality. These are useful implementation details, but they also mean the integration is a component to evaluate and operate, not a turnkey OCR service. ## Limits and uncertainty The supplied repository material does not establish benchmark results, comparative accuracy, throughput, hardware requirements, or costs for this LiteParse integration. It does not specify a release date, adoption level, or whether the adapter is production-supported. The listed serving engines and configuration document how to connect components, not whether they behave identically. In particular, a fixed confidence value of `1.0` cannot substantiate that extracted text is correct; teams need their own validation and error handling. The source also does not establish whether the integration can process languages beyond Chinese and English. ## Skill to build now Before putting the adapter into a document workflow, create a small evaluation set containing representative pages with body text, tables, formulas, and difficult layouts. Run those pages through the configured inference backend, inspect skipped blocks and extracted output, and record errors separately from the adapter’s fixed confidence field. This directly tests the behavior the README describes without treating `1.0` as a quality signal. ## Reader takeaway LiteParse’s MiniCPM-OCR adapter makes a self-hosted OCR backend available through its OCR API, but it is not a bundled model or a managed service. Plan for a separate inference server, first-request layout-model setup, and independent checks of recognition quality; the reported confidence value does not measure it. Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json ## Continue in the graph Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`. - topic hub: [Api Design](https://newruntime.com/topics/api-design.md): Explore the api-design topic hub. - collection: [Field Notes](https://newruntime.com/posts.json): Open the latest editorial analysis. - collection: [Sources](https://newruntime.com/sources/): See the original sources this archive cites. - whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)