LightOnOCR-3-1B-GGUF

LightOnOCR-3-1B, developed by lightonai, is a highly performant, lightweight OCR and end-to-end document understanding model designed as a seamless, drop-in upgrade for existing LightOnOCR-2 deployments. Released under the Apache 2.0 license, it retains the proven LightOnOCR-2-1B architecture while introducing powerful new visual understanding capabilities, including a grounding mode (triggered by the grounding prompt) that outputs labeled bounding boxes for all document elements in normalized page coordinates, short descriptions for images, and structured HTML data extraction from charts. Alongside its default transcription mode that outputs full-page markdown text from an empty prompt, the model is highly versatile—effortlessly handling complex multi-column layouts, tables, receipts, forms, handwriting, and math notation—offering a ready-to-use, single-model alternative to traditional, multi-stage document processing pipelines when images are optimally preprocessed at 200 DPI.

Model Files

llama.cpp

LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp