LightOnOCR-3-0.8B-GGUF
GGUF conversion of LightOnOCR-3-0.8B by LightOn AI.
Converted using llama.cpp.
Model Files
| File Name | Quant Type | File Size | File Link | Description |
|---|---|---|---|---|
LightOnOCR-3-0.8B-f16.gguf |
F16 | 1.413 GB | Link | Full precision model |
LightOnOCR-3-0.8B-Q2_K.gguf |
Q2_K | 0.393 GB | Link | Smallest quantization |
LightOnOCR-3-0.8B-Q3_K_S.gguf |
Q3_K_S | 0.405 GB | Link | Very small |
LightOnOCR-3-0.8B-Q3_K_M.gguf |
Q3_K_M | 0.434 GB | Link | Small size |
LightOnOCR-3-0.8B-Q3_K_L.gguf |
Q3_K_L | 0.458 GB | Link | Better quality |
LightOnOCR-3-0.8B-Q4_K_S.gguf |
Q4_K_S | 0.471 GB | Link | Good compression |
LightOnOCR-3-0.8B-Q4_K_M.gguf |
Q4_K_M | 0.493 GB | Link | Recommended |
LightOnOCR-3-0.8B-Q5_K_S.gguf |
Q5_K_S | 0.525 GB | Link | High quality |
LightOnOCR-3-0.8B-Q5_K_M.gguf |
Q5_K_M | 0.538 GB | Link | Recommended |
LightOnOCR-3-0.8B-Q6_K.gguf |
Q6_K | 0.586 GB | Link | Very high quality |
LightOnOCR-3-0.8B-Q8_0.gguf |
Q8_0 | 0.756 GB | Link | Near F16 quality |
LightOnOCR-3-0.8B-mmproj-f16.gguf |
MMPROJ F16 | 0.191 GB | Link | Required for vision input |
Usage
For image/document OCR, use the model together with the MMPROJ file:
llama-server \
-m LightOnOCR-3-0.8B-Q4_K_M.gguf \
--mmproj LightOnOCR-3-0.8B-mmproj-f16.gguf
Original Model
Credits
Original model: LightOn AI
GGUF conversion: Prathat
Runtime: llama.cpp
License
Apache 2.0