PaddleOCR-VL 1.6, quantized GGUF
Quantized GGUF of PaddlePaddle/PaddleOCR-VL-1.6, for running in the browser via wllama.
The official PaddleOCR-VL-1.6-GGUF release is F16 and totals 1.73 GB. This one is 856 MB with no measurable difference in output.
| file | size | what it is |
|---|---|---|
PaddleOCR-VL-1.6-Q4_K_M.gguf |
286 MB | decoder |
mmproj-Q8_0.gguf |
570 MB | vision projector |
Both files are required.
Usage
llama-mtmd-cli -m PaddleOCR-VL-1.6-Q4_K_M.gguf --mmproj mmproj-Q8_0.gguf \
--image crop.png -p "OCR:" --jinja --temp 0
Use the prompt OCR:. The model expects a crop of a single text region.
Quantization
Decoder: llama-quantize Q4_K_M from the official F16 GGUF.
Projector: convert_hf_to_gguf.py --mmproj --outtype q8_0 from the safetensors
release (llama.cpp b10150).
The upstream vision config declares SiglipVisionModel; the converter's mmproj
path expects PaddleOCRVisionModel, so that field was renamed before
converting. No weights were altered.
Checked against the F16 originals on Japanese, Korean and Chinese comic pages; output was character-identical.
Licence
Apache-2.0, inherited from PaddleOCR-VL.