ScreenVLM GGUF
F16 and Q8_0 conversions of the ScreenParse-v2 checkpoint, with a shared F16 vision encoder/projector. Q8_0 is derived from the original-weight F16 conversion.
| File | Component | Quantization | Size | Status |
|---|---|---|---|---|
| ScreenVLM-Q8_0.gguf | decoder | Q8_0 | 239,333,536 bytes | Available |
| ScreenVLM-F16.gguf | decoder | F16 | 447,246,496 bytes | Available |
| mmproj-ScreenVLM-F16.gguf | vision | F16 | 190,031,392 bytes | Available |
Usage
Use llama.cpp at 0ec4027:
llama-server -m ScreenVLM-Q8_0.gguf --mmproj mmproj-ScreenVLM-F16.gguf \
-ngl 99 -c 4096 -np 1 --jinja --special \
--host 127.0.0.1 --port 8080
Send one screenshot followed by Generate the screen representation for this UI:.
--special retains the <loc_ control prefix. ScreenTag bounding boxes
use integer coordinates in [0,500]. For CPU inference, use
-ngl 0 --no-mmproj-offload.
Preserve the native Idefics3 processing: longest edge 2048, 512-pixel tiles plus overview, 4× pixel shuffle, Lanczos, and mean/std 0.5. The original chat template is embedded and supplied separately. The converter copy removes two token IDs outside the source weight tables; all model-representable token IDs and source weights are retained. See tokenizer-repair.json and CHANGES.md.
Source and license
Apache-2.0, as declared by the source and its named components. Complete terms and source attribution are included in LICENSE and ATTRIBUTION.md. Commands, pinned provenance and hashes: REPRODUCE.md, runtime-info.json, model-manifest.json.