Community GGUF quantizations of openbmb/MiniCPM-V-4.7-1B.
☕ If this GGUF made your day easier, a coffee would make mine.MiniCPM-V 4.7 1B is OpenBMB's compact multimodal model for image and video understanding. The upstream model describes single-image, multi-image, and video use, with an efficient vision encoder and on-device deployment targets. See the official model card and the upstream deployment guide.
The upstream configuration declares a 262,144-token text context. The example below uses a 4,096-token context; long-context behavior has not been evaluated in this release. This GGUF release keeps the vision projector in F16 and quantizes the language-model weights. The default upstream 16x visual-token compression is used.
With a CPU build of llama.cpp, ask a question about a local image:
./llama-mtmd-cli \
-m MiniCPM-V-4_7-1B-Q4_K_M.gguf \
--mmproj mmproj-model-f16.gguf \
--chat-template-file chat_template.jinja \
--image ./photo.jpg \
--jinja \
--simple-io --single-turn \
-p 'Describe the image in one sentence.' \
-n 128 -c 4096
The locked upstream BF16 checkpoint is converted to one F16 GGUF, and every quantized language-model GGUF is quantized directly from that same F16 input using a MiniCPM-V 4.7 1B-specific imatrix. No quantized GGUF is used as the source for another quantization. The projector stays in F16. The reproducibility manifest records source and runtime revisions, hashes, commands, and validation details. Artifact measurements use decimal GB (bytes / 1e9); SHA256SUMS.txt covers the published files.
Each published quantization is loaded with llama.cpp and must generate non-empty output for text and a single-image prompt. This is a compatibility smoke test, not a quality benchmark. No hold-out fidelity evaluation is published, so this card does not rank quantizations or make quality recommendations. The 2-bit, IQ, and ternary variants are experimental builds without a quality claim.
The upstream model is licensed under Apache 2.0. These are community GGUF quantizations, not an official OpenBMB release or endorsement.
Have the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo ngquocvinh/MiniCPM-V-4.7-1B-GGUF ./model-folderopenbmb/MiniCPM-V-4.7-1B