MiniCPM5-2B MLX - 8-bit
MLX 8-bit conversion of OpenBMB/MiniCPM5-2B, a 2B dense Llama-based model for local deployment, coding, reasoning, long-context work, and tool use. The source checkpoint supports a native context length of 131,072 tokens (128K).
Benchmarks
Benchmark results reported by OpenBMB for the original MiniCPM5-2B checkpoint.
Release
| Format | Quantization | Size |
|---|---|---|
| MLX safetensors | Affine 8-bit, group size 64 | 2.5 GB |
The model is text-only. No vision projector or MTP files are included.
Usage
pip install -U mlx-lm
mlx_lm.generate \
--model . \
--prompt "Explain why reproducible builds matter." \
--max-tokens 512
Source
- Model: OpenBMB/MiniCPM5-2B
- Source revision: 3497c460c89e00520c3cfa2e73f49ab7647f1177
- License: Apache-2.0
- Checksums: SHA256SUMS.txt