MiniCPM5-2B MLX - 4-bit

MLX 4-bit conversion of OpenBMB/MiniCPM5-2B, a 2B dense Llama-based model for local deployment, coding, reasoning, long-context work, and tool use. The source checkpoint supports a native context length of 131,072 tokens (128K).

Benchmarks

Benchmark results reported by OpenBMB for the original MiniCPM5-2B checkpoint.

Release

Format	Quantization	Size
MLX safetensors	Affine 4-bit, group size 64	1.4 GB

The model is text-only. No vision projector or MTP files are included.

Usage

pip install -U mlx-lm
mlx_lm.generate \
  --model . \
  --prompt "Explain why reproducible builds matter." \
  --max-tokens 512

Source

Model: OpenBMB/MiniCPM5-2B
Source revision: 3497c460c89e00520c3cfa2e73f49ab7647f1177
License: Apache-2.0
Checksums: SHA256SUMS.txt