abenzerps/MiniCPM5-2B-MLX-6bit

abenzerps 已认证

🤗 Hugging Face 来源text-generationapache-2.02.5B 参数5.0 GBsafetensors✓ 1 个校验和今天更新

MiniCPM5-2B MLX - 6-bit

MLX 6-bit conversion of OpenBMB/MiniCPM5-2B, a 2B dense Llama-based model for local deployment, coding, reasoning, long-context work, and tool use. The source checkpoint supports a native context length of 131,072 tokens (128K).

Benchmarks

Benchmark results reported by OpenBMB for the original MiniCPM5-2B checkpoint.

Release

Format	Quantization	Size
MLX safetensors	Affine 6-bit, group size 64	2.0 GB

The model is text-only. No vision projector or MTP files are included.

Usage

pip install -U mlx-lm
mlx_lm.generate \
  --model . \
  --prompt "Explain why reproducible builds matter." \
  --max-tokens 512

Source

Model: OpenBMB/MiniCPM5-2B
Source revision: 3497c460c89e00520c3cfa2e73f49ab7647f1177
License: Apache-2.0
Checksums: SHA256SUMS.txt