MLX 6-bit conversion of Nex-N2.5-mini, a sparse MoE language model for local inference, coding, reasoning, and long-context work. The source checkpoint supports a native context length of 262,144 tokens (256K).
Benchmark results reported by Nex AI for the original Nex-N2.5 checkpoint and its upstream evaluation setup.
| Format | Quantization | Size |
|---|---|---|
| MLX safetensors | Affine 6-bit, group size 64 | 28.19 GB |
This release contains the text-generation weights and tokenizer. It does not include MTP weights or a vision projector.
pip install -U mlx-lm
mlx_lm.generate \
--model . \
--prompt "Explain why reproducible builds matter." \
--max-tokens 512
model-00003-of-00006.safetensors 5.3 GBmodel-00004-of-00006.safetensors 5.3 GBmodel-00002-of-00006.safetensors 5.2 GBmodel-00001-of-00006.safetensors 5.2 GBmodel-00005-of-00006.safetensors 5.2 GBmodel-00006-of-00006.safetensors 2.0 GBnex-agi/Nex-N2.5-miniHave the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo abenzerps/Nex-N2.5-mini-MLX-6bit ./model-folder