abenzerps/Nex-N2.5-mini-MLX-8bit

Verified creator abenzerps verified
🤗 Hugging Face sourcetext-generationapache-2.034.7B params69 GBsafetensors✓ 9 checksumsupdated today
Needs seeder →

Nex-N2.5-mini MLX — 8-bit

MLX 8-bit conversion of Nex-N2.5-mini, a sparse MoE language model for local inference, coding, reasoning, and long-context work. The source checkpoint supports a native context length of 262,144 tokens (256K).

Benchmarks

Benchmark results reported by Nex AI for the original Nex-N2.5 checkpoint and its upstream evaluation setup.

Release

Format Quantization Size
MLX safetensors Affine 8-bit, group size 64 36.85 GB

This release contains the text-generation weights and tokenizer. It does not include MTP weights or a vision projector.

Usage

pip install -U mlx-lm
mlx_lm.generate \
  --model . \
  --prompt "Explain why reproducible builds matter." \
  --max-tokens 512

Source