abenzerps/Nex-N2.5-mini-MLX-6bit

abenzerps 已认证

🤗 Hugging Face 来源text-generationapache-2.034.7B 参数69 GBsafetensors✓ 8 个校验和今天更新

Nex-N2.5-mini MLX — 6-bit

MLX 6-bit conversion of Nex-N2.5-mini, a sparse MoE language model for local inference, coding, reasoning, and long-context work. The source checkpoint supports a native context length of 262,144 tokens (256K).

Benchmarks

Benchmark results reported by Nex AI for the original Nex-N2.5 checkpoint and its upstream evaluation setup.

Release

Format	Quantization	Size
MLX safetensors	Affine 6-bit, group size 64	28.19 GB

This release contains the text-generation weights and tokenizer. It does not include MTP weights or a vision projector.

Usage

pip install -U mlx-lm
mlx_lm.generate \
  --model . \
  --prompt "Explain why reproducible builds matter." \
  --max-tokens 512

Source

Model: Nex-N2.5-mini
Source revision: 87420286149d9cce9bd46cd335ef9bda33c37c1b
License: Apache-2.0
Checksums: SHA256SUMS.txt