MLX 8-bit conversion of IFM/K2-Horizon-3.7B, a 3.7B dense decoder-only model for reasoning, coding, long-context work, and tool use. The source checkpoint supports a native context length of 524,288 tokens (512K).
Benchmark results reported by IFM for the original IFM/K2-Horizon-3.7B checkpoint.
| Format | Quantization | Size |
|---|---|---|
| MLX safetensors | Affine 8-bit, group size 64 | 5.40 GB |
The included k2_horizon_mlx.py adapter preserves K2 Horizon's grouped RMSNorm. Use it with MLX-LM and --trust-remote-code. The model is text-only; no vision projector or MTP files are included.
pip install -U mlx-lm
mlx_lm.generate \
--model . \
--trust-remote-code \
--prompt "Explain why reproducible builds matter." \
--max-tokens 512
633f52amodel-00001-of-00002.safetensors 5.4 GBmodel-00002-of-00002.safetensors 20 MBIFM/K2-Horizon-3.7BHave the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo abenzerps/K2-Horizon-3.7B-MLX-8bit ./model-folder