K2-Horizon-7B MLX — 4-bit
MLX 4-bit conversion of IFM/K2-Horizon-7B, a 7B dense decoder-only model for reasoning, coding, long-context work, and tool use. The source checkpoint supports a native context length of 524,288 tokens (512K).
Benchmarks
Benchmark results reported by IFM for the original IFM/K2-Horizon-7B checkpoint.
Release
| Format | Quantization | Size |
|---|---|---|
| MLX safetensors | Affine 4-bit, group size 64 | 5.06 GB |
The included model.py loader preserves K2-Horizon's grouped RMSNorm. Use it with MLX-LM and --trust-remote-code. The model is text-only; no vision projector or MTP files are included.
Usage
pip install -U mlx-lm
mlx_lm.generate \
--model abenzerps/K2-Horizon-7B-MLX-4bit \
--trust-remote-code \
--prompt "Explain why reproducible builds matter." \
--max-tokens 256
Source
- Model: IFM/K2-Horizon-7B
- Source revision:
2c9659a - License: Apache-2.0
- Checksums: SHA256SUMS.txt