English注册

0xSojalSec/K2-Horizon-7B-MAC-MLX

🤗 Hugging Face 来源text-generationapache-2.09B 参数18 GBsafetensors✓ 3 个校验和今天更新
需要做种者 →

K2-Horizon-7B MLX — 4-bit

MLX 4-bit conversion of IFM/K2-Horizon-7B, a 7B dense decoder-only model for reasoning, coding, long-context work, and tool use. The source checkpoint supports a native context length of 524,288 tokens (512K).

Benchmarks

Benchmark results reported by IFM for the original IFM/K2-Horizon-7B checkpoint.

Release

Format Quantization Size
MLX safetensors Affine 4-bit, group size 64 5.06 GB

The included model.py loader preserves K2-Horizon's grouped RMSNorm. Use it with MLX-LM and --trust-remote-code. The model is text-only; no vision projector or MTP files are included.

Usage

pip install -U mlx-lm
mlx_lm.generate \
  --model abenzerps/K2-Horizon-7B-MLX-4bit \
  --trust-remote-code \
  --prompt "Explain why reproducible builds matter." \
  --max-tokens 256

Source