Keye-VL-2.0-30B-A3B — Abliterated — MLX (MXFP4)
MXFP4 (≈4.43 bpw) MLX build of the abliterated
Kwai-Keye/Keye-VL-2.0-30B-A3B,
for Apple Silicon. Quantized from
lemuralabs/Keye-VL-2.0-30B-A3B-uncensored
with mlx-vlm. ~16 GB on disk; runs in ~17 GB; ≈107 tok/s on an M4 Max.
Yes — This MLX build runs Keye coherently on a Mac. The original model uses a CUDA-only sparse-attention indexer (
SALightningIndexer) that is unstable on MPS — so the stock model generates garbage via Transformers on Apple Silicon. This port runs the mathematically-equivalent dense attention, which is coherent and fast on MLX.
Requirements — custom mlx-vlm model class
Keye is not yet in mainline mlx-vlm. This repo bundles the support module under
mlx_vlm_keye_support/keyevl2/. Install it:
pip install mlx-vlm
# copy the bundled module into your mlx-vlm install:
python - <<'PY'
import mlx_vlm, os, shutil
dst = os.path.join(os.path.dirname(mlx_vlm.__file__), "models", "keyevl2")
shutil.copytree("mlx_vlm_keye_support/keyevl2", dst, dirs_exist_ok=True)
print("installed keyevl2 ->", dst)
PY
Also register the prompt format (one line in mlx_vlm/prompt_utils.py): add
"keye_vl2": MessageFormat.LIST_WITH_IMAGE_FIRST, to the format map.
Usage
python -m mlx_vlm generate --model lemuralabs/Keye-VL-2.0-30B-A3B-uncensored-mlx-mxfp4 \
--prompt "Describe this image." --image path/to/img.jpg --trust-remote-code
Notes
- Quant: MXFP4, group size 32, 4.432 bpw (whole model, incl. vision tower).
- Vision: the SigLIP tower +
mlp_ARprojector are included (quantized). Text gen is verified coherent; image understanding is functional but the packed-vision forward in this port is a first cut — report issues. - Abliterated (refusals reduced; see the base abliterated card for method/limits).
- The text backbone reuses mlx-vlm's
qwen3_vl_moe; the sparsesa_indexeris dropped.
Abliteration removes safety alignment; you are responsible for use.
Other variants of this model (public on Lemura Labs)
Keye-VL-2.0-30B-A3B-uncensored— abliterated bf16 — full precision (CUDA / vLLM / SGLang)Keye-VL-2.0-30B-A3B-uncensored-mlx-optiq-3.7bpw— MLX mixed ~3.87 bpw — Apple Silicon