mlx-community/Muse-Spark-Open-816B-A42B-3bit

This model mlx-community/Muse-Spark-Open-816B-A42B-3bit was converted to MLX format from meta-models/Muse-Spark-Open-816B-A42B using mlx-lm version 0.32.2.

Re-uploaded on 2026-10-16 at 07:18 UTC with mlx-lm 0.32.2, which supports Muse Spark.

mlx-lm's default quantization for this model makes the routed experts of layers 1-60 3-bit and keeps the other weights in BF16. The checkpoint includes the vision encoder and takes about 436 GB.

Use with mlx

pip install -U "mlx-lm>=0.32.2"

from mlx_lm import load, generate

model, tokenizer = load("mlx-community/Muse-Spark-Open-816B-A42B-3bit")

prompt = "hello"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)

You can also use

• mlx-community/Muse-Spark-Open-816B-A42B-oQ3e: mixed-precision oQ quant optimized for oMLX, with the vision encoder. It also runs in mlx-lm 0.32.2.
• mlx-community/Muse-Spark-Open-816B-A42B-oQ4e: the 4-bit oQ quant.
• mlx-community/Muse-Spark-Open-816B-A42B-4bit: the standard mlx-lm 4-bit quant.