mlx-community/Muse-Spark-Open-816B-A42B-4bit

This model mlx-community/Muse-Spark-Open-816B-A42B-4bit was converted to MLX format from meta-models/Muse-Spark-Open-816B-A42B using mlx-lm version 0.32.2.

Re-uploaded on 2026-10-16 at 07:21 UTC with mlx-lm 0.32.2, which supports Muse Spark.

mlx-lm's default quantization for this model makes the routed experts of layers 1-60 4-bit and keeps the other weights in BF16. The checkpoint includes the vision encoder and takes about 533 GB, more than the memory of a single 512 GB Mac.

Use with mlx

pip install -U "mlx-lm>=0.32.2"

from mlx_lm import load, generate

model, tokenizer = load("mlx-community/Muse-Spark-Open-816B-A42B-4bit")

prompt = "hello"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)

You can also use

• mlx-community/Muse-Spark-Open-816B-A42B-oQ3e: mixed-precision oQ quant optimized for oMLX, with the vision encoder. It also runs in mlx-lm 0.32.2.
• mlx-community/Muse-Spark-Open-816B-A42B-oQ4e: the 4-bit oQ quant.
• mlx-community/Muse-Spark-Open-816B-A42B-3bit: the standard mlx-lm 3-bit quant.