Run this on your Mac with Outlier — a free macOS app for local MLX inference.

Qwen3-8B (MLX 4-bit)

MLX 4-bit conversion of Qwen/Qwen3-8B. License and base-model fields inherit from the original — see YAML frontmatter above.

Load with mlx-lm

pip install mlx-lm
python -m mlx_lm.generate --model Outlier-Ai/Qwen3-8B-MLX-4bit --prompt "Hello" --max-tokens 256

What is Outlier?

A free macOS app that runs MLX models locally — no cloud, no API keys, no usage caps.

➡ outlier.host

Other Outlier conversions

• Qwen3-Coder-30B-A3B-Instruct (MLX 4-bit) — MLX 4-bit conversion (1,598 downloads)
• Qwen3-14B (MLX 4-bit) — MLX 4-bit conversion (466 downloads)
• Qwen3-32B (MLX 4-bit) — MLX 4-bit conversion (98 downloads)
• Outlier-Core-27B (MLX 4-bit) — MLX 4-bit conversion (55 downloads)
• Outlier-Nano-4B (MLX 4-bit) — MLX 4-bit conversion (67 downloads)

License

Inherits from upstream (apache-2.0). See base model card.