Mage-Flow-Turbo-MLX-Serve-8bit
8-bit mirror of microsoft/Mage-Flow-Turbo for mlx-serve. Half the download, half the memory, same distilled 4-step schedule.
Weights: 9.2 GB (upstream bf16: 17.5 GB).
Judged against bf16 at the same seed on text-to-image, single-reference edits and multi-reference composition: no visible quality difference.
Run it
Download MLX Core.app, open the Image tab, and pick Mage-Flow Turbo 8-bit from the model menu. It downloads with a progress bar and generates in the same window. No terminal, nothing to configure.
Prefer Homebrew? It is a third-party tap, so tap it first:
brew tap ddalcu/mlx-serve https://github.com/ddalcu/mlx-serve
brew install --cask mlx-core
Driving it from code instead? The app runs the server on
http://localhost:11234, so POST to /v1/images/generations.
mlx-serve
A native Zig server for Apple Silicon. No Python, no cloud, no Electron. One 9 MB binary.
- One server, every modality. Chat, images, video, music, speech with voice cloning, and 3D, all running natively on MLX.
- Points at what you already use. OpenAI- and Anthropic-compatible APIs on
http://localhost:11234, so Claude Code, the OpenAI SDK, Continue, Cursor and Open WebUI just work. - Any LLM, not just these. Every MLX model and every GGUF on Hugging Face, with speculative decoding built in.
- MLX Core.app included. Signed macOS menu-bar app: chat, agent mode with MCP tools, model downloads, and every generator above, no terminal needed.
If it is useful to you, a star on GitHub genuinely helps.
Recipe
DiT and text-encoder linears affine-quantized at 8-bit, group size 64, via
mlx.core.quantize. Left at bf16: the whole VAE (its precision is load-bearing
for a distilled 4-step model), the token and position embedding tables (they are
gathered, not matmul'd), and any linear with a dimension under 512.
Dropped because the engine never loads them: the VAE's training-time encoder half. This is the text-to-image build, so the vision tower and the reference-image encoder went with it.
Dropped too, the repo files it never opens: chat_template, tokenizer_config, generation_config, video_preprocessor_config, vocab.json + merges.txt, assets.
Built by tests/convert_mageflow_weights.py in the mlx-serve repo. Original
model and weights by Microsoft, MIT licensed.