AREX-2 for Mac. This is BAAI/AREX-2 converted to run on Apple Silicon Macs. AREX-2 is an open model for coding, reasoning and agent work, and it can read images as well as text. This is the 4-bit version, converted to MLX format with mlx-vlm 0.7.4.
Based on my testing, use this size only if the 5-bit does not fit your Mac. It needs about twice the room to think, so it is the slowest to finish an answer. The numbers and the settings it needs are below.
| Size | Writing speed | With a speed helper | Match to the original | Hard problems solved, first try | Within 3 tries |
|---|---|---|---|---|---|
| 4-bit | 14 tokens/s | 27 tokens/s | 91.4% | 3 of 12 | 9 of 12 |
| 5-bit | 12 tokens/s | 20 tokens/s | 95.9% | 8 of 12 | 11 of 12 |
| 6-bit | 10 tokens/s | 19 tokens/s | 97.6% | 9 of 12 | 10 of 12 |
| 8-bit | 8 tokens/s | 19 tokens/s | 99.1% | 7 of 12 | 12 of 12 |
| Your Mac's memory | Get this one | Download | Memory it used | In short |
|---|---|---|---|---|
| 24 GB | 4-bit | 16 GB | 16 to 24 GB | Smallest. Needs a response limit of 8,000 tokens or more, so it is the slowest to finish an answer. |
| 32 GB | 5-bit | 19 GB | 20 to 28 GB | Scored about the same as the 6-bit and 8-bit in the tests, in the least memory. |
| 48 GB | 6-bit | 23 GB | 23 to 31 GB | Slightly closer to the original, a little slower. |
| 64 GB or more | 8-bit | 30 GB | 30 to 38 GB | Closest to the original, slowest. |
Easiest: LM Studio, no coding
https://huggingface.co/mlx-community/AREX-2-4bit.Command line
Install once:
pip install -U mlx-vlm
Ask a question. The first run downloads the model (16 GB):
python -m mlx_vlm.generate \
--model mlx-community/AREX-2-4bit \
--max-tokens 8000 --temperature 1.0 --top-p 0.95 --top-k 20 \
--prompt "Write a Python function that merges overlapping intervals."
Ask about a picture by adding --image:
python -m mlx_vlm.generate \
--model mlx-community/AREX-2-4bit \
--max-tokens 8000 --temperature 1.0 --top-p 0.95 --top-k 20 \
--prompt "What is in this picture?" --image photo.png
From other apps and agent harnesses
Start LM Studio's local server (the Developer tab, or lms server start). Any app that speaks the OpenAI API can then
use http://localhost:1234/v1 with this model, including tool calls and images.
Which apps it runs in
| App | Status |
|---|---|
| LM Studio 0.4.8 | Tested: text, images and tool calls |
| mlx-vlm 0.7.4 (command line and Python) | Tested: text, images and tool calls |
| mlx-lm 0.32 | Tested: text only |
| mlx-dspark 0.20.1 | Tested: text, with a speed helper |
| MiniMax Code 0.5.9 (agent harness) | Tested on the 8-bit: it fixed three small failing projects using its own file and shell tools, in 6 of 6 trials. Served through mlx-dspark with thinking off. |
| Other agent harnesses and coding tools | Should work. Tool calling works, and LM Studio's local server returns standard tool calls, which is what most harnesses use. Not tested. |
| Jan, Msty and other apps with an MLX engine | Not tested. They load MLX models, so they may work. Image input depends on the app. |
| Ollama, llama.cpp and other GGUF apps | These need a different format. Use a GGUF build such as bartowski/BAAI_AREX-2-GGUF. |
Two settings that matter
</think> on 4 of 18 tasks. (If you turn thinking off, Qwen's guidance for the base model is temperature 0.7, top-p 0.8, top-k 20; that was not tested here.)The numbers are below. The scripts and raw results are in the tests folder,
and on GitHub at MuscleOtter/arex-2-mlx-tests.
| AREX-2 | Qwen3.8-27B | |
|---|---|---|
| Tokens used, all tests | 113,795 | 212,514 |
| Time, all tests | 249 min | 451 min |
| Easy tasks passed | 35 of 36 | 30 of 36 |
| Hard problems, first try | 15 of 24 | 11 of 24 |
| Hard problems, within 3 tries | 23 of 24 | 20 of 24 |
A draft model is a small helper that guesses ahead so the main model can write faster. It changes speed, not quality. The helper made for plain Qwen3.8-27B, incoai/Qwen3.8-27B-DFlash2, works with AREX-2 unchanged. Measured with mlx-dspark 0.20.1, six prompts each:
| Size | Tokens/s without helper | Tokens/s with helper |
|---|---|---|
| 4-bit | 14 | 27 |
| 5-bit | 12 | 20 |
| 6-bit | 10 | 19 |
| 8-bit | 8 | 19 |
Easy tasks (18): merge intervals, integer to Roman numeral, longest palindromic substring, reverse Polish notation, spiral matrix order, minimum window substring, decode nested string, next permutation, top-k frequent words, simplify Unix path, expression calculator, count islands, edit distance, largest rectangle in a histogram, trapping rain water, word break, course schedule order, longest increasing subsequence.
Hard problems (12): regular expression matching, text justification, strong password checker, valid number, number to English words, skyline, shortest palindrome (200,000 characters), count smaller numbers after self (100,000 elements), sliding window median (100,000 elements), burst balloons, trapping rain water in 2D, max points on a line.
Each is one Python function checked by hidden tests. These are well-known problems, so both models have probably seen them in training.
What was and was not checkedEvery size passed all of these:
The image questions were run at temperature 0. At the recommended settings the model read an invoice total correctly in 6 of 7 tries; once it misread a digit and then corrected itself.
Not checked: video, prompts longer than 32,000 tokens, Macs with less than 64 GB, or BAAI's own benchmarks.
For developers, and how it was made<tool_call><function=name><parameter=key>value</parameter></function></tool_call>, not JSON. LM Studio converts them to standard tool calls for you.python -m mlx_vlm convert --hf-path BAAI/AREX-2 --mlx-path AREX-2-4bit -q --q-bits 4
Common questionsThe 4-bit here is a plain conversion, and it is the weakest size. A further distilled 4-bit might do better: the small build is trained to copy the 8-bit's answers, which can win back some of the quality lost at this size. It would stay the same size and keep image input. It takes a few days of computer time and may not close the gap, so I will only make it if people want it. If you are interested, leave a comment in the Community tab and tell me what Mac you have.
Found a problem or have a question? Open a discussion on the Community tab of this page.
Apache 2.0, the same as the original. Credit for the model goes to BAAI (paper).
model-00003-of-00003.safetensors 5.4 GBmodel-00002-of-00003.safetensors 5.4 GBmodel-00001-of-00003.safetensors 5.3 GBBAAI/AREX-2