BAAI-AREX-Turbo-GGUF
AREX-Turbo (
BAAI/AREX-Turbo) is an Apache-2.0 open-weight 4B dense deep-research agent from BAAI, built onQwen/Qwen3.5-4Bas a compact alternative to the 122B AREX-Base, with a 256K context window. Its recursive self-improvement framework combines iterative research, evidence verification, targeted follow-up searches, and autonomous context updates to improve long-horizon information seeking. Across research benchmarks, it scores 70.7 on BrowseComp, 81.6 on GAIA, 57.0 on xbench-2510, 78.5 on DeepSearchQA, 68.5 on WideSearch-en, and 40.6 on text-only HLE with tools. Despite its smaller size, it outperforms several 30B–235B models, matches Qwen3.5-122B on GAIA, surpasses it on BrowseComp (70.7 vs. 63.8) and WideSearch-en (68.5 vs. 60.5), and exceeds Gemini-3.1-Pro on GAIA, xbench-2510, and WideSearch-en. It usessearch,visit,update_context, andfinishtools for evidence-driven research.
[!NOTE] MTP — Speculative Decoding: No
Model Files
| File Name | Quant Type | File Size | File Link | Description |
|---|---|---|---|---|
| AREX-Turbo.BF16.gguf | BF16 | 8.42 GB | Link | Full BF16 weights. Highest quality, largest file size. |
| AREX-Turbo.Q3_K_L.gguf | Q3_K_L | 2.42 GB | Link | Lower quality but usable, good for low RAM availability. |
| AREX-Turbo.Q3_K_M.gguf | Q3_K_M | 2.26 GB | Link | Low quality. |
| AREX-Turbo.Q4_K_M.gguf | Q4_K_M | 2.71 GB | Link | Good quality, default size for most use cases, recommended. |
| AREX-Turbo.Q4_K_S.gguf | Q4_K_S | 2.56 GB | Link | Slightly lower quality with more space savings, recommended. |
| AREX-Turbo.Q5_K_M.gguf | Q5_K_M | 3.07 GB | Link | High quality, recommended. |
| AREX-Turbo.Q5_K_S.gguf | Q5_K_S | 2.99 GB | Link | High quality, recommended. |
| AREX-Turbo.Q6_K.gguf | Q6_K | 3.46 GB | Link | Very high quality, near perfect, recommended. |
| AREX-Turbo.Q8_0.gguf | Q8_0 | 4.48 GB | Link | Extremely high quality, generally unneeded but max available quant. |
| AREX-Turbo.mmproj-bf16.gguf | mmproj-bf16 | 676 MB | Link | Multimodal projection file in BF16 format. Used for vision/language models. |
llama.cpp
LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp