Qwen-4B Sagui (Sagui-4B) is a tiny open-weights model for Ollama and llama.cpp. It reasons step by step, reads images and screenshots, writes TypeScript, and calls tools, all offline. It runs on a 4 GB GPU from 2014.
What "Qwen-4B" means: a 4-billion-parameter model from the Qwen family. It is built on Qwen3.5-4B, not on Qwen 4. It is the same model as Sagui-4B, published under a second name.
Size: 2.4 GB in total: a 1.71 GB model plus a 0.67 GB vision projector. Without images, you only need the 1.71 GB file.
ollama run hf.co/sysrobson/Qwen-4B-Sagui-Vision-Thinking-Code-GGUF:IQ3_XXS
If Sagui saves you a subscription or a GPU upgrade, you can support the project: ☕ PayPal
40% smaller than the Q4_K_M it comes from, for 5 to 9 points less on TypeScript benchmarks. Thinking, vision and tool calling all stay.
| Sagui-4B | Qwen3.5-4B Q4_K_M (source model) | |
|---|---|---|
| Total with vision | 2.38 GB | 3.51 GB |
| Without vision | 1.71 GB | 2.83 GB |
| Thinking, vision, tool calling | ✅ | ✅ |
| HumanEval-TS pass@1 | 44.0% | 52.8% |
| MBPP-TS pass@1 | 54.6% | 59.7% |
| Speed on a GTX 970 (llama.cpp, 4 GB) | 21.2 tok/s | 20.5 tok/s |
| Languages | English, Portuguese and other Latin scripts | Many, including non-Latin scripts |
A sagui is a marmoset, one of the smallest monkeys in the world, native to Brazil. Tiny, sharp-eyed and very quick.
These are unedited outputs from this exact GGUF. Prompts and raw responses are in examples/transcripts.json, and scripts/run_demos.py reproduces them. Sampling isn't seeded, so your wording will vary.
Prompt: This is a screenshot from my editor. Explain the error in one sentence, then give the corrected line 4.
The error occurs because the
reducemethod's initial value of"0"is a string, which cannot be added to a number; it should be replaced with the numeric literal0.return items.reduce((sum, i) => sum + i.price * i.qty, 0);
63 tokens, 26.8 s on a GTX 970.
| Input screenshot | Sagui's code, rendered |
|---|---|
Thinking on, 2332 tokens, 174.2 s on a GTX 970. The code is unedited and the page has no CSS reset. It missed the field placeholders. Without thinking, the same prompt produced correct text and fields but ignored the inline-style request.
Prompt: A train leaves at 14:35 and arrives at 17:10. How long is the trip in minutes?
To find the duration of the trip in minutes, we can calculate the difference between the arrival time and the departure time.
**Step 1: Calculate the time difference**
* **Departure:** 14:35 (2:35 PM)
* **Arrival:** 17:10 (5:10 PM)
First, look at the hours: $17 - 14 = 3$ hours. However, since we are subtracting minutes ($10 - 35$), we cannot simply subtract directly because 10 is less than 35. We need to borrow an hour from the arrival time.
* Borrow 1 hour (60 minutes) from the hours:
$17 \text{ hours } 10 \text{ minutes} = 16 \text{ hours } 70 \text{ minutes}$
Now, subtract the departure time ($14 \text{ hours } 35 \text{ minutes}$) from this adjusted time:
* **Hours:** $16 - 14 = 2$ hours
* **Minutes:** $70 - 35 = 35$ minutes
So, the trip duration is **2 hours and 35 minutes**.
**Step 2: Convert to minutes**
* 2 hours = $2 \times 60 = 120$ minutes.
* Add the remaining minutes: $120 + 35 = 155$.
The trip is **155** minutes long.
3542 tokens, 254.5 s on a GTX 970, most of them reasoning. Thinking checks its work at length, so turn it off when you want speed.
ollama run hf.co/sysrobson/Qwen-4B-Sagui-Vision-Thinking-Code-GGUF:IQ3_XXS
hf download sysrobson/Qwen-4B-Sagui-Vision-Thinking-Code-GGUF --local-dir sagui
cd sagui
ollama create sagui-4b -f Modelfile
ollama run sagui-4b "What is in this image? ./photo.png"
Control thinking per chat with --think or --think=false, or in the API:
curl http://localhost:11434/api/chat -d '{
"model": "sagui-4b",
"think": false,
"messages": [{"role": "user", "content": "Write a debounce function in TypeScript."}]
}'
llama-server -m Sagui-4B-IQ3_XXS.gguf --mmproj mmproj-Sagui-4B-F16.gguf -ngl 99 -c 16384
Ollama can split the model between CPU and GPU to be safe. On our GTX 970 that gave 15.0 tok/s. Forcing every layer onto the GPU gave 22.7 tok/s:
PARAMETER num_gpu 99
Add that line to the Modelfile and run ollama create again. If you run out of memory, remove it or lower num_ctx.
| File | Size | Needed for |
|---|---|---|
Sagui-4B-IQ3_XXS.gguf |
1.71 GB | Everything |
mmproj-Sagui-4B-F16.gguf |
0.67 GB | Images only |
Modelfile, template, params |
small | Ollama setup |
TypeScript code generation on MultiPL-E with greedy decoding. A solution passes only if it type-checks with tsc and passes its tests in Node.
| Benchmark | Sagui-4B IQ3_XXS | Qwen3.5-4B Q4_K_M |
|---|---|---|
| HumanEval-TS | 70/159 (44.0%) | 84/159 (52.8%) |
| MBPP-TS | 213/390 (54.6%) | 233/390 (59.7%) |
These measure raw completion without thinking mode. Completions, failures and the script are in benchmarks/.
Measured on an Intel i5-10400, 16 GB RAM and an NVIDIA GTX 970 (4 GB). With Ollama's default split, about 3.4 GB of VRAM was in use with the desktop running. CPU only: 8.1 tok/s.
groupBy demo, the code ran correctly but failed tsc --strict with TS2322. Review generated code before running it, and don't use the model for medical, legal or safety-critical decisions. Vision was tested on screenshots and simple images, not on photos at scale.Is this Qwen 4? No. "Qwen-4B" means a Qwen-family model with 4 billion parameters. The base is Qwen3.5-4B, and the weights are identical to Sagui-4B.
How small is a local model with vision and thinking? Sagui-4B does vision, reasoning and tool calling in 2.4 GB. Without images, it needs 1.71 GB.
Can it run on 4 GB of VRAM? Yes. Every result here comes from a 4 GB GTX 970.
Does it run without a GPU? Yes, on CPU, at 8.1 tok/s on an i5-10400.
Is it good for coding offline? It's useful for small TypeScript tasks and for explaining errors from screenshots. Larger models are more accurate, as the benchmarks above show.
Was it retrained? No. It has the same weights as Qwen3.5-4B, with a trimmed vocabulary and heavier quantization. See the recipe.
Can I use it commercially? Yes, under Apache 2.0. Keep the LICENSE and NOTICE files.
Sagui-4B é uma IA local de 2,4 GB que pensa, enxerga e programa. São 1,71 GB de modelo mais 0,67 GB do projetor de visão. Sem imagens, basta o arquivo de 1,71 GB. Roda offline com Ollama ou llama.cpp, inclusive em GPU de 4 GB, e responde em português e inglês. Foi calibrado para TypeScript.
"Qwen-4B" quer dizer um modelo da família Qwen com 4 bilhões de parâmetros: a base é o Qwen3.5-4B, não o Qwen 4. É o mesmo modelo do Sagui-4B.
ollama run hf.co/sysrobson/Qwen-4B-Sagui-Vision-Thinking-Code-GGUF:IQ3_XXS
Gostou? Apoie o projeto e compartilhe.
Sagui-4B is free and stays free. Donations pay for the compute and the time behind the next tiny models.
No money to spare? A ❤️ on this page and a post about what you built help just as much.
Sagui-4B is a modified version of Qwen3.5-4B by the Qwen team, converted from the GGUF by Unsloth and quantized with llama.cpp. It is licensed under Apache 2.0, and the changes are listed in NOTICE. This is an independent community project, not affiliated with or endorsed by the Qwen team or Alibaba Cloud.
Qwen/Qwen3.5-4B