🧢 Qwen3.5-4B-StreetTalk — GGUF Demos

GGUF quant of wesjos/Qwen3.5-4B-StreetTalk · repo: Qwen3.5-4B-StreetTalk-GGUF

💬 Demo

📊 GRPO reward (JEV)

🚀 Run it

llama-cli -m Qwen3.5-4B-StreetTalk.Q4_K_M.gguf -cnv -c 8192 --temp 0.7 --top-p 0.9

• Qwen3.5-4B-StreetTalk.Q4_K_M.gguf — 2.52 GiB (default)
• qwen3.5-4b-streettalk-q8_0.gguf — 4.29 GiB (near-lossless)
• Qwen3.5-4B-StreetTalk.F16-mmproj.gguf — 0.63 GiB (vision, optional)

License: Apache-2.0