CrowQwen3.5 4B Agent Heretic GGUF

Compact Qwen3.5 local agent builds for coding, planning, and Korean/English developer prompts.

Collection · MLX oQ

CrowQwen3.5 starts from Qwen/Qwen3.5-4B and is tuned toward local assistant work: coding notes, refactor plans, bug triage, shell-oriented workflows, and bilingual technical prompts.

Highlights

• Korean + code + English + agent SFT mix.
• Tool-call formatting support in the chat template.
• Heretic-edited final export selected by internal refusal/KL probe.
• 31 GGUF variants for llama.cpp-compatible runtimes.

Pick A File

Start with Q4_K_M if you are unsure.

Quick Start

llama-cli \
  -hf dawncr0w/crowqwen3.5-4b-agent-heretic-gguf:Q4_K_M \
  -p "Write a short plan to refactor a Python CLI parser." \
  -n 256

llama-server \
  -hf dawncr0w/crowqwen3.5-4b-agent-heretic-gguf:Q4_K_M \
  -c 2048

Files

GGUF variants

gguf_family_manifest.json has the build and smoke details.

Note

Smoke checks verify local loading and short generation only. No benchmark scores are claimed.