CrowQwen3.5 4B Agent Heretic MLX oQ

Apple Silicon oQ builds for a compact Qwen3.5 coding and agent assistant.

Collection · GGUF

CrowQwen3.5 starts from Qwen/Qwen3.5-4B and is tuned toward local assistant work: coding notes, refactor plans, bug triage, shell-oriented workflows, and bilingual technical prompts.

Highlights

• Korean + code + English + agent SFT mix.
• Tool-call formatting support in the chat template.
• Heretic-edited final export selected by internal refusal/KL probe.
• 9 MLX/oMLX oQ variants for Apple Silicon.

Pick A Directory

Start with oQ4 if you are unsure.

Quick Start

huggingface-cli download \
  dawncr0w/crowqwen3.5-4b-agent-heretic-mlx-oq \
  --include "crowqwen3.5-4b-agent-heretic-oQ4/*" \
  --local-dir crowqwen-mlx-oq

from mlx_lm import load, generate

model, tokenizer = load("crowqwen-mlx-oq/crowqwen3.5-4b-agent-heretic-oQ4")
prompt = tokenizer.apply_chat_template(
    [{"role": "user", "content": "Draft a short CLI refactor plan."}],
    tokenize=False,
    add_generation_prompt=True,
)

print(generate(model, tokenizer, prompt=prompt, max_tokens=160))

Artifacts

BUILD_MANIFEST.json has the build and smoke details.

Note

Smoke checks verify local loading and short generation only. No benchmark scores are claimed.