Sign up

jcbtc/chadrock3.6-27b-pi-agent-rocmfp4-mtp

🤗 On Hugging Facetext-generationapache-2.015 GBGGUF✓ HF checksums availableupdated today
Magnet

!CHADROCK3.6 27B Pi Agent ROCmFP4 MTP

CHADROCK3.6 27B Pi Agent ROCmFP4 MTP

CHADROCK3.6 27B Pi Agent is a Chadrock ROCmFP4/MTP GGUF release of bytkim/Qwen3.6-27B-MTP-pi-tune-GGUF, tuned for no-thinking local coding-agent loops and served here in Charlie's AMD-focused ROCmFP4 Strix Lean runtime format.

This release is meant for Pi-style terminal agents, repository edits, shell-verifier loops, and direct no-thinking coding workflows on AMD Ryzen AI Max+ 395 / Strix Halo systems. It keeps the upstream Pi tune's non-thinking sampling profile and MTP speculative decoding posture, then converts the model into a compact 14 GB Chadrock ROCmFP4 GGUF for the local Strix runtime.

This GGUF will not run correctly with stock llama.cpp. It needs the pinned ciru-ai/ROCmFPX runner because the file uses ROCmFP4 tensor types that upstream llama.cpp does not currently understand.

Why This Build Exists

The upstream Pi tune is built around the fast no-thinking path: act directly, emit tool-shaped work, and avoid spending the agent loop's wall time on hidden scratchpad tokens. Chadrock adds the AMD runtime piece:

  • ROCmFP4 Strix Lean tensor recipe
  • native draft-MTP serving
  • AMD ROCm/HIP and Vulkan-oriented local runtime path
  • q8 target and draft KV profile
  • one-slot agent serving
  • 128K context profile for local coding sessions

Treat this as a model/runtime pairing for Strix Halo rather than a generic GGUF quant.

Model Lineage

Qwen/Qwen3.6-27B
  -> bytkim/Qwen3.6-27B-MTP-pi-tune-GGUF
       adds:
         - 4-bit QLoRA SFT Pi-style agent trajectories
         - no-thinking coding-agent behavior
         - MTP speculative decoding heads
  -> jcbtc/chadrock3.6-27b-pi-agent-rocmfp4-mtp
       adds:
         - Chadrock ROCmFP4 Strix Lean conversion
         - local AMD Strix profile and run settings

The upstream card describes the source as a 4-bit QLoRA SFT Multi-Token Prediction tune of Qwen3.6-27B for no-thinking agentic coding through a Pi-style harness. This release keeps that behavioral target and changes the local runtime format.

Technical Metadata

| Field | Value |

| --- | --- |

| model size | 27B dense |

| architecture | qwen35 |

| local runtime format | ROCmFP4 Chadrock GGUF |

| direct upstream/source GGUF | bytkim/Qwen3.6-27B-MTP-pi-tune-GGUF |

| upstream revision used locally | 22943ba3319569b743d4cb3832e3aa336785d8b8 |

| local profile | chadrock3.6-27b-pi-agent-rocmfp4 |

| context target | 131072 tokens |

| max generation profile | 65536 tokens |

| draft mode | draft-mtp, n_max=3, p_split=0.10 |

| device profile | ROCm0, split mode none |

| target KV cache | q8_0 |

| draft KV cache | q8_0 |

| batch / ubatch | 2048 / 512 |

| intended hardware | AMD Ryzen AI Max+ 395 / Strix Halo |

Local Coding Benchmarks

All numbers below were measured locally on AMD Ryzen AI Max+ 395 / Strix Halo. The Pi Agent rows use the local profile chadrock3.6-27b-pi-agent-rocmfp4.

Official Scored Rows

| Benchmark | Run | Result |

| --- | --- | ---: |

| EvalPlus HumanEval base | 20260617T164929Z-quick-coding-test-small | 157/164 = 95.73% |

| EvalPlus HumanEval+ | 20260617T164929Z-quick-coding-test-small | 151/164 = 92.07% |

| BigCodeBench Hard Instruct | 20260618T031413Z-full-coding-benchmark-large | 40/148 = 27.03% pass@1 |

For BigCodeBench, the official model score is the original 148-task row. A later 146-task adjusted subset exists in the local lab for debugging ground-truth issues, but it is not the score used here.

The stored Chadrock 27B Coder quality rows are from a different agent/model

lineage, so they are not used as a quality baseline for this Pi Agent release.

Add a quality before/after table only when there is an official stored

EvalPlus/BigCodeBench run for the matching upstream/source Pi Agent under the

same benchmark protocol.

Speed Before / After And Current Profile

The speed comparison below is against the direct upstream/source Pi Agent GGUF,

bytkim/Qwen3.6-27B-MTP-pi-tune-GGUF, not a different Chadrock Coder model.

These are llama-server API rows from June 17, 2026 on the same Strix Halo

host. The current best Chadrock serving profile was selected in a follow-up

ROCm tuning pass on June 18, 2026.

The current measured local winner for this Pi Agent release is:

ROCm0, split none, q8/q8 target and draft KV, batch 2048, ubatch 512,
draft-mtp n-max 3, p-min 0, p-split 0.10, one slot, reasoning off

Against that upstream/source Pi Agent, the Chadrock ROCmFP4 build improved the

published long-prompt row by 1.30x decode speed while also lowering TTFP:

| Workload | Upstream Pi Agent Q4_K_M | Chadrock Pi Agent ROCmFP4 | Chadrock delta |

| --- | ---: | ---: | ---: |

| short prompt, card/default KV, 512 generated tokens | 28.20 tok/s, 1111 ms TTFP | 27.03 tok/s, 874 ms TTFP | 0.96x decode, 21% lower TTFP |

| short prompt, f16 KV, 512 generated tokens | 25.40 tok/s, 922 ms TTFP | 26.69 tok/s, 854 ms TTFP | 1.05x decode, 7% lower TTFP |

| short prompt, q8 KV + MTP n=4, 512 generated tokens | 24.78 tok/s, 945 ms TTFP | 26.11 tok/s, 851 ms TTFP | 1.05x decode, 10% lower TTFP |

| long prompt, card/default KV, 128 generated tokens | 18.87 tok/s, 53.72 s TTFP | 24.52 tok/s, 46.11 s TTFP | 1.30x decode, 14% lower TTFP |

After that upstream/source comparison, the current ROCm tuning pass selected

the best Chadrock serving profile. On the same 512-token smoke prompt, moving

the Chadrock profile from the older Vulkan device path to ROCm improved

generation speed and latency:

| Device path | Decode | TTFP | Prompt throughput | Draft accepted |

| --- | ---: | ---: | ---: | ---: |

| Vulkan0 | 26.94 tok/s | 900 ms | 162.62 tok/s | 332/536 |

| ROCm0 | 27.70 tok/s | 672 ms | 218.11 tok/s | 339/514 |

That ROCm tuning step is a 1.03x decode-speed gain over the Chadrock Vulkan

launch path, about 25% lower TTFP, and about 34% higher prompt throughput

on the smoke run. It is a local serving-setting improvement on top of the

Chadrock-vs-upstream gains above.

For a stricter apples-to-apples high-context check, the same promoted ROCm

profile was rerun against the upstream/source Pi Agent on the same harder

~39K-token prompt with two uncached 512-token generations, same ROCm0 backend,

same q8/q8 target and draft KV, same b2048/u512, and same MTP n=3

settings:

| Model and setting | Mean decode | Mean TTFP | Mean prompt throughput | Draft accepted |

| --- | ---: | ---: | ---: | ---: |

| upstream/source Pi Agent Q4_K_M, ROCm0 q8/q8 b2048 n3 | 16.32 tok/s | 179.04 s | 218.05 tok/s | 711/923 |

| Chadrock Pi Agent ROCmFP4, promoted ROCm profile | 20.60 tok/s | 164.13 s | 237.87 tok/s | 688/1000 |

On that matched high-context run, Chadrock is 1.26x faster on decode, has

about 8% lower TTFP, and has about 9% higher prompt throughput than the

upstream/source Pi Agent.

The same high-context gate also tested harder ROCm variants against the

promoted Chadrock profile:

| Setting | Mean decode | Mean TTFP | Mean prompt throughput | Draft accepted |

| --- | ---: | ---: | ---: | ---: |

| promoted ROCm profile | 20.60 tok/s | 164.13 s | 237.87 tok/s | 688/1000 |

| HSA_ENABLE_SDMA=0 | 20.54 tok/s | 166.14 s | 234.99 tok/s | 688/1000 |

| FATTN_V_NTHREADS=4 build | 20.58 tok/s | 165.84 s | 235.40 tok/s | 688/1000 |

| FATTN_KQ_NTHREADS=2 build | 20.48 tok/s | 164.93 s | 236.72 tok/s | 688/1000 |

Those harder ROCm variants did not beat the promoted profile, so they are not

used in the recommended command below.

During the official BigCodeBench quality run, the Chadrock server metrics recorded:

| Metric | Value |

| --- | ---: |

| peak prompt throughput while active | 254.069 tok/s |

| peak decode throughput while active | 34.8247 tok/s |

| last active prompt throughput | 220.612 tok/s |

| last active decode throughput | 30.3895 tok/s |

These are local benchmark-server measurements, not universal llama.cpp claims. Throughput depends on driver version, clocks, prompt shape, KV cache settings, and MTP acceptance.

Best Settings / Advanced Setup

For the pinned runner build, copy-paste build commands, request-level speculative controls, and the 35B/27B reproduction notes, use the advanced Ciru setup page:

https://llm.ciru.ai/chadrock-rocmfpx/

The current pinned runner build is:

ciru-ai/ROCmFPX commit: 7aa484a2f0a504dc612a3d74a068024f3e6d6353
historical score tag: chadrock-rocmfp4-mtp-scores-20260621

For this Pi Agent release, keep the current local winner:

backend: ROCm0 target + ROCm0 draft
context: 131072
batch / ubatch: 2048 / 512
target KV: q8_0 / q8_0
draft KV: q8_0 / q8_0
MTP: draft-mtp, n_max=3, n_min=0, p_min=0.0, p_split=0.10
serving: one slot, metrics on, no-thinking mode
sampler: temperature=0.7, top_p=0.8, top_k=20, presence_penalty=1.5
reasoning: off, reasoning_format=none, reasoning_budget=0

This is the profile selected by the June 18 ROCm tuning pass. It is the best

fit for Pi-style repository agents because it keeps TTFP low, uses q8 KV for

the target and draft paths, and preserves the no-thinking behavior target.

Run With llama-server

Build Charlie's custom llama.cpp once, download the GGUF, and run:

HSA_OVERRIDE_GFX_VERSION=11.5.1 \
GGML_HIP_ENABLE_UNIFIED_MEMORY=1 \
/path/to/rocmfp4-llama/build-strix-rocmfp4/bin/llama-server \
  -m CHADROCK3.6-27B-Pi-Agent-MTP-ROCmFP4-STRIX_LEAN.gguf \
  --alias chadrock3.6-27b-pi-agent-rocmfp4 \
  --host 127.0.0.1 \
  --port 8080 \
  --jinja \
  -c 131072 \
  -ngl 999 \
  -fa on \
  -dev ROCm0 \
  -sm none \
  -b 2048 \
  -ub 512 \
  -t 16 \
  -tb 32 \
  --cache-type-k q8_0 \
  --cache-type-v q8_0 \
  --ctx-checkpoints 0 \

  --checkpoint-every-n-tokens -1 \

  --spec-type draft-mtp \
  --spec-draft-device ROCm0 \
  --spec-draft-ngl all \
  --spec-draft-type-k q8_0 \
  --spec-draft-type-v q8_0 \
  --spec-draft-n-max 3 \
  --spec-draft-n-min 0 \
  --spec-draft-p-min 0.0 \
  --spec-draft-p-split 0.10 \
  --parallel 1 \
  --temp 0.7 \
  --top-p 0.8 \
  --top-k 20 \
  --min-p 0 \
  --presence-penalty 1.5 \
  --seed 123 \
  --metrics

Use --parallel 1 for this MTP profile. Multi-slot serving changes draft-MTP behavior and is not the intended configuration.

Pi Agent Profile

The local Pi-facing model ID is:

chadrock3.6-27b-pi-agent-rocmfp4

The profile is configured as a no-thinking agentic coding model:

REASONING_MODE=off
REASONING_FORMAT=none
REASONING_BUDGET=0
TEMPERATURE=0.7
TOP_P=0.8
TOP_K=20
PRESENCE_PENALTY=1.5

Point a Pi provider at the OpenAI-compatible llama-server endpoint and use the alias above as the model ID.

Build The Required llama.cpp

git clone https://github.com/ciru-ai/ROCmFPX.git
cd ROCmFPX
git checkout 7aa484a2f0a504dc612a3d74a068024f3e6d6353
env JOBS=16 scripts/build-strix-rocmfp4-mtp.sh llama-server llama-bench

The server binary will be here:

build-strix-rocmfp4/bin/llama-server

Files

| File | Size | SHA256 |

| --- | ---: | --- |

| CHADROCK3.6-27B-Pi-Agent-MTP-ROCmFP4-STRIX_LEAN.gguf | 14 GB | 15f98039eb7da09f743ae6b2f1545ef7059a89af84813d9d510eb8d10e699f68 |

Credits

  • Qwen: Qwen/Qwen3.6-27B base model family.
  • bytkim: Qwen3.6-27B-MTP-pi-tune-GGUF, the direct upstream Pi-tuned GGUF source.
  • charlie12345 / @Italianclownz: ROCmFP4 llama.cpp fork, Strix Halo build path, and AMD-focused MTP runtime work.

Notes

  • This is a text-generation release. The direct upstream Pi tune can be paired with compatible Qwen3.6 vision sidecars, but this Chadrock profile is configured text-only.
  • The benchmark table intentionally uses the official 148-task BigCodeBench row and does not promote the adjusted local subset.
  • The recommended ROCm settings above are the current local winner; harder ROCm compile/runtime variants were tested and rejected because they did not beat the promoted high-context profile.
  • The Pi Agent tuning goal is agent-loop behavior in no-thinking mode, not maximum offline benchmark score.