grug think fast. now grug PREDICT own thought before think it. free speedup.
this is grug-35b-v2 (v2.1) with a trained MTP head for multi-token prediction / speculative decoding. base Qwen3.6-27B ship MTP head; ordinary grug-35b-v2 drop it. grug graft head back AND retrain it on grug data so draft match grug's terse output style.
| draft quality (t+2 top-1 agreement on grug outputs) | % |
|---|---|
| random-init head (nothing to graft) | 0.0 |
| after from-scratch grug training | 68.1 |
higher agreement = more accepted drafts = more free speedup. head trained on 3M token of grug v2.1 data, backbone completely frozen (identical quality to grug-35b-v2 - same tensors bit-for-bit).
vLLM (>= 0.19):
vllm serve ProCreations/grug-35b-mtp --max-model-len 32768 \
--reasoning-parser deepseek_r1 \
--speculative-config '{"method":"qwen3_next_mtp","num_speculative_tokens":1}'
gguf with MTP tensors: grug-35b-mtp-gguf (needs llama.cpp build with qwen3_5 MTP speculative support).
no MTP wanted? use plain grug-35b-v2 - same brain, smaller checkpoint. grug made by ProCreations.
model-00010-of-00018.safetensors 4.0 GBmodel-00016-of-00018.safetensors 4.0 GBmodel-00013-of-00018.safetensors 4.0 GBmodel-00004-of-00018.safetensors 4.0 GBmodel-00008-of-00018.safetensors 4.0 GBmodel-00015-of-00018.safetensors 4.0 GBmodel-00003-of-00018.safetensors 4.0 GBmodel-00011-of-00018.safetensors 4.0 GBmodel-00007-of-00018.safetensors 3.9 GBmodel-00012-of-00018.safetensors 3.9 GBmodel-00017-of-00018.safetensors 3.9 GBmodel-00005-of-00018.safetensors 3.9 GBmodel-00006-of-00018.safetensors 3.9 GBmodel-00009-of-00018.safetensors 3.8 GBmodel-00014-of-00018.safetensors 3.8 GBmodel-00002-of-00018.safetensors 3.8 GBmodel-00001-of-00018.safetensors 3.8 GBmodel-00018-of-00018.safetensors 3.6 GBmodel-mtp.safetensors 1.7 GB