MTP-Qwen3.5-35B-A3B-GGUF

This repository contains MTP GGUF files only for Qwen/Qwen3.5-35B-A3B.

To be used with models without MTP included, such as deepreinforce-ai/Ornith-1.0-35B-GGUF

It does not include the full base model. These files are intended to be used as the MTP / speculative decoding component together with the matching full model GGUF.

Q4_K_M and Q8_0 quants used unsloth/Qwen3.5-35B-A3B-MTP-GGUF for recipe.

Files

Usage

Example with llama-server:

llama-server \
  -m /path/to/Qwen3.5-35B-A3B.gguf \
  -md /path/to/mtp-Q4_K_M.gguf \
  --spec-type draft-mtp \
  --spec-draft-n-max 2

Notes

• These files are not usable standalone.
• Use only with the matching base model.
• License follows the original base model license.