ZDTaichu5.0-9B DSpark GGUF

GGUF files for ZDTaichu5.0-9B-DSpark, the official semi-autoregressive speculative decoding draft model developed by the Zi Dong Tai Chu team to accelerate ZDTaichu5.0-9B.

[!NOTE] This is a speculative decoding draft model (D-Spark / DFlash), not a standalone general model. It must be paired with the primary ZDTaichu5.0-9B GGUF model during inference to increase generation speeds by up to 60–85%.

Benchmarks

Benchmark results reported by TaichuAI for the original ZDTaichu5.0-9B foundation model. These figures are not measurements of this GGUF conversion.

GGUF files

Draft model architecture

• Framework: DSpark (semi-autoregressive DFlash backbone + chained Markov head).
• Target Layers: Extracts auxiliary hidden states from target layers [1, 8, 15, 22, 29].
• Block Size: 8 tokens drafted per forward pass (dflash.block_size = 8).
• Target Model: ZDTaichu5.0-9B GGUF.

Usage

Use this draft model alongside the primary target model abenzerps/ZDTaichu5.0-9B-GGUF with llama.cpp (llama-cli or llama-server):

Text generation with Speculative Decoding (llama-cli)

llama-cli \
  -m ZDTaichu5.0-9B-Q4_K_M.gguf \
  -md ZDTaichu5.0-9B-DSpark-Q4_K_M.gguf \
  --spec-type draft-dspark \
  --spec-draft-n-max 8 \
  -c 8192 --jinja \
  --temp 0.7 --top-p 0.95 \
  -p "Explain why reproducible builds matter."

Multimodal vision understanding with Speculative Decoding (llama-cli)

llama-cli \
  -m ZDTaichu5.0-9B-Q4_K_M.gguf \
  -md ZDTaichu5.0-9B-DSpark-Q4_K_M.gguf \
  --mmproj mmproj-ZDTaichu5.0-9B-BF16.gguf \
  --spec-type draft-dspark \
  --spec-draft-n-max 8 \
  --image path/to/image.jpg \
  -p "Describe what is shown in this image in detail."

OpenAI-compatible server with Speculative Decoding (llama-server)

llama-server \
  -m ZDTaichu5.0-9B-Q4_K_M.gguf \
  -md ZDTaichu5.0-9B-DSpark-Q4_K_M.gguf \
  --mmproj mmproj-ZDTaichu5.0-9B-BF16.gguf \
  --spec-type draft-dspark \
  --spec-draft-n-max 8 \
  -c 8192 --jinja -fa on --host 0.0.0.0 --port 8080

Increase context -c up to 131,072 tokens (128K) when sufficient memory is available.

Source and build

• Source draft model: TaichuAI/ZDTaichu5.0-9B-DSpark
• Target base model: TaichuAI/ZDTaichu5.0-9B
• Conversion: ggml-org/llama.cpp commit 7ceed8737fdb4eb09b4760e77bd12d38012de5a8
• License: Apache-2.0
• Checksums: SHA256SUMS.txt