Qwen3-TTS-12Hz-0.6B-CustomVoice GGUF for speech.cpp

These files run only in speech.cpp 0.7.0 or later, and the Q6_K, Q5_K and Q4_K files in 0.8.0 or later. Their layout is speech.cpp's own, so llama.cpp, LM Studio, Ollama and other programs that read GGUF cannot run them.

It holds Qwen's Qwen3-TTS 12Hz 0.6B CustomVoice and its codec's decoder in one file. It speaks ten languages with nine named speakers, and passes its audio a few frames at a time as it makes it, so that a player can start on the first chunk.

Use

Install speech.cpp (install), then:

speech tts qwen3-tts-0.6b --voice ono_anna --language ja -o out.wav "明日の東京は晴れです。"
speech tts qwen3-tts-0.6b:q4_k --voice ryan -o out.wav "It will be sunny in Tokyo tomorrow."
speech serve qwen3-tts-0.6b --open

qwen3-tts-0.6b is the name speech.cpp gives this model; speech fetches the Q8_0 file from this repository the first time, and qwen3-tts-0.6b:q4_k or another type of the table below fetches that type instead. A path to a downloaded file works as well. The options, the worker and the HTTP API are in speech.cpp's documentation: Qwen3-TTS, command line and server.

Files

On Vulkan, the Q5_K and Q4_K files need speech.cpp 0.8.4 or later: earlier releases compute them to no finite logit there. A request needs the GGUF file alone; the JSON file lets a program show the model or choose a file without downloading it.

Speakers and languages

The model speaks de, en, es, fr, it, ja, ko, pt, ru and zh, and the language a request gives steers it.

Accuracy

Every stage is checked against the official implementation's tensors:

Each type, measured by speech-bench on 2026-10-12 on an Apple M5 with Metal, on the 20 sentences of speech-bench's prompts/speak-ja-JP.json spoken with seeds 1, 2 and 3 with the speaker ono_anna, and heard by Qwen3-ASR 1.7B in Q8_0: the CER over the 60 takes. The memory is the peak memory footprint of speech for one request. The CER of one type moves by a few points from seed to seed, so only a larger difference tells two types apart.

Speed

speech-bench on 2026-10-08: the 20 sentences of its prompts/speak-ja-JP.json with the speaker ono_anna, one request at a time through the worker, Q8_0.

The first audio is the first chunk. The 0.6B model often begins its speech with silence, as the official implementation does, so the voice is heard later: on the M5, half a second after the request in the median.

Source

Converted by speech.cpp's reference/qwen3-tts/convert.py 0.6b, whose environment pins the official code at QwenLM/Qwen3-TTS@022e286, from Qwen/Qwen3-TTS-12Hz-0.6B-CustomVoice at 85e237c12c027371202489a0ec509ded67b5e4b5, to F32, from which speech quantize --type <type> wrote each file. Every constant the C++ reads is in the file, from the checkpoint or, where it has none, from the official code.

The 1.7B model, which also follows an instruction of how to speak, is qwen3-tts-1.7b in sakasegawa/Qwen3-TTS-12Hz-1.7B-CustomVoice-GGUF.

License

The weights are the Qwen team's, under the Apache License 2.0, as the official checkpoint is. See Qwen/Qwen3-TTS-12Hz-0.6B-CustomVoice for the model and its terms. These files change the format of the weights and quantize them; they do not retrain them.