SpeechT5 TTS — GGUF (ggml-quantised)

GGUF / ggml conversion of microsoft/speecht5_tts for use with CrispStrobe/CrispASR.

SpeechT5 is a lightweight (~80M param) encoder-decoder TTS model:

• Text encoder — 12-layer transformer (768d) with relative positional encoding
• Speech decoder — 6-layer AR decoder generating continuous mel frames (no codebook tokens)
• Postnet — 5-layer Conv1d + BatchNorm + Tanh residual stack
• HiFi-GAN vocoder — 4x upsample (rates [4,4,4,4]) with MRF resblocks to 16 kHz PCM

Speaker conditioning via 512-d x-vector (e.g. from Matthijs/cmu-arctic-xvectors). Deterministic output (greedy decoding, no sampling).

Released under MIT license.

Files

Quick start

# 1. Build CrispASR
git clone https://github.com/CrispStrobe/CrispASR
cd CrispASR
cmake -B build -DCMAKE_BUILD_TYPE=Release
cmake --build build -j --target crispasr-cli

# 2. Download model + speaker
huggingface-cli download cstr/speecht5-tts-GGUF speecht5-tts-f16.gguf speaker.bin --local-dir .

# 3. Synthesize
./build/bin/crispasr --backend speecht5 -m speecht5-tts-f16.gguf \
    --voice speaker.bin \
    --tts "Hello, how are you today?" \
    --tts-output hello.wav

Or with auto-download:

./build/bin/crispasr -m speecht5 --auto-download \
    --tts "The quick brown fox jumps over the lazy dog." \
    --tts-output fox.wav

Python binding

from crispasr import Session

sess = Session("speecht5-tts-f16.gguf")
sess.set_voice("speaker.bin")
pcm = sess.synthesize("Hello world.")
sess.write_wav("hello.wav", pcm)

Architecture details

See docs/architecture.md#speecht5 for the full architecture breakdown.

Conversion

Converted with models/convert-speecht5-tts-to-gguf.py from the CrispASR repo. The HiFi-GAN vocoder weights are from microsoft/speecht5_hifigan and are embedded in the same GGUF file.

Provenance and EU AI Act Art. 53 note

• Upstream model: microsoft/speecht5_tts — published by microsoft.
• Upstream licence: mit. This repository redistributes under the same terms; it grants no rights the upstream licence does not.
• What was done here: format conversion and/or quantisation only (GGUF/GGML). No training, no fine-tuning, no merging, no distillation, no change to architecture, vocabulary or capability. Only the numeric representation of the upstream weights differs.
• Training data: documented — where it is documented at all — by the upstream provider; see the upstream model card. No training data was used, added or selected by this repository.
• Provider status: under Regulation (EU) 2024/1689 the upstream authors remain the provider of this model. Converting the serialisation format does not make this repository the provider of a new general-purpose AI model, and no such claim is made. Questions about training content, copyright policy or model capability belong upstream.