This model consists of checkpoints for two fast and high-quality non-autoregressive zero-shot text-to-speech models:
ZipVoice, for single-speaker speech generation. Details in paper and demo.
ZipVoice-Dialog, for spoken dialogue generation. Details in paper and demo.
See our Github repository ZipVoice for instructions on using our models.
| Directory | Model Type | Training Data | Initialized from |
|---|---|---|---|
| zipvoice | ZipVoice | Emilia | - |
| zipvoice_libritts | ZipVoice | LibriTTS | - |
| zipvoice_distill | ZipVoice-Distill | Emilia | zipvoice/model.pt |
| zipvoice_distill_libritts | ZipVoice-Distill | LibriTTS | zipvoice_libritts/model.pt |
| zipvoice_dialog | ZipVoice-Dialog | OpenDialog + in-house dataset | zipvoice/model.pt |
| zipvoice_dialog_opendialog | ZipVoice-Dialog | OpenDialog | zipvoice/model.pt |
| zipvoice_dialog_stereo | ZipVoice-Dialog-Stereo | in-house dataset | zipvoice_dialog/model.pt |
You can directly discuss on Github Issues.
You can also scan the QR code to join our wechat group or follow our wechat official account.
| Wechat Group | Wechat Official Account |
|---|---|
@article{zhu2025zipvoice,
title={ZipVoice: Fast and High-Quality Zero-Shot Text-to-Speech with Flow Matching},
author={Zhu, Han and Kang, Wei and Yao, Zengwei and Guo, Liyong and Kuang, Fangjun and Li, Zhaoqing and Zhuang, Weiji and Lin, Long and Povey, Daniel},
journal={arXiv preprint arXiv:2506.13053},
year={2025}
}
@article{zhu2025zipvoicedialog,
title={ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matching},
author={Zhu, Han and Kang, Wei and Guo, Liyong and Yao, Zengwei and Kuang, Fangjun and Zhuang, Weiji and Li, Zhaoqing and Han, Zhifeng and Zhang, Dong and Zhang, Xin and Song, Xingchen and Lin, Long and Povey, Daniel},
journal={arXiv preprint arXiv:2507.09318},
year={2025}
}
Our code is released under the Apache 2.0 License. The pre-trained model is licensed under the CC-BY-NC due to constraints from its training data (Emilia).
zipvoice_dialog_stereo/model.pt 493 MBzipvoice_distill/model.pt 491 MBzipvoice_dialog/model.pt 491 MBzipvoice_dialog_opendialog/model.pt 491 MBzipvoice/model.pt 491 MBzipvoice_distill_libritts/model.pt 491 MBzipvoice_libritts/model.pt 491 MBzipvoice_distill/model.safetensors 491 MBzipvoice/model.safetensors 491 MBzipvoice_distill/fm_decoder.onnx 478 MBzipvoice/fm_decoder.onnx 477 MBzipvoice_distill/fm_decoder_int8.onnx 125 MBzipvoice/fm_decoder_int8.onnx 125 MBzipvoice/text_encoder.onnx 18 MBzipvoice_distill/text_encoder.onnx 18 MBzipvoice/text_encoder_int8.onnx 6 MBzipvoice_distill/text_encoder_int8.onnx 6 MB有文件?提交种子。
提交种子