LongCat-Audio-Codec: An Audio Tokenizer and Detokenizer Solution Designed for Speech Large Language Models
We are excited to introduce LongCat-Audio-Codec, an audio tokenizer and detokenizer solution designed for speech large language models. It works by generating semantic and acoustic tokens in parallel, enabling high-fidelity audio reconstruction at extremely low bitrates with excellent backend support for Speech LLM.
This repository hosts the resources for LongCat-Audio-Codec. For complete documentation, installation guides, and usage examples, please visit our GitHub Repository.
🗺️ Framework
✨ Key Features
- High Fidelity at Ultra-Low Bitrates: As a codec, it achieves high-intelligibility audio reconstruction at extremely low bitrates.
- Low-Frame-Rate Tokenizer: As a tokenizer, it extracts semantic and acoustic tokens in parallel at a low frame rate of 16.6Hz, with flexible acoustic codebook configurations to adapt to different downstream tasks.
- Low-Latency Streaming Detokenizer: Equipped with a specially designed streaming detokenizer that requires minimal future information to deliver high-quality audio output with low latency.
- Super-Resolution Capability: Integrates audio super-resolution processing into the detokenizer, enabling the generation of high-quality audio with a higher sample rate if the sample rate of original input is lower than 24khz.
📦Resources
| Resourcess | Notes |
|---|---|
| LongCatAudioCodec_encoder | encoder weights of LongCat-Audio-Codec with semantic encoder and acoustic encoder |
| LongCatAudioCodec_encoder_cmvn | coefficients of Cepstral Mean and Variance Normalization, used by encoder |
| LongCatAudioCodec_decoder16k_4codebooks | native 16k decoder, supply 1 semantic codebook and at most 3 acoustic codebooks |
| LongCatAudioCodec_decoder24k_2codebooks | super-resolution 24k decoder, supply 1 semantic codebook and 1 acoustic codebook |
| LongCatAudioCodec_decoder24k_4codebooks | super-resolution 24k decoder, supply 1 semantic codebook and at most 3 acoustic codebooks |
📚 Citation
If you find our work useful in your research, please consider citing:
@article{longcataudiocodec,
title={LongCat-Audio-Codec: An Audio Tokenizer and Detokenizer Solution Designed for Speech Large Language Models},
author={Xiaohan Zhao, Hongyu Xiang, Shengze Ye, Song Li, Zhengkun Tian, Guanyu Chen, Ke Ding, Guanglu Wan},
journal={arXiv preprint arXiv:2510.15227},
organization={LongCat Team, Meituan},
year={2025}
}
📜 License
The code and models in this repository are released under the MIT License. This grants you broad permissions to use, copy, modify, and distribute the software, provided you include the original copyright notice. We claim no ownership over any content you generate using these models.
The software is provided "AS IS", without any warranty. You are fully accountable for your use of the models. Your usage must not involve creating or sharing any content that violates applicable laws, causes harm to individuals, disseminates personal information with harmful intent, spreads misinformation, or targets vulnerable groups.
📩 Contact
Please contact us at longcat-team@meituan.com or open an issue if you have any questions.