Precomputed artifacts for npu-cosyvoice, which runs
CosyVoice3's flow-matching DiT on the AMD Ryzen AI (XDNA1) NPU. The voice bundle's setup step
downloads these instead of exporting them locally, which saves about 15 minutes of CPU time.
| path | what | made by |
|---|---|---|
weights/ |
int8 DiT weights (W8A8, per-output-channel scales, SmoothQuant on q/k/v) and AdaLN weights | python -m npu_cosyvoice.export |
cv_llm_q4_0.gguf |
CosyVoice3's Qwen2 LM backbone (no output head), Q4_0, for llama.cpp | python -m npu_cosyvoice.llm (llama.cpp 9adc7f4) |
aot/npu1/ |
the 512x1024x1024 int8 GEMM overlay for XDNA1 | scripts/compile_xclbin.py --device npu1 |
SHA256SUMS |
checksums; setup verifies them |
All three are deterministic: rebuilding them with the repository's container reproduces these files
bit for bit (see the repository README). You still need the original CosyVoice3 checkpoint for the
parts that stay in PyTorch (vocoder, embeddings, voice encoder); setup downloads it from ModelScope.
Derived from Fun-CosyVoice3-0.5B-2512
by FunAudioLLM, released under Apache-2.0; these files are distributed under the same license
(see LICENSE). Modifications: the DiT projection weights were quantized to int8 with SmoothQuant
scaling on the q/k/v input, calibrated on four sentences; the LM backbone was converted to GGUF and
quantized to Q4_0 with its unused output head removed. The NPU overlay is generated with
MLIR-AIE (Apache-2.0 WITH LLVM-exception).
weights/L00/f1_w_0_0.bin 1 MBweights/L00/f1_w_0_1.bin 1 MBweights/L00/f2_w_0_0.bin 1 MBweights/L00/f2_w_1_0.bin 1 MBweights/L00/o_w_0_0.bin 1 MBweights/L00/qkv_w_0_0.bin 1 MBweights/L00/qkv_w_0_1.bin 1 MBweights/L00/qkv_w_0_2.bin 1 MBweights/L01/f1_w_0_0.bin 1 MBweights/L01/f1_w_0_1.bin 1 MBweights/L01/f2_w_0_0.bin 1 MBweights/L01/f2_w_1_0.bin 1 MBweights/L01/o_w_0_0.bin 1 MBweights/L01/qkv_w_0_0.bin 1 MBweights/L01/qkv_w_0_1.bin 1 MBweights/L01/qkv_w_0_2.bin 1 MBweights/L02/f1_w_0_0.bin 1 MBweights/L02/f1_w_0_1.bin 1 MBweights/L02/f2_w_0_0.bin 1 MBweights/L02/f2_w_1_0.bin 1 MBweights/L02/o_w_0_0.bin 1 MBweights/L02/qkv_w_0_0.bin 1 MBweights/L02/qkv_w_0_1.bin 1 MBweights/L02/qkv_w_0_2.bin 1 MBweights/L03/f1_w_0_0.bin 1 MBweights/L03/f1_w_0_1.bin 1 MBweights/L03/f2_w_0_0.bin 1 MBweights/L03/f2_w_1_0.bin 1 MBweights/L03/o_w_0_0.bin 1 MBweights/L03/qkv_w_0_0.bin 1 MBweights/L03/qkv_w_0_1.bin 1 MBweights/L03/qkv_w_0_2.bin 1 MBweights/L04/f1_w_0_0.bin 1 MBweights/L04/f1_w_0_1.bin 1 MBweights/L04/f2_w_0_0.bin 1 MBweights/L04/f2_w_1_0.bin 1 MBweights/L04/o_w_0_0.bin 1 MBweights/L04/qkv_w_0_0.bin 1 MBweights/L04/qkv_w_0_1.bin 1 MBweights/L04/qkv_w_0_2.bin 1 MBweights/L05/f1_w_0_0.bin 1 MBweights/L05/f1_w_0_1.bin 1 MBweights/L05/f2_w_0_0.bin 1 MBweights/L05/f2_w_1_0.bin 1 MBweights/L05/o_w_0_0.bin 1 MBweights/L05/qkv_w_0_0.bin 1 MBweights/L05/qkv_w_0_1.bin 1 MBweights/L05/qkv_w_0_2.bin 1 MBweights/L06/f1_w_0_0.bin 1 MBweights/L06/f1_w_0_1.bin 1 MBweights/L06/f2_w_0_0.bin 1 MBweights/L06/f2_w_1_0.bin 1 MBweights/L06/o_w_0_0.bin 1 MBweights/L06/qkv_w_0_0.bin 1 MBweights/L06/qkv_w_0_1.bin 1 MBweights/L06/qkv_w_0_2.bin 1 MBweights/L07/f1_w_0_0.bin 1 MBweights/L07/f1_w_0_1.bin 1 MBweights/L07/f2_w_0_0.bin 1 MBweights/L07/f2_w_1_0.bin 1 MBweights/L07/o_w_0_0.bin 1 MBweights/L07/qkv_w_0_0.bin 1 MBweights/L07/qkv_w_0_1.bin 1 MBweights/L07/qkv_w_0_2.bin 1 MBweights/L08/f1_w_0_0.bin 1 MBweights/L08/f1_w_0_1.bin 1 MBweights/L08/f2_w_0_0.bin 1 MBweights/L08/f2_w_1_0.bin 1 MBweights/L08/o_w_0_0.bin 1 MBweights/L08/qkv_w_0_0.bin 1 MBweights/L08/qkv_w_0_1.bin 1 MBweights/L08/qkv_w_0_2.bin 1 MBweights/L09/f1_w_0_0.bin 1 MBweights/L09/f1_w_0_1.bin 1 MBweights/L09/f2_w_0_0.bin 1 MBweights/L09/f2_w_1_0.bin 1 MBweights/L09/o_w_0_0.bin 1 MBweights/L09/qkv_w_0_0.bin 1 MBweights/L09/qkv_w_0_1.bin 1 MBweights/L09/qkv_w_0_2.bin 1 MBweights/L10/f1_w_0_0.bin 1 MBweights/L10/f1_w_0_1.bin 1 MBweights/L10/f2_w_0_0.bin 1 MBweights/L10/f2_w_1_0.bin 1 MBweights/L10/o_w_0_0.bin 1 MBweights/L10/qkv_w_0_0.bin 1 MBweights/L10/qkv_w_0_1.bin 1 MBweights/L10/qkv_w_0_2.bin 1 MBweights/L11/f1_w_0_0.bin 1 MBweights/L11/f1_w_0_1.bin 1 MBweights/L11/f2_w_0_0.bin 1 MBweights/L11/f2_w_1_0.bin 1 MBweights/L11/o_w_0_0.bin 1 MBweights/L11/qkv_w_0_0.bin 1 MBweights/L11/qkv_w_0_1.bin 1 MBweights/L11/qkv_w_0_2.bin 1 MBweights/L12/f1_w_0_0.bin 1 MBweights/L12/f1_w_0_1.bin 1 MBweights/L12/f2_w_0_0.bin 1 MBweights/L12/f2_w_1_0.bin 1 MBweights/L12/o_w_0_0.bin 1 MBweights/L12/qkv_w_0_0.bin 1 MBweights/L12/qkv_w_0_1.bin 1 MBweights/L12/qkv_w_0_2.bin 1 MBweights/L13/f1_w_0_0.bin 1 MBweights/L13/f1_w_0_1.bin 1 MBweights/L13/f2_w_0_0.bin 1 MBweights/L13/f2_w_1_0.bin 1 MBweights/L13/o_w_0_0.bin 1 MBweights/L13/qkv_w_0_0.bin 1 MBweights/L13/qkv_w_0_1.bin 1 MBweights/L13/qkv_w_0_2.bin 1 MBweights/L14/f1_w_0_0.bin 1 MBweights/L14/f1_w_0_1.bin 1 MBweights/L14/f2_w_0_0.bin 1 MBweights/L14/f2_w_1_0.bin 1 MBweights/L14/o_w_0_0.bin 1 MBweights/L14/qkv_w_0_0.bin 1 MBweights/L14/qkv_w_0_1.bin 1 MBweights/L14/qkv_w_0_2.bin 1 MBweights/L15/f1_w_0_0.bin 1 MBweights/L15/f1_w_0_1.bin 1 MBweights/L15/f2_w_0_0.bin 1 MBweights/L15/f2_w_1_0.bin 1 MBweights/L15/o_w_0_0.bin 1 MBweights/L15/qkv_w_0_0.bin 1 MBweights/L15/qkv_w_0_1.bin 1 MBweights/L15/qkv_w_0_2.bin 1 MBweights/L16/f1_w_0_0.bin 1 MBweights/L16/f1_w_0_1.bin 1 MBweights/L16/f2_w_0_0.bin 1 MBweights/L16/f2_w_1_0.bin 1 MBweights/L16/o_w_0_0.bin 1 MBweights/L16/qkv_w_0_0.bin 1 MBweights/L16/qkv_w_0_1.bin 1 MBweights/L16/qkv_w_0_2.bin 1 MBweights/L17/f1_w_0_0.bin 1 MBweights/L17/f1_w_0_1.bin 1 MBweights/L17/f2_w_0_0.bin 1 MBweights/L17/f2_w_1_0.bin 1 MBweights/L17/o_w_0_0.bin 1 MBweights/L17/qkv_w_0_0.bin 1 MBweights/L17/qkv_w_0_1.bin 1 MBweights/L17/qkv_w_0_2.bin 1 MBweights/L18/f1_w_0_0.bin 1 MBweights/L18/f1_w_0_1.bin 1 MBweights/L18/f2_w_0_0.bin 1 MBweights/L18/f2_w_1_0.bin 1 MBweights/L18/o_w_0_0.bin 1 MBweights/L18/qkv_w_0_0.bin 1 MBweights/L18/qkv_w_0_1.bin 1 MBweights/L18/qkv_w_0_2.bin 1 MBweights/L19/f1_w_0_0.bin 1 MBweights/L19/f1_w_0_1.bin 1 MBweights/L19/f2_w_0_0.bin 1 MBweights/L19/f2_w_1_0.bin 1 MBweights/L19/o_w_0_0.bin 1 MBweights/L19/qkv_w_0_0.bin 1 MBweights/L19/qkv_w_0_1.bin 1 MBweights/L19/qkv_w_0_2.bin 1 MBweights/L20/f1_w_0_0.bin 1 MBweights/L20/f1_w_0_1.bin 1 MBweights/L20/f2_w_0_0.bin 1 MBweights/L20/f2_w_1_0.bin 1 MBweights/L20/o_w_0_0.bin 1 MBweights/L20/qkv_w_0_0.bin 1 MBweights/L20/qkv_w_0_1.bin 1 MBweights/L20/qkv_w_0_2.bin 1 MBweights/L21/f1_w_0_0.bin 1 MBweights/L21/f1_w_0_1.bin 1 MBweights/L21/f2_w_0_0.bin 1 MBweights/L21/f2_w_1_0.bin 1 MBweights/L21/o_w_0_0.bin 1 MBweights/L21/qkv_w_0_0.bin 1 MBweights/L21/qkv_w_0_1.bin 1 MBweights/L21/qkv_w_0_2.bin 1 MBweights/L00/qkv_b.bin 12.3 kBweights/L00/qkv_sw.bin 12.3 kBweights/L01/qkv_b.bin 12.3 kBweights/L01/qkv_sw.bin 12.3 kBweights/L02/qkv_b.bin 12.3 kBweights/L02/qkv_sw.bin 12.3 kBweights/L03/qkv_b.bin 12.3 kBweights/L03/qkv_sw.bin 12.3 kBweights/L04/qkv_b.bin 12.3 kBweights/L04/qkv_sw.bin 12.3 kBweights/L05/qkv_b.bin 12.3 kBweights/L05/qkv_sw.bin 12.3 kBweights/L06/qkv_b.bin 12.3 kBweights/L06/qkv_sw.bin 12.3 kBweights/L07/qkv_b.bin 12.3 kBweights/L07/qkv_sw.bin 12.3 kBweights/L08/qkv_b.bin 12.3 kBweights/L08/qkv_sw.bin 12.3 kBweights/L09/qkv_b.bin 12.3 kBweights/L09/qkv_sw.bin 12.3 kBweights/L10/qkv_b.bin 12.3 kBweights/L10/qkv_sw.bin 12.3 kBweights/L11/qkv_b.bin 12.3 kBweights/L11/qkv_sw.bin 12.3 kBweights/L12/qkv_b.bin 12.3 kBweights/L12/qkv_sw.bin 12.3 kBweights/L13/qkv_b.bin 12.3 kBweights/L13/qkv_sw.bin 12.3 kBweights/L14/qkv_b.bin 12.3 kBweights/L14/qkv_sw.bin 12.3 kBweights/L15/qkv_b.bin 12.3 kBweights/L15/qkv_sw.bin 12.3 kBweights/L16/qkv_b.bin 12.3 kBweights/L16/qkv_sw.bin 12.3 kBweights/L17/qkv_b.bin 12.3 kBweights/L17/qkv_sw.bin 12.3 kBweights/L18/qkv_b.bin 12.3 kBweights/L18/qkv_sw.bin 12.3 kBweights/L19/qkv_b.bin 12.3 kBweights/L19/qkv_sw.bin 12.3 kBweights/L20/qkv_b.bin 12.3 kBweights/L20/qkv_sw.bin 12.3 kBweights/L21/qkv_b.bin 12.3 kBweights/L21/qkv_sw.bin 12.3 kBweights/L00/f1_b.bin 8.2 kBweights/L00/f1_sw.bin 8.2 kBweights/L01/f1_b.bin 8.2 kBweights/L01/f1_sw.bin 8.2 kBweights/L02/f1_b.bin 8.2 kBweights/L02/f1_sw.bin 8.2 kBweights/L03/f1_b.bin 8.2 kBweights/L03/f1_sw.bin 8.2 kBweights/L04/f1_b.bin 8.2 kBweights/L04/f1_sw.bin 8.2 kBweights/L05/f1_b.bin 8.2 kBweights/L05/f1_sw.bin 8.2 kBweights/L06/f1_b.bin 8.2 kBweights/L06/f1_sw.bin 8.2 kBweights/L07/f1_b.bin 8.2 kBweights/L07/f1_sw.bin 8.2 kBweights/L08/f1_b.bin 8.2 kBweights/L08/f1_sw.bin 8.2 kBweights/L09/f1_b.bin 8.2 kBweights/L09/f1_sw.bin 8.2 kBweights/L10/f1_b.bin 8.2 kBweights/L10/f1_sw.bin 8.2 kBweights/L11/f1_b.bin 8.2 kBweights/L11/f1_sw.bin 8.2 kBweights/L12/f1_b.bin 8.2 kBweights/L12/f1_sw.bin 8.2 kBweights/L13/f1_b.bin 8.2 kBweights/L13/f1_sw.bin 8.2 kBweights/L14/f1_b.bin 8.2 kBweights/L14/f1_sw.bin 8.2 kBweights/L15/f1_b.bin 8.2 kBweights/L15/f1_sw.bin 8.2 kBweights/L16/f1_b.bin 8.2 kBweights/L16/f1_sw.bin 8.2 kBweights/L17/f1_b.bin 8.2 kBweights/L17/f1_sw.bin 8.2 kBweights/L18/f1_b.bin 8.2 kBweights/L18/f1_sw.bin 8.2 kBweights/L19/f1_b.bin 8.2 kBweights/L19/f1_sw.bin 8.2 kBweights/L20/f1_b.bin 8.2 kBweights/L20/f1_sw.bin 8.2 kBweights/L21/f1_b.bin 8.2 kBweights/L21/f1_sw.bin 8.2 kBweights/L00/f2_b.bin 4.1 kBweights/L00/f2_sw.bin 4.1 kBweights/L00/o_b.bin 4.1 kBweights/L00/o_sw.bin 4.1 kBweights/L00/qkv_inv_smooth.bin 4.1 kBweights/L01/f2_b.bin 4.1 kBweights/L01/f2_sw.bin 4.1 kBweights/L01/o_b.bin 4.1 kBweights/L01/o_sw.bin 4.1 kBweights/L01/qkv_inv_smooth.bin 4.1 kBweights/L02/f2_b.bin 4.1 kBweights/L02/f2_sw.bin 4.1 kBweights/L02/o_b.bin 4.1 kBweights/L02/o_sw.bin 4.1 kBweights/L02/qkv_inv_smooth.bin 4.1 kBweights/L03/f2_b.bin 4.1 kBweights/L03/f2_sw.bin 4.1 kBweights/L03/o_b.bin 4.1 kBweights/L03/o_sw.bin 4.1 kBweights/L03/qkv_inv_smooth.bin 4.1 kBweights/L04/f2_b.bin 4.1 kBweights/L04/f2_sw.bin 4.1 kBweights/L04/o_b.bin 4.1 kBweights/L04/o_sw.bin 4.1 kBweights/L04/qkv_inv_smooth.bin 4.1 kBweights/L05/f2_b.bin 4.1 kBweights/L05/f2_sw.bin 4.1 kBweights/L05/o_b.bin 4.1 kBweights/L05/o_sw.bin 4.1 kBweights/L05/qkv_inv_smooth.bin 4.1 kBweights/L06/f2_b.bin 4.1 kBweights/L06/f2_sw.bin 4.1 kBweights/L06/o_b.bin 4.1 kBweights/L06/o_sw.bin 4.1 kBweights/L06/qkv_inv_smooth.bin 4.1 kBweights/L07/f2_b.bin 4.1 kBweights/L07/f2_sw.bin 4.1 kBweights/L07/o_b.bin 4.1 kBweights/L07/o_sw.bin 4.1 kBweights/L07/qkv_inv_smooth.bin 4.1 kBweights/L08/f2_b.bin 4.1 kBweights/L08/f2_sw.bin 4.1 kBweights/L08/o_b.bin 4.1 kBweights/L08/o_sw.bin 4.1 kBweights/L08/qkv_inv_smooth.bin 4.1 kBweights/L09/f2_b.bin 4.1 kBweights/L09/f2_sw.bin 4.1 kBweights/L09/o_b.bin 4.1 kBweights/L09/o_sw.bin 4.1 kBweights/L09/qkv_inv_smooth.bin 4.1 kBweights/L10/f2_b.bin 4.1 kBweights/L10/f2_sw.bin 4.1 kBweights/L10/o_b.bin 4.1 kBweights/L10/o_sw.bin 4.1 kBweights/L10/qkv_inv_smooth.bin 4.1 kBweights/L11/f2_b.bin 4.1 kBweights/L11/f2_sw.bin 4.1 kBweights/L11/o_b.bin 4.1 kBweights/L11/o_sw.bin 4.1 kBweights/L11/qkv_inv_smooth.bin 4.1 kBweights/L12/f2_b.bin 4.1 kBweights/L12/f2_sw.bin 4.1 kBweights/L12/o_b.bin 4.1 kBweights/L12/o_sw.bin 4.1 kBweights/L12/qkv_inv_smooth.bin 4.1 kBweights/L13/f2_b.bin 4.1 kBweights/L13/f2_sw.bin 4.1 kBweights/L13/o_b.bin 4.1 kBweights/L13/o_sw.bin 4.1 kBweights/L13/qkv_inv_smooth.bin 4.1 kBweights/L14/f2_b.bin 4.1 kBweights/L14/f2_sw.bin 4.1 kBweights/L14/o_b.bin 4.1 kBweights/L14/o_sw.bin 4.1 kBweights/L14/qkv_inv_smooth.bin 4.1 kBweights/L15/f2_b.bin 4.1 kBweights/L15/f2_sw.bin 4.1 kBweights/L15/o_b.bin 4.1 kBweights/L15/o_sw.bin 4.1 kBweights/L15/qkv_inv_smooth.bin 4.1 kBweights/L16/f2_b.bin 4.1 kBweights/L16/f2_sw.bin 4.1 kBweights/L16/o_b.bin 4.1 kBweights/L16/o_sw.bin 4.1 kBweights/L16/qkv_inv_smooth.bin 4.1 kBweights/L17/f2_b.bin 4.1 kBweights/L17/f2_sw.bin 4.1 kBweights/L17/o_b.bin 4.1 kBweights/L17/o_sw.bin 4.1 kBweights/L17/qkv_inv_smooth.bin 4.1 kBweights/L18/f2_b.bin 4.1 kBweights/L18/f2_sw.bin 4.1 kBweights/L18/o_b.bin 4.1 kBweights/L18/o_sw.bin 4.1 kBweights/L18/qkv_inv_smooth.bin 4.1 kBweights/L19/f2_b.bin 4.1 kBweights/L19/f2_sw.bin 4.1 kBweights/L19/o_b.bin 4.1 kBweights/L19/o_sw.bin 4.1 kBweights/L19/qkv_inv_smooth.bin 4.1 kBweights/L20/f2_b.bin 4.1 kBweights/L20/f2_sw.bin 4.1 kBweights/L20/o_b.bin 4.1 kBweights/L20/o_sw.bin 4.1 kBweights/L20/qkv_inv_smooth.bin 4.1 kBweights/L21/f2_b.bin 4.1 kBweights/L21/f2_sw.bin 4.1 kBweights/L21/o_b.bin 4.1 kBweights/L21/o_sw.bin 4.1 kBweights/L21/qkv_inv_smooth.bin 4.1 kBaot/npu1/mmi8i32_512x1024x1024_64_64_64.bin 2.6 kBHave the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo billchen42/npu-cosyvoice ./model-folderFunAudioLLM/Fun-CosyVoice3-0.5B-2512