Precomputed artifacts for npu-cosyvoice, which runs
CosyVoice3's flow-matching DiT on the AMD Ryzen AI (XDNA1) NPU. The voice bundle's setup step
downloads these instead of exporting them locally, which saves about 15 minutes of CPU time.
| path | what | made by |
|---|---|---|
weights/ |
int8 DiT weights (W8A8, per-output-channel scales, SmoothQuant on q/k/v) and AdaLN weights | python -m npu_cosyvoice.export |
cv_llm_q4_0.gguf |
CosyVoice3's Qwen2 LM backbone (no output head), Q4_0, for llama.cpp | python -m npu_cosyvoice.llm (llama.cpp 9adc7f4) |
aot/npu1/ |
the 512x1024x1024 int8 GEMM overlay for XDNA1 | scripts/compile_xclbin.py --device npu1 |
SHA256SUMS |
checksums; setup verifies them |
All three are deterministic: rebuilding them with the repository's container reproduces these files
bit for bit (see the repository README). You still need the original CosyVoice3 checkpoint for the
parts that stay in PyTorch (vocoder, embeddings, voice encoder); setup downloads it from ModelScope.
Derived from Fun-CosyVoice3-0.5B-2512
by FunAudioLLM, released under Apache-2.0; these files are distributed under the same license
(see LICENSE). Modifications: the DiT projection weights were quantized to int8 with SmoothQuant
scaling on the q/k/v input, calibrated on four sentences; the LM backbone was converted to GGUF and
quantized to Q4_0 with its unused output head removed. The NPU overlay is generated with
MLIR-AIE (Apache-2.0 WITH LLVM-exception).
weights/L00/f1_w_0_0.bin 1 MBweights/L00/f1_w_0_1.bin 1 MBweights/L00/f2_w_0_0.bin 1 MBweights/L00/f2_w_1_0.bin 1 MBweights/L00/o_w_0_0.bin 1 MBweights/L00/qkv_w_0_0.bin 1 MBweights/L00/qkv_w_0_1.bin 1 MBweights/L00/qkv_w_0_2.bin 1 MBweights/L01/f1_w_0_0.bin 1 MBweights/L01/f1_w_0_1.bin 1 MBweights/L01/f2_w_0_0.bin 1 MBweights/L01/f2_w_1_0.bin 1 MBweights/L01/o_w_0_0.bin 1 MBweights/L01/qkv_w_0_0.bin 1 MBweights/L01/qkv_w_0_1.bin 1 MBweights/L01/qkv_w_0_2.bin 1 MBweights/L02/f1_w_0_0.bin 1 MBweights/L02/f1_w_0_1.bin 1 MBweights/L02/f2_w_0_0.bin 1 MBweights/L02/f2_w_1_0.bin 1 MBweights/L02/o_w_0_0.bin 1 MBweights/L02/qkv_w_0_0.bin 1 MBweights/L02/qkv_w_0_1.bin 1 MBweights/L02/qkv_w_0_2.bin 1 MBweights/L03/f1_w_0_0.bin 1 MBweights/L03/f1_w_0_1.bin 1 MBweights/L03/f2_w_0_0.bin 1 MBweights/L03/f2_w_1_0.bin 1 MBweights/L03/o_w_0_0.bin 1 MBweights/L03/qkv_w_0_0.bin 1 MBweights/L03/qkv_w_0_1.bin 1 MBweights/L03/qkv_w_0_2.bin 1 MBweights/L04/f1_w_0_0.bin 1 MBweights/L04/f1_w_0_1.bin 1 MBweights/L04/f2_w_0_0.bin 1 MBweights/L04/f2_w_1_0.bin 1 MBweights/L04/o_w_0_0.bin 1 MBweights/L04/qkv_w_0_0.bin 1 MBweights/L04/qkv_w_0_1.bin 1 MBweights/L04/qkv_w_0_2.bin 1 MBweights/L05/f1_w_0_0.bin 1 MBweights/L05/f1_w_0_1.bin 1 MBweights/L05/f2_w_0_0.bin 1 MBweights/L05/f2_w_1_0.bin 1 MBweights/L05/o_w_0_0.bin 1 MBweights/L05/qkv_w_0_0.bin 1 MBweights/L05/qkv_w_0_1.bin 1 MBweights/L05/qkv_w_0_2.bin 1 MBweights/L06/f1_w_0_0.bin 1 MBweights/L06/f1_w_0_1.bin 1 MBweights/L06/f2_w_0_0.bin 1 MBweights/L06/f2_w_1_0.bin 1 MBweights/L06/o_w_0_0.bin 1 MBweights/L06/qkv_w_0_0.bin 1 MBweights/L06/qkv_w_0_1.bin 1 MBweights/L06/qkv_w_0_2.bin 1 MBweights/L07/f1_w_0_0.bin 1 MBweights/L07/f1_w_0_1.bin 1 MBweights/L07/f2_w_0_0.bin 1 MBweights/L07/f2_w_1_0.bin 1 MBweights/L07/o_w_0_0.bin 1 MBweights/L07/qkv_w_0_0.bin 1 MBweights/L07/qkv_w_0_1.bin 1 MBweights/L07/qkv_w_0_2.bin 1 MBweights/L08/f1_w_0_0.bin 1 MBweights/L08/f1_w_0_1.bin 1 MBweights/L08/f2_w_0_0.bin 1 MBweights/L08/f2_w_1_0.bin 1 MBweights/L08/o_w_0_0.bin 1 MBweights/L08/qkv_w_0_0.bin 1 MBweights/L08/qkv_w_0_1.bin 1 MBweights/L08/qkv_w_0_2.bin 1 MBweights/L09/f1_w_0_0.bin 1 MBweights/L09/f1_w_0_1.bin 1 MBweights/L09/f2_w_0_0.bin 1 MBweights/L09/f2_w_1_0.bin 1 MBweights/L09/o_w_0_0.bin 1 MBweights/L09/qkv_w_0_0.bin 1 MBweights/L09/qkv_w_0_1.bin 1 MBweights/L09/qkv_w_0_2.bin 1 MBweights/L10/f1_w_0_0.bin 1 MBweights/L10/f1_w_0_1.bin 1 MBweights/L10/f2_w_0_0.bin 1 MBweights/L10/f2_w_1_0.bin 1 MBweights/L10/o_w_0_0.bin 1 MBweights/L10/qkv_w_0_0.bin 1 MBweights/L10/qkv_w_0_1.bin 1 MBweights/L10/qkv_w_0_2.bin 1 MBweights/L11/f1_w_0_0.bin 1 MBweights/L11/f1_w_0_1.bin 1 MBweights/L11/f2_w_0_0.bin 1 MBweights/L11/f2_w_1_0.bin 1 MBweights/L11/o_w_0_0.bin 1 MBweights/L11/qkv_w_0_0.bin 1 MBweights/L11/qkv_w_0_1.bin 1 MBweights/L11/qkv_w_0_2.bin 1 MBweights/L12/f1_w_0_0.bin 1 MBweights/L12/f1_w_0_1.bin 1 MBweights/L12/f2_w_0_0.bin 1 MBweights/L12/f2_w_1_0.bin 1 MBweights/L12/o_w_0_0.bin 1 MBweights/L12/qkv_w_0_0.bin 1 MBweights/L12/qkv_w_0_1.bin 1 MBweights/L12/qkv_w_0_2.bin 1 MBweights/L13/f1_w_0_0.bin 1 MBweights/L13/f1_w_0_1.bin 1 MBweights/L13/f2_w_0_0.bin 1 MBweights/L13/f2_w_1_0.bin 1 MBweights/L13/o_w_0_0.bin 1 MBweights/L13/qkv_w_0_0.bin 1 MBweights/L13/qkv_w_0_1.bin 1 MBweights/L13/qkv_w_0_2.bin 1 MBweights/L14/f1_w_0_0.bin 1 MBweights/L14/f1_w_0_1.bin 1 MBweights/L14/f2_w_0_0.bin 1 MBweights/L14/f2_w_1_0.bin 1 MBweights/L14/o_w_0_0.bin 1 MBweights/L14/qkv_w_0_0.bin 1 MBweights/L14/qkv_w_0_1.bin 1 MBweights/L14/qkv_w_0_2.bin 1 MBweights/L15/f1_w_0_0.bin 1 MBweights/L15/f1_w_0_1.bin 1 MBweights/L15/f2_w_0_0.bin 1 MBweights/L15/f2_w_1_0.bin 1 MBweights/L15/o_w_0_0.bin 1 MBweights/L15/qkv_w_0_0.bin 1 MBweights/L15/qkv_w_0_1.bin 1 MBweights/L15/qkv_w_0_2.bin 1 MBweights/L16/f1_w_0_0.bin 1 MBweights/L16/f1_w_0_1.bin 1 MBweights/L16/f2_w_0_0.bin 1 MBweights/L16/f2_w_1_0.bin 1 MBweights/L16/o_w_0_0.bin 1 MBweights/L16/qkv_w_0_0.bin 1 MBweights/L16/qkv_w_0_1.bin 1 MBweights/L16/qkv_w_0_2.bin 1 MBweights/L17/f1_w_0_0.bin 1 MBweights/L17/f1_w_0_1.bin 1 MBweights/L17/f2_w_0_0.bin 1 MBweights/L17/f2_w_1_0.bin 1 MBweights/L17/o_w_0_0.bin 1 MBweights/L17/qkv_w_0_0.bin 1 MBweights/L17/qkv_w_0_1.bin 1 MBweights/L17/qkv_w_0_2.bin 1 MBweights/L18/f1_w_0_0.bin 1 MBweights/L18/f1_w_0_1.bin 1 MBweights/L18/f2_w_0_0.bin 1 MBweights/L18/f2_w_1_0.bin 1 MBweights/L18/o_w_0_0.bin 1 MBweights/L18/qkv_w_0_0.bin 1 MBweights/L18/qkv_w_0_1.bin 1 MBweights/L18/qkv_w_0_2.bin 1 MBweights/L19/f1_w_0_0.bin 1 MBweights/L19/f1_w_0_1.bin 1 MBweights/L19/f2_w_0_0.bin 1 MBweights/L19/f2_w_1_0.bin 1 MBweights/L19/o_w_0_0.bin 1 MBweights/L19/qkv_w_0_0.bin 1 MBweights/L19/qkv_w_0_1.bin 1 MBweights/L19/qkv_w_0_2.bin 1 MBweights/L20/f1_w_0_0.bin 1 MBweights/L20/f1_w_0_1.bin 1 MBweights/L20/f2_w_0_0.bin 1 MBweights/L20/f2_w_1_0.bin 1 MBweights/L20/o_w_0_0.bin 1 MBweights/L20/qkv_w_0_0.bin 1 MBweights/L20/qkv_w_0_1.bin 1 MBweights/L20/qkv_w_0_2.bin 1 MBweights/L21/f1_w_0_0.bin 1 MBweights/L21/f1_w_0_1.bin 1 MBweights/L21/f2_w_0_0.bin 1 MBweights/L21/f2_w_1_0.bin 1 MBweights/L21/o_w_0_0.bin 1 MBweights/L21/qkv_w_0_0.bin 1 MBweights/L21/qkv_w_0_1.bin 1 MBweights/L21/qkv_w_0_2.bin 1 MBweights/L00/qkv_b.bin 12.3 kBweights/L00/qkv_sw.bin 12.3 kBweights/L01/qkv_b.bin 12.3 kBweights/L01/qkv_sw.bin 12.3 kBweights/L02/qkv_b.bin 12.3 kBweights/L02/qkv_sw.bin 12.3 kBweights/L03/qkv_b.bin 12.3 kBweights/L03/qkv_sw.bin 12.3 kBweights/L04/qkv_b.bin 12.3 kBweights/L04/qkv_sw.bin 12.3 kBweights/L05/qkv_b.bin 12.3 kBweights/L05/qkv_sw.bin 12.3 kBweights/L06/qkv_b.bin 12.3 kBweights/L06/qkv_sw.bin 12.3 kBweights/L07/qkv_b.bin 12.3 kBweights/L07/qkv_sw.bin 12.3 kBweights/L08/qkv_b.bin 12.3 kBweights/L08/qkv_sw.bin 12.3 kBweights/L09/qkv_b.bin 12.3 kBweights/L09/qkv_sw.bin 12.3 kBweights/L10/qkv_b.bin 12.3 kBweights/L10/qkv_sw.bin 12.3 kBweights/L11/qkv_b.bin 12.3 kBweights/L11/qkv_sw.bin 12.3 kBweights/L12/qkv_b.bin 12.3 kBweights/L12/qkv_sw.bin 12.3 kBweights/L13/qkv_b.bin 12.3 kBweights/L13/qkv_sw.bin 12.3 kBweights/L14/qkv_b.bin 12.3 kBweights/L14/qkv_sw.bin 12.3 kBweights/L15/qkv_b.bin 12.3 kBweights/L15/qkv_sw.bin 12.3 kBweights/L16/qkv_b.bin 12.3 kBweights/L16/qkv_sw.bin 12.3 kBweights/L17/qkv_b.bin 12.3 kBweights/L17/qkv_sw.bin 12.3 kBweights/L18/qkv_b.bin 12.3 kBweights/L18/qkv_sw.bin 12.3 kBweights/L19/qkv_b.bin 12.3 kBweights/L19/qkv_sw.bin 12.3 kBweights/L20/qkv_b.bin 12.3 kBweights/L20/qkv_sw.bin 12.3 kBweights/L21/qkv_b.bin 12.3 kBweights/L21/qkv_sw.bin 12.3 kBweights/L00/f1_b.bin 8.2 kBweights/L00/f1_sw.bin 8.2 kBweights/L01/f1_b.bin 8.2 kBweights/L01/f1_sw.bin 8.2 kBweights/L02/f1_b.bin 8.2 kBweights/L02/f1_sw.bin 8.2 kBweights/L03/f1_b.bin 8.2 kBweights/L03/f1_sw.bin 8.2 kBweights/L04/f1_b.bin 8.2 kBweights/L04/f1_sw.bin 8.2 kBweights/L05/f1_b.bin 8.2 kBweights/L05/f1_sw.bin 8.2 kBweights/L06/f1_b.bin 8.2 kBweights/L06/f1_sw.bin 8.2 kBweights/L07/f1_b.bin 8.2 kBweights/L07/f1_sw.bin 8.2 kBweights/L08/f1_b.bin 8.2 kBweights/L08/f1_sw.bin 8.2 kBweights/L09/f1_b.bin 8.2 kBweights/L09/f1_sw.bin 8.2 kBweights/L10/f1_b.bin 8.2 kBweights/L10/f1_sw.bin 8.2 kBweights/L11/f1_b.bin 8.2 kBweights/L11/f1_sw.bin 8.2 kBweights/L12/f1_b.bin 8.2 kBweights/L12/f1_sw.bin 8.2 kBweights/L13/f1_b.bin 8.2 kBweights/L13/f1_sw.bin 8.2 kBweights/L14/f1_b.bin 8.2 kBweights/L14/f1_sw.bin 8.2 kBweights/L15/f1_b.bin 8.2 kBweights/L15/f1_sw.bin 8.2 kBweights/L16/f1_b.bin 8.2 kBweights/L16/f1_sw.bin 8.2 kBweights/L17/f1_b.bin 8.2 kBweights/L17/f1_sw.bin 8.2 kBweights/L18/f1_b.bin 8.2 kBweights/L18/f1_sw.bin 8.2 kBweights/L19/f1_b.bin 8.2 kBweights/L19/f1_sw.bin 8.2 kBweights/L20/f1_b.bin 8.2 kBweights/L20/f1_sw.bin 8.2 kBweights/L21/f1_b.bin 8.2 kBweights/L21/f1_sw.bin 8.2 kBweights/L00/f2_b.bin 4.1 kBweights/L00/f2_sw.bin 4.1 kBweights/L00/o_b.bin 4.1 kBweights/L00/o_sw.bin 4.1 kBweights/L00/qkv_inv_smooth.bin 4.1 kBweights/L01/f2_b.bin 4.1 kBweights/L01/f2_sw.bin 4.1 kBweights/L01/o_b.bin 4.1 kBweights/L01/o_sw.bin 4.1 kBweights/L01/qkv_inv_smooth.bin 4.1 kBweights/L02/f2_b.bin 4.1 kBweights/L02/f2_sw.bin 4.1 kBweights/L02/o_b.bin 4.1 kBweights/L02/o_sw.bin 4.1 kBweights/L02/qkv_inv_smooth.bin 4.1 kBweights/L03/f2_b.bin 4.1 kBweights/L03/f2_sw.bin 4.1 kBweights/L03/o_b.bin 4.1 kBweights/L03/o_sw.bin 4.1 kBweights/L03/qkv_inv_smooth.bin 4.1 kBweights/L04/f2_b.bin 4.1 kBweights/L04/f2_sw.bin 4.1 kBweights/L04/o_b.bin 4.1 kBweights/L04/o_sw.bin 4.1 kBweights/L04/qkv_inv_smooth.bin 4.1 kBweights/L05/f2_b.bin 4.1 kBweights/L05/f2_sw.bin 4.1 kBweights/L05/o_b.bin 4.1 kBweights/L05/o_sw.bin 4.1 kBweights/L05/qkv_inv_smooth.bin 4.1 kBweights/L06/f2_b.bin 4.1 kBweights/L06/f2_sw.bin 4.1 kBweights/L06/o_b.bin 4.1 kBweights/L06/o_sw.bin 4.1 kBweights/L06/qkv_inv_smooth.bin 4.1 kBweights/L07/f2_b.bin 4.1 kBweights/L07/f2_sw.bin 4.1 kBweights/L07/o_b.bin 4.1 kBweights/L07/o_sw.bin 4.1 kBweights/L07/qkv_inv_smooth.bin 4.1 kBweights/L08/f2_b.bin 4.1 kBweights/L08/f2_sw.bin 4.1 kBweights/L08/o_b.bin 4.1 kBweights/L08/o_sw.bin 4.1 kBweights/L08/qkv_inv_smooth.bin 4.1 kBweights/L09/f2_b.bin 4.1 kBweights/L09/f2_sw.bin 4.1 kBweights/L09/o_b.bin 4.1 kBweights/L09/o_sw.bin 4.1 kBweights/L09/qkv_inv_smooth.bin 4.1 kBweights/L10/f2_b.bin 4.1 kBweights/L10/f2_sw.bin 4.1 kBweights/L10/o_b.bin 4.1 kBweights/L10/o_sw.bin 4.1 kBweights/L10/qkv_inv_smooth.bin 4.1 kBweights/L11/f2_b.bin 4.1 kBweights/L11/f2_sw.bin 4.1 kBweights/L11/o_b.bin 4.1 kBweights/L11/o_sw.bin 4.1 kBweights/L11/qkv_inv_smooth.bin 4.1 kBweights/L12/f2_b.bin 4.1 kBweights/L12/f2_sw.bin 4.1 kBweights/L12/o_b.bin 4.1 kBweights/L12/o_sw.bin 4.1 kBweights/L12/qkv_inv_smooth.bin 4.1 kBweights/L13/f2_b.bin 4.1 kBweights/L13/f2_sw.bin 4.1 kBweights/L13/o_b.bin 4.1 kBweights/L13/o_sw.bin 4.1 kBweights/L13/qkv_inv_smooth.bin 4.1 kBweights/L14/f2_b.bin 4.1 kBweights/L14/f2_sw.bin 4.1 kBweights/L14/o_b.bin 4.1 kBweights/L14/o_sw.bin 4.1 kBweights/L14/qkv_inv_smooth.bin 4.1 kBweights/L15/f2_b.bin 4.1 kBweights/L15/f2_sw.bin 4.1 kBweights/L15/o_b.bin 4.1 kBweights/L15/o_sw.bin 4.1 kBweights/L15/qkv_inv_smooth.bin 4.1 kBweights/L16/f2_b.bin 4.1 kBweights/L16/f2_sw.bin 4.1 kBweights/L16/o_b.bin 4.1 kBweights/L16/o_sw.bin 4.1 kBweights/L16/qkv_inv_smooth.bin 4.1 kBweights/L17/f2_b.bin 4.1 kBweights/L17/f2_sw.bin 4.1 kBweights/L17/o_b.bin 4.1 kBweights/L17/o_sw.bin 4.1 kBweights/L17/qkv_inv_smooth.bin 4.1 kBweights/L18/f2_b.bin 4.1 kBweights/L18/f2_sw.bin 4.1 kBweights/L18/o_b.bin 4.1 kBweights/L18/o_sw.bin 4.1 kBweights/L18/qkv_inv_smooth.bin 4.1 kBweights/L19/f2_b.bin 4.1 kBweights/L19/f2_sw.bin 4.1 kBweights/L19/o_b.bin 4.1 kBweights/L19/o_sw.bin 4.1 kBweights/L19/qkv_inv_smooth.bin 4.1 kBweights/L20/f2_b.bin 4.1 kBweights/L20/f2_sw.bin 4.1 kBweights/L20/o_b.bin 4.1 kBweights/L20/o_sw.bin 4.1 kBweights/L20/qkv_inv_smooth.bin 4.1 kBweights/L21/f2_b.bin 4.1 kBweights/L21/f2_sw.bin 4.1 kBweights/L21/o_b.bin 4.1 kBweights/L21/o_sw.bin 4.1 kBweights/L21/qkv_inv_smooth.bin 4.1 kBaot/npu1/mmi8i32_512x1024x1024_64_64_64.bin 2.6 kB有文件?提交种子。
提交种子