VoxCPM-0.5B — GGUF weights for llama.cpp-omni
GGUF-converted weights of openbmb/VoxCPM-0.5B
for the C++/ggml engine llama.cpp-omni
(tools/omni/voxcpm2). The lightest VoxCPM — runs TTS + voice cloning natively on
CPU / Metal / CUDA / Vulkan, no PyTorch runtime required.
Files
| File | Format | Size | Component |
|---|---|---|---|
VoxCPM-0.5B-BaseLM-F16.gguf |
F16 | ~974 MB | Base language model |
VoxCPM-0.5B-BaseLM-Q8_0.gguf |
Q8_0 | ~519 MB | Base language model, 8-bit (recommended) |
VoxCPM-0.5B-Acoustic-F16.gguf |
F16 | ~560 MB | Acoustic stack (ResidualLM + FSQ + CFM + AudioVAE) |
Output: 16 kHz mono. Use one BaseLM (Q8_0 recommended) + the Acoustic file.
Usage
./voxcpm2-cli -t "Hello from VoxCPM 0.5B." -o out.wav \
VoxCPM-0.5B-BaseLM-Q8_0.gguf VoxCPM-0.5B-Acoustic-F16.gguf
# voice cloning: add -r speaker.wav
Verified on Apple M4 Pro / Metal (RTF ~1.06 — fastest of the VoxCPM family).
Flags: --cfg, --timesteps, --seed, --temperature, -r (clone),
--prompt-wav/--prompt-text (reference-transcript clone), --cpu.
License/terms inherit from the upstream model.