gguf quantized version of chatterbox
- base model from resembleai
- text-to-speech synthesis
connector c3 (*multilingual update)
ggc c3
*note: for c3, you might need to downgrade transformers to 4.46.3 (c2 below compatible with the latest version); upgrade chichat to 0.0.4, and opt t3_23lang clip instead of t3_cfg
run it with gguf-connector
ggc c2
| Prompt | Audio Sample |
|---|---|
Hey Connector, why your appearance looks so stupid?Oh, really? maybe I ate too much smart beans.Wow. Amazing.Let's go to get some more smart beans and you will become stupid as well. |
🎧 audio-sample-1 |
Now let's make my mum's favourite. So three mars bars into the pan. Then we add the tuna and just stir for a bit, just let the chocolate and fish infuse. A sprinkle of olive oil and some tomato ketchup. Now smell that. Oh boy this is going to be incredible. |
🎧 audio-sample-2 |
review/reference
- simply execute the command (
ggc c2) above in console/terminal - opt a
vae, aclip(encoder)and amodelfile in the current directory to interact with (see example below)
GGUF file(s) available. Select which one for ve:
- s3gen-bf16.gguf
- s3gen-f16.gguf
- s3gen-f32.gguf
- t3_cfg-q2_k.gguf
- t3_cfg-q4_k_m.gguf
- t3_cfg-q6_k.gguf
- ve_fp32-f16.gguf (recommended)
- ve_fp32-f32.gguf
Enter your choice (1 to 8): 7
ve file: ve_fp32-f16.gguf is selected!
GGUF file(s) available. Select which one for t3:
- s3gen-bf16.gguf
- s3gen-f16.gguf
- s3gen-f32.gguf
- t3_cfg-q2_k.gguf
- t3_cfg-q4_k_m.gguf (recommended)
- t3_cfg-q6_k.gguf
- ve_fp32-f16.gguf
- ve_fp32-f32.gguf
Enter your choice (1 to 8): 5
t3 file: t3_cfg-q4_k_m.gguf is selected!
GGUF file(s) available. Select which one for s3gen:
- s3gen-bf16.gguf (recommended)
- s3gen-f16.gguf (for non-cuda user)
- s3gen-f32.gguf
- t3_cfg-q2_k.gguf
- t3_cfg-q4_k_m.gguf
- t3_cfg-q6_k.gguf
- ve_fp32-f16.gguf
- ve_fp32-f32.gguf
Enter your choice (1 to 8): _
- note: for the latest update, only tokenizer will be pulled to cache automatically during the first launch; you need to prepare the model, encoder and vae files yourself, working like vision connector right away; mix and match, more flexible
- run it entirely offline; i.e., from local URL: http://127.0.0.1:7860 with lazy webui
- gguf-connector (pypi)