Pyrex-8B-Instruct-Uncensored GGUF
Quantized builds for Pyrex-8B-Instruct-Uncensored.
| File | Size | Notes |
|---|---|---|
pyrex-f16.gguf |
15.2 GB | Full precision |
pyrex-q4_k_m.gguf |
4.4 GB | Recommended daily driver |
pyrex-q5_k_m.gguf |
5.1 GB | Higher quality |
pyrex-q8_0.gguf |
8.1 GB | Best quality |
Chat format: chatml (<|im_start|>).
Base model: ImposterOnline/Pyrex-8B-Instruct-Uncensored