Mythos-9B-Unhinged GGUF
GGUF quantizations of King3Djbl/mythos-9b-unhinged, a fully uncensored 9B agent model.
Provided quants
| File | Quant | Size | Notes |
|---|---|---|---|
| mythos-9b-unhinged-Q4_K_M.gguf | Q4_K_M | 5.03 GB | ⭐ Best size/quality balance |
| mythos-9b-unhinged-IQ4_XS.gguf | IQ4_XS | 4.56 GB | imatrix — great quality, smaller |
| mythos-9b-unhinged-IQ3_M.gguf | IQ3_M | 3.90 GB | imatrix — low RAM option |
| mythos-9b-unhinged-Q2_K.gguf | Q2_K | 3.28 GB | Very low quality, last resort |
Additional quants available in the source repo.
Usage
llama.cpp:
llama-cli -hf fableforge-ai/mythos-9b-unhinged-GGUF:Q4_K_M -p "Hello!"
Ollama:
ollama run hf.co/fableforge-ai/mythos-9b-unhinged-GGUF:Q4_K_M
🔗 Related models
- 🧠 Base model (safetensors):
mythos-9b-unhinged