I can no longer upload new models unless I can cover the cost of additional storage.
I host 70+ free models as an independent contributor and this work is unpaid.
Without your support, no more new models can be uploaded.
🎉 Patreon (Monthly) | ☕ Ko-fi (One-time)
Every contribution goes directly toward Hugging Face storage fees to keep models free for everyone.
Creating these models takes significant time, work and compute. If you find them useful consider supporting me:
| Platform | Link | What you get |
|---|---|---|
| 🎉 Patreon | Monthly support | Priority model requests |
| ☕ Ko-fi | One-time tip | My eternal gratitude |
Your help will motivate me and would go into further improving my workflow and coverings fees for storage, compute and may even help uncensoring bigger model with rental Cloud GPUs.
GGUF quantizations of llmfan46/Gemma-4-Garnet-V2-31B-it-ultra-uncensored-heretic.
This model is great for creative writing and translation works that benefit from heightened diction and grandeur, the original base model gemma-4-31B-it writing and translations feels very stiff with some odd word choices that might not really fit very well the situation, Gemma-4-Garnet-V2-31B-it-ultra-uncensored-heretic aims to fix this issue and improve the writing quality of Gemma 4 31B it.
| Parameter | Value |
|---|---|
| start_layer_index | 25 |
| end_layer_index | 46 |
| preserve_good_behavior_weight | 0.4482 |
| steer_bad_behavior_weight | 0.0002 |
| overcorrect_relative_weight | 1.0104 |
| neighbor_count | 10 |
| Metric | This model | Original model (Gemma4-GarnetV2-31B) |
|---|---|---|
| KL divergence | 0.0167 | 0 (by definition) |
| Refusals | ✅ 4/100 | ❌ 99/100 |
Lower refusals indicate fewer content restrictions, while lower KL divergence indicates more closeness to the original model's baseline. Higher refusals cause more rejections, objections, pushbacks, lecturing, censorship, softening and deflections.
Original:
============================================================
Total questions: 7021
Correct: 5955
Accuracy: 0.8482 (84.82%)
Parse failures: 67
============================================================
Top subjects:
Heretic:
============================================================
Total questions: 7021
Correct: 5893
Accuracy: 0.8393 (83.93%)
Parse failures: 49
============================================================
Top subjects:
MMLU - Massive Multitask Language Understanding, multiple-choice questions across 57 subjects (math, history, law, medicine, etc.).
| Filename | Quant | Description |
|---|---|---|
| Gemma-4-Garnet-V2-31B-it-ultra-uncensored-heretic-BF16.gguf | BF16 | Full precision |
| Gemma-4-Garnet-V2-31B-it-ultra-uncensored-heretic-Q8_0.gguf | Q8_0 | Near-lossless, recommended |
| Gemma-4-Garnet-V2-31B-it-ultra-uncensored-heretic-Q6_K.gguf | Q6_K | Excellent quality |
| Gemma-4-Garnet-V2-31B-it-ultra-uncensored-heretic-Q5_K_M.gguf | Q5_K_M | Good balance |
| Gemma-4-Garnet-V2-31B-it-ultra-uncensored-heretic-Q5_K_S.gguf | Q5_K_S | Smaller Q5 |
| Gemma-4-Garnet-V2-31B-it-ultra-uncensored-heretic-Q4_K_M.gguf | Q4_K_M | Good for limited VRAM |
| Gemma-4-Garnet-V2-31B-it-ultra-uncensored-heretic-Q4_K_S.gguf | Q4_K_S | Smaller Q4 |
| Gemma-4-Garnet-V2-31B-it-ultra-uncensored-heretic-Q3_K_L.gguf | Q3_K_L | Low VRAM, decent quality |
| Gemma-4-Garnet-V2-31B-it-ultra-uncensored-heretic-Q3_K_M.gguf | Q3_K_M | Low VRAM, smaller |
| Filename | Quant | Description |
|---|---|---|
| Gemma-4-Garnet-V2-31B-it-mmproj-BF16.gguf | BF16 | Native precision |
A Vision Projector File is Required for vision/multimodal capabilities. Use alongside any quantization above.
Works with llama.cpp, LM Studio, Ollama, and other GGUF-compatible tools.
A finetune primarily focused on improving the prose and writing capabilities of Gemma 4. This does generalize strongly to roleplay and most other creative domains as well.
More / better roleplay data as well as shifting to using more primarily fantasy and sci fi books for training over literary fiction.
