Abiray/Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated-GGUF

This repository contains GGUF format quantizations of huihui-ai/Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated, which is an uncensored version of empero-ai's Qwythos-9B-Claude-Mythos-5-1M model stripped of its refusal vectors via abliteration techniques.

Additionally, this repository includes the necessary multimodal projection files (mmproj) required to utilize the model's vision/image-to-text capabilities locally.

---

Provided Files & Quantization Details

---

Deployment & Usage Instructions

Ensure you are utilizing a recent build of llama.cpp to natively handle modern Qwen 3.5 architectures and context window stretching constraints.

1. Pure Text Mode (CLI Inference)

To interact with the model purely over terminal text-generation pipelines:

./llama-cli \
  -m Huihui-Qwythos-9B-Claude-Mythos-5-1M-abliterated.Q4_K_M.gguf \
  -ngl 99 \
  -c 32768 \
  -fa on \
  -p "<|im_start|>system\nYou are a helpful assistant.<|im_end|>\n<|im_start|>user\nWrite a short story about an AI break-out.<|im_end|>\n<|im_start|>assistant\n"