This repository contains GGUF Quantizations of the Huihui-Ministral-3B-Instruct-2512-abliterated model.
The model is based on Ministral 3B, which has been "abliterated" (uncensored) to remove refusal mechanisms. This modification makes it highly responsive and capable of handling complex, unrestricted creative writing tasks. These GGUF files are strictly optimized for high-performance local inference on edge devices, laptops, and consumer-grade hardware.
This model is engineered for efficient local inference on hardware with limited VRAM. It is compatible with major GGUF inference engines including:
It is particularly effective for Creative Writing, Interactive Assistants, and Narrative Generation on edge devices where cloud latency or privacy is a concern. The "abliterated" nature ensures the model follows instructions precisely without unnecessary refusals.
Warning: Uncensored Model This model has undergone "abliteration," a technique that selectively removes safety guardrails.
To prevent the model from generating artifacts (like +++++) or hallucinating user replies at the end of a response, ensure your inference tool uses the following stop sequences:
</s>User:Assistant:You can pull this model directly to your command line:
ollama run hf.co/Abhiray/Huihui-Ministral-3B-Instruct-2512-abliterated-GGUF:Q4_K_M
huihui-ai/Huihui-Ministral-3-3B-Instruct-2512-abliterated