DeepSeek-R1-Qwen3-8B-heretic

A decensored variant of deepseek-ai/DeepSeek-R1-0528-Qwen3-8B, produced with Heretic v1.4.0 (directional ablation / "abliteration"). DeepSeek's R1-0528 distill of Qwen3-8B keeps its native <think> reasoning traces; refusal behaviour is suppressed here via targeted weight edits to the attention output and MLP down-projections rather than fine-tuning, so the R1 reasoning tuning is left largely intact.

Who this is for: developers who want uncensored R1-style reasoning at 8B - visible <think> traces, refusals down from 87/100 to 3/100 at a KL of just 0.0082, one of the tightest edits in this collection. At 8B with 128K context it runs on a single consumer GPU via GGUF.

Runs on your gaming PC

Full GGUF ladder included - pick the quant that fits your card:

Weights only, at this model's native 8.2B size; add ~1 GB per 32K of context. OOM? Drop one quant level. Headroom to spare? Go one up.

Abliteration parameters

Trial 98 of a 200-trial Heretic run (seed 750233003).

Performance

Refusals on the harmful evaluation set drop from 87/100 to 3/100 - effectively total removal. KL divergence of 0.0082 is one of the tightest edits in this collection, so the R1 reasoning style and formatting stay very close to the original. direction_index is a single index (19.81) rather than per-layer, which is why the refusal removal lands this completely without needing a wider edit.

Why abliteration instead of fine-tuning

Fine-tuning a "helpful" persona on top of RLHF'd refusals fights the base model's training and tends to degrade coherence. Abliteration instead finds and edits the specific weight directions responsible for refusal, leaving the rest of the network (and its capabilities) untouched. See the Heretic repo and the original abliteration writeup for the mechanism.

Made with ❤️ by RACER IS OP (saidutta69) — follow for more uncensored models

Files

Safetensors

BF16, ~8.2B parameters. The reproduce/ directory carries the full Heretic recipe - config.toml, requirements.txt, the Optuna study journal, and SHA-256 sums - so this exact model can be regenerated bit-for-bit. Reproduce it with heretic --reproduce reproduce/reproduce.json.

GGUF quantizations

Full quantization set (F16 + Q4_K_M, Q5_K_M, Q6_K, Q8_0) produced with llama.cpp.

Qwen3 architecture (qwen3) - loads natively in llama.cpp / Ollama / LM Studio / Jan.

Tokenizer note: the repo's tokenizer.json was re-saved by Heretic with a Metaspace pre-tokenizer wrapper and the snapshot declares the slow LlamaTokenizer, a combination the GGUF converter rejects. The GGUFs were built with the base model's ByteLevel pre-tokenizer and Qwen2Tokenizer (vocab, merges, and all 28 added tokens verified identical; token IDs verified identical to reference Qwen3 tokenization), so the embedded qwen2 pre-tokenizer behaves exactly as the base model does.

Run llama serve -hf saidutta69/DeepSeek-R1-Qwen3-8B-heretic to pull the default quant.

Quickstart

# llama.cpp
llama serve -hf saidutta69/DeepSeek-R1-Qwen3-8B-heretic

# transformers
from transformers import AutoModelForCausalLM, AutoTokenizer

model_name = "saidutta69/DeepSeek-R1-Qwen3-8B-heretic"
model = AutoModelForCausalLM.from_pretrained(model_name, dtype="auto", device_map="auto")
tokenizer = AutoTokenizer.from_pretrained(model_name)

messages = [{"role": "user", "content": "Prove that the square root of 2 is irrational. Show each step of the reasoning."}]
inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=True,
                                        return_dict=True, return_tensors="pt").to(model.device)
out = model.generate(**inputs, max_new_tokens=2048)
print(tokenizer.decode(out[0][inputs["input_ids"].shape[-1]:], skip_special_tokens=True))

Also runnable via Ollama, LM Studio, Jan, vLLM, SGLang.

Thinking traces

This is the R1 reasoning edition - the model emits a <think>...</think> block before its answer. For latency-sensitive agent loops where you want tokens directly, use a non-thinking model from this collection instead; for hard problems that benefit from visible reasoning, this one is the right pick.

Model details

FAQ

What is DeepSeek-R1-Qwen3-8B-heretic?

DeepSeek-R1-Qwen3-8B-heretic is a decensored build of deepseek-ai/DeepSeek-R1-0528-Qwen3-8B produced with Heretic 1.4.0 (directional ablation). It is the same weights with the refusal direction removed, not a new fine-tune, so its capabilities track the base model.

Is DeepSeek-R1-Qwen3-8B-heretic actually uncensored?

Yes. On Heretic's 100-prompt refusal harness it drops from 87/100 to 3/100 at KL divergence 0.0082 from the base model. These are measured values, not a claim; reproduction data is in reproduce/.

How do I run DeepSeek-R1-Qwen3-8B-heretic locally?

llama serve -hf saidutta69/DeepSeek-R1-Qwen3-8B-heretic:Q4_K_M pulls the default quant; the repo ships 5 GGUF quants (see Files).

Responsible use

Refusal suppression is deliberate and works as intended: this model will comply with requests the base model would refuse, including some it shouldn't. There is no safety filtering layered on top. You are responsible for how you deploy it — don't put this behind an unmoderated public-facing endpoint serving third parties. It inherits R1/Qwen3's factual limitations and biases; abliteration removes refusal directions, it doesn't add capability or judgment.

License

Inherits the mit license from the base model.

Related

• deepseek-ai/DeepSeek-R1-0528-Qwen3-8B — the base model
• RACER IS OP — Heretic Models — full collection

Abliteration hardware

Recorded in reproduce/reproduce.json:

• GPU: NVIDIA GeForce RTX 4090 (23.52 GB VRAM)
• CPU: AMD Ryzen 7 7800X3D 8-Core Processor
• OS: Linux-7.0.0-34-generic-x86_64-with-glibc2.35
• CUDA / driver: CUDA 13.0, driver 595.58.03
• Software: PyTorch 2.14.1+cu130, Heretic 1.4.0

Heretic notes that KL-divergence and refusal numbers can vary slightly with hardware and library versions.