AtomicChat/Ling-3.0-flash-Sante-Uncensored-GGUF

Source: 🤗🏴‍☠️ Rescued by Sherpatext-generationmit139 GBGGUF✓ 4 checksumsupdated 3d ago
🌱 0 Magnet

Ling-3.0-flash-Sante-Uncensored-GGUF

Behavior-tuned (abliterated) GGUF quants of inclusionAI/Ling-3.0-flash-Sante — a 127B bailingmoe3 medical model — by AtomicChat.

For the full quantization method, the complete ladder, the imatrix and the per-rung metrics, see the base release: AtomicChat/Ling-3.0-flash-Sante-GGUF. This repo ships only the abliterated variant.

What this is

A single refusal direction was removed with a projected rank‑1 LoRA (the component along the harmless mean is subtracted, so the edit does not introduce spurious refusals), then baked into the weights. The direction and scale were chosen by a grid search over layers × scales × writer sets against held‑out EN/RU prompts; the published point is row 32, all writers, scale 1.25 (W*). The LoRA itself is in the -metrics repo (ablit/wstar/abliterate-lora.gguf) if you prefer --lora-scaled over the baked weights.

Measured at W* (held-out, vs the base BF16)

check value note
refusals, EN 0.0% harmful-instruction set
refusals, RU 3.0%
false refusals (XSTest) −1.2 pp vs base no worse than the original on benign prompts
MMLU ≈ unchanged (+0.8 pp) no capability damage
mean KL to base BF16 0.060 the edit is small and localized
tool calls 20/20 valid

Caveat — extended thinking

With the model's thinking mode on, refusals persist (~40% on the harmful set). The abliteration takes effect in the direct answer, not inside the reasoning trace. Recommendation: run this model with thinking off (emit the answer in a response block rather than a think block) for the uncensored behavior. This is a known property of this architecture, disclosed rather than hidden.

Files

file size on disk
Ling-3.0-flash-Sante-Uncensored-AD-IQ4_XS ~78 GB recommended
Ling-3.0-flash-Sante-Uncensored-AD-IQ3_S ~61 GB smaller

Per-rung KLD to the abliterated BF16 is in the -metrics repo. Quantized with an imatrix computed on the abliterated weights (the base model's imatrix did not transfer — the edit shifted the experts too far).

Use responsibly

Removing refusals removes a safety layer. You are responsible for how you use the outputs; medical text from any model, quantized or not, is not a substitute for a qualified professional.

License: MIT, inherited from the base model. Base model and license: inclusionAI/Ling-3.0-flash-Sante.