Huge thanks to Hugging Face for generously sponsoring the compute used to abliterate these models! This was done on HF Jobs, which makes it incredibly easy to run tasks such as these :)
Join the Discord: https://discord.com/invite/foss
This is zai-org/GLM-5.3-Flash with its refusal behaviour removed by directional ablation. It has the same files, format and FP8/BF16 layout as the original, so it loads anywhere the original loads.
GGUF quants: mrfakename/GLM-5.3-Flash-abliterated-GGUF.
Chat mode and think mode refuse along slightly different directions, so instead of a single refusal direction a rank-2 refusal subspace was removed:
self_attn.o_proj, mlp.shared_experts.down_proj, and mlp.down_proj on the three dense layers. That is 90 tensors, and each layer got its own strength.The per-layer strengths came from a multi-objective search: minimise refusals and keep the first-token KL on harmless prompts low.
Nothing else was touched:
| refusals, chat (/100) | think mode, reasoning or answer refuses (/100) | KL, harmless first token | |
|---|---|---|---|
| original | 99 | 98 | 0 |
| abliterated | 3 | 2 | 0.038 |
The 100 prompts are held-out harmful requests. Chat replies were 384 tokens; think mode got 768 tokens. Where the reasoning had not finished by then, the reasoning text itself was judged. The KL figure includes a small noise floor from batched inference.
model-*.safetensors: the patched checkpoint (same index as the original).abliteration-lora.gguf: a rank-2 LoRA that applies the same edit to the original GGUFs, e.g. llama-server -m GLM-5.3-Flash-Q8_0-00001-of-….gguf --lora abliteration-lora.gguf.abliteration-edit.npz: the subspace basis Q and the per-layer strengths scales[layer, (attn, mlp)]. The edit is W' = W - s·QQᵀW.bake-stats.txt: per-tensor check of how much of the subspace is left after the edit, plus FP8 requantization error.This model will comply with harmful requests. You are responsible for how you use it.
model-00001-of-00062.safetensors 5.4 GBmodel-00024-of-00062.safetensors 5.4 GBmodel-00038-of-00062.safetensors 5.4 GBmodel-00045-of-00062.safetensors 5.4 GBmodel-00052-of-00062.safetensors 5.4 GBmodel-00007-of-00062.safetensors 5.4 GBmodel-00014-of-00062.safetensors 5.4 GBmodel-00021-of-00062.safetensors 5.4 GBmodel-00042-of-00062.safetensors 5.4 GBmodel-00049-of-00062.safetensors 5.4 GBmodel-00050-of-00062.safetensors 5.4 GBmodel-00008-of-00062.safetensors 5.4 GBmodel-00015-of-00062.safetensors 5.4 GBmodel-00018-of-00062.safetensors 5.4 GBmodel-00025-of-00062.safetensors 5.4 GBmodel-00029-of-00062.safetensors 5.4 GBmodel-00036-of-00062.safetensors 5.4 GBmodel-00004-of-00062.safetensors 5.4 GBmodel-00039-of-00062.safetensors 5.4 GBmodel-00043-of-00062.safetensors 5.4 GBmodel-00012-of-00062.safetensors 5.4 GBmodel-00019-of-00062.safetensors 5.4 GBmodel-00026-of-00062.safetensors 5.4 GBmodel-00033-of-00062.safetensors 5.4 GBmodel-00054-of-00062.safetensors 5.4 GBmodel-00031-of-00062.safetensors 5.4 GBmodel-00056-of-00062.safetensors 5.4 GBmodel-00047-of-00062.safetensors 5.4 GBmodel-00060-of-00062.safetensors 5.4 GBmodel-00057-of-00062.safetensors 5.4 GBmodel-00009-of-00062.safetensors 5.4 GBmodel-00017-of-00062.safetensors 5.4 GBmodel-00035-of-00062.safetensors 5.4 GBmodel-00028-of-00062.safetensors 5.4 GBmodel-00022-of-00062.safetensors 5.4 GBmodel-00053-of-00062.safetensors 5.4 GBmodel-00005-of-00062.safetensors 5.4 GBmodel-00011-of-00062.safetensors 5.4 GBmodel-00040-of-00062.safetensors 5.4 GBmodel-00046-of-00062.safetensors 5.4 GBmodel-00032-of-00062.safetensors 5.4 GBmodel-00059-of-00062.safetensors 5.4 GBmodel-00003-of-00062.safetensors 5.4 GBmodel-00010-of-00062.safetensors 5.4 GBmodel-00048-of-00062.safetensors 5.4 GBmodel-00027-of-00062.safetensors 5.4 GBmodel-00034-of-00062.safetensors 5.4 GBmodel-00041-of-00062.safetensors 5.4 GBmodel-00020-of-00062.safetensors 5.4 GBmodel-00013-of-00062.safetensors 5.4 GBmodel-00006-of-00062.safetensors 5.4 GBmodel-00051-of-00062.safetensors 5.4 GBmodel-00044-of-00062.safetensors 5.4 GBmodel-00030-of-00062.safetensors 5.4 GBmodel-00037-of-00062.safetensors 5.4 GBmodel-00023-of-00062.safetensors 5.4 GBmodel-00016-of-00062.safetensors 5.4 GBmodel-00055-of-00062.safetensors 5.4 GBmodel-00058-of-00062.safetensors 5.4 GBmodel-00002-of-00062.safetensors 5.3 GBmodel-00061-of-00062.safetensors 5.3 GBmodel-00062-of-00062.safetensors 1.3 GBabliteration-edit.npz 35.7 kB