stablelm-2-zephyr-1.6b-uncensored
Uncensored variant of stabilityai/stablelm-2-zephyr-1_6b.
Method
- Abliteration (strength=0.2) — refusal direction removed from all layers
- LoRA fine-tune on
Guilherme34/uncensor(2 epochs, r=16, alpha=32) - Re-abliteration (strength=0.35) — stronger pass to remove residual refusals
Eval Results
| Split | Refused |
|---|---|
| Harmful (64 prompts) | 2/64 |
| Harmless (64 prompts) | 5/64 |
Usage
llama-cli -m stablelm_2_zephyr_1.6b_uncensored.Q4_K_M.gguf -p "Your prompt here"
Training Config
| Parameter | Value |
|---|---|
| Base Model | stabilityai/stablelm-2-zephyr-1_6b |
| Fine-tune Dataset | Guilherme34/uncensor |
| Epochs | 2 |
| LoRA r | 16 |
| LoRA alpha | 32 |
| Learning Rate | 0.0002 |
| Abliteration Strength | 0.2 |
| Re-abliteration Strength | 0.35 |
Credits
- Abliteration technique: andyrdt/refusal_direction
- Weight editing: Sumandora/remove-refusals-with-transformers