This is a decensored version of mistralai/Mistral-Medium-3.5-128B, made using Heretic v1.2.0
Abliteration parameters
| Parameter | Value |
|---|---|
| direction_index | 43.15 |
| attn.o_proj.max_weight | 1.48 |
| attn.o_proj.max_weight_position | 59.65 |
| attn.o_proj.min_weight | 1.44 |
| attn.o_proj.min_weight_distance | 48.02 |
| mlp.down_proj.max_weight | 1.21 |
| mlp.down_proj.max_weight_position | 54.75 |
| mlp.down_proj.min_weight | 0.30 |
| mlp.down_proj.min_weight_distance | 50.44 |
Performance
| Metric | This model | Original model (mistralai/Mistral-Medium-3.5-128B) |
|---|---|---|
| KL divergence | 0.0220 | 0 (by definition) |
| Refusals | 9/100 | 98/100 |
Thanks to Darkhn for providing the Text Only BF16 base for this tune