This is a decensored version of Darkhn/Mistral-Medium-3.5-128B-BF16-Text-Only, made using Heretic v1.3.0
[!TIP] This model is reproducible!
See the README in the
reproducedirectory for more information.
Abliteration parameters
| Parameter | Value |
|---|---|
| direction_index | 40.13 |
| attn.o_proj.max_weight | 1.47 |
| attn.o_proj.max_weight_position | 52.50 |
| attn.o_proj.min_weight | 1.39 |
| attn.o_proj.min_weight_distance | 49.92 |
| mlp.down_proj.max_weight | 1.21 |
| mlp.down_proj.max_weight_position | 54.38 |
| mlp.down_proj.min_weight | 0.76 |
| mlp.down_proj.min_weight_distance | 50.68 |
Performance
| Metric | This model | Original model (Darkhn/Mistral-Medium-3.5-128B-BF16-Text-Only) |
|---|---|---|
| KL divergence | 0.0329 | 0 (by definition) |
| Refusals | 8/100 | 93/100 |