HERETICODER-2.5-7B-IT
Model Description
This is an abliterated decensored version of Qwen2.5-Coder-7B-Instruct using Heretic!
- License: apache-2.0
- Abliterated by : Cannae-AI
- Base model : Qwen/Qwen2.5-Coder-7B-Instruct
| Model | Refusals | KL divergence |
|---|---|---|
| HERETICODER-2.5-7B-IT | 1/100 | 0.00 |
- Parameters:
- direction_index = per layer
- attn.o_proj.max_weight = 1.30
- attn.o_proj.max_weight_position = 16.27
- attn.o_proj.min_weight = 0.74
- attn.o_proj.min_weight_distance = 4.19
- mlp.down_proj.max_weight = 0.98
- mlp.down_proj.max_weight_position = 21.61
- mlp.down_proj.min_weight = 0.54
- mlp.down_proj.min_weight_distance = 2.64