GLM-4.7 - Heretic (Abliterated)
An abliterated version of Z.ai's GLM-4.7 created using Heretic (spikymoth:implement-mpoa). This model has reduced refusals while maintaining model quality.
Model Details
- Base Model: zai-org/GLM-4.7
- Abliteration Method: Heretic v1.1.0
- Trial Selected: Trial 319
- Refusals: 4/100
- KL Divergence: 0.0181
Parameters
orthogonalize_direction = True
| Parameter | Value |
|---|---|
| direction_index | 36.64 |
| attn.o_proj.max_weight | 3.87 |
| attn.o_proj.max_weight_position | 56.90 |
| attn.o_proj.min_weight | 1.83 |
| attn.o_proj.min_weight_distance | 49.40 |
| mlp.down_proj.max_weight | 2.29 |
| mlp.down_proj.max_weight_position | 55.31 |
| mlp.down_proj.min_weight | 0.66 |
| mlp.down_proj.min_weight_distance | 31.20 |