This is a decensored version of meta-models/Muse-Glimmer-30B, made using Abliterix v1.12.2
Steering parameters
| Parameter | Value |
|---|---|
| vector_index | per layer |
| attn.o_proj.max_weight | 3.69 |
| attn.o_proj.max_weight_position | 32.35 |
| attn.o_proj.min_weight | 0.45 |
| attn.o_proj.min_weight_distance | 30.02 |
| mlp.down_proj.max_weight | 2.54 |
| mlp.down_proj.max_weight_position | 40.92 |
| mlp.down_proj.min_weight | 1.23 |
| mlp.down_proj.min_weight_distance | 12.85 |
Performance
| Metric | This model | Original model (meta-models/Muse-Glimmer-30B) |
|---|---|---|
| KL divergence | 0.0094 | 0 (by definition) |
| Refusals | 10/100 | 98/100 |