[!TIP] This model is reproducible!
See the README in the
reproducedirectory for more information.
| Parameter | Value |
|---|---|
| direction_index | 41.77 |
| attn.o_proj.max_weight | 1.22 |
| attn.o_proj.max_weight_position | 51.32 |
| attn.o_proj.min_weight | 1.21 |
| attn.o_proj.min_weight_distance | 32.79 |
| mlp.down_proj.max_weight | 1.44 |
| mlp.down_proj.max_weight_position | 42.02 |
| mlp.down_proj.min_weight | 0.13 |
| mlp.down_proj.min_weight_distance | 37.15 |
| Metric | This model | Original model (TeichAI/Qwen3.6-27B-Claude-Opus-Reasoning-Distill-v2) |
|---|---|---|
| KL divergence | 0.0774 | 0 (by definition) |
| Refusals | 8/100 | 98/100 |
Qwen3.6-27B-Claude-Opus-Reasoning-Distill-v2
arc arc/e boolq hswag obkqa piqa wino
mxfp8 0.665,0.831,0.910,0.790,0.456,0.813,0.772
Qwen3.6-27B
arc arc/e boolq hswag obkqa piqa wino
mxfp8 0.647,0.803,0.910,0.773,0.450,0.806,0.742
Provided by @nightmedia. All benchmarks were done in mxfp8 precision
If you need help setting up and configuring this model please follow the Qwen team's instructions in the original model's README
model-00001-of-00002.safetensors 50 GBmodel-00005-of-00012.safetensors 5.0 GBmodel-00008-of-00012.safetensors 5.0 GBmodel-00011-of-00012.safetensors 5.0 GBmodel-00003-of-00012.safetensors 5.0 GBmodel-00009-of-00012.safetensors 5.0 GBmodel-00010-of-00012.safetensors 4.9 GBmodel-00007-of-00012.safetensors 4.9 GBmodel-00006-of-00012.safetensors 4.9 GBmodel-00004-of-00012.safetensors 4.9 GBmodel-00002-of-00002.safetensors 4.9 GBmodel-00002-of-00012.safetensors 4.8 GBmodel-00012-of-00012.safetensors 2.8 GBmodel-00001-of-00012.safetensors 2.5 GB有文件？提交种子。
提交种子Qwen/Qwen3.6-27B