evolai-qwen047-v0
Baseline EvolAI transformer model.
- Base model:
Qwen/Qwen3-0.6B - Tokenizer:
Qwen/Qwen3.5-9B - Kept layers:
[0, 2, 4, 6, 8, 10, 12, 15, 17, 19, 21, 23, 25, 27] - Final params:
0.474265B - Target bucket:
0.45–0.48B
This is a baseline checkpoint for registration and later fine-tuning.