An experiment in fusing creative world simulation and genuine reasoning capability into a single Qwen 3.6 MoE model.
The idea here was simple: find out whether a small reasoning model can roleplay properly if fed high quality data. Every dataset used here includes full thinking traces, so the model reasons its way through creative writing — planning story beats, considering character motivations, and working through consequences before committing to a response.
...Or so the theory goes!
GGUF quants are available here.
Base model is Qwen/Qwen3.6-35B-A3B - MoEs are neat little things, and this one is actually (finally!) remarkably easy to train with Axolotl. Worth noting: thinking traces are noticeably more concise post-training. Qwen3.6 loves to spiral, and apparently feeding it stories helped.
All three training sources are reasoning datasets, meaning every assistant turn includes a full thinking trace:
The model was trained with preserve_thinking: true, so thinking tags are active across all assistant turns in multi-turn conversations, not just the last one.
These settings have been working well for me:
"temperature": 0.8,
"repetition_penalty": 1.05,
"min_p": 0.05
I obviously recommend leaving thinking enabled, and ideally with preserve_thinking turned on.
The model was trained using ChatML via Qwen3.6's chat template, which should be applied automatically.
Since reasoning doesn't tend to play nice with character name prefixes enabled I'm inclined to recommend against using them.
This is, like always, a research release and hasn't gone through extensive quality testing beyond basic sanity checks. The blend of reasoning + creative data is an experiment, and I'm genuinely not sure how well the two domains mix in practice. Let me know what you find! To me it feels absurdly promising, but I could be very wrong here, hence me sharing it with you all.
model-00001-of-00002.safetensors 50 GBmodel-00002-of-00002.safetensors 20 GB