[!TIP] This model is reproducible!
See the README in the
reproducedirectory for more information.
You can find quants/GGUFs here.
| Parameter | Value |
|---|---|
| start_layer_index | 32 |
| end_layer_index | 63 |
| preserve_good_behavior_weight | 0.9540 |
| steer_bad_behavior_weight | 0.0001 |
| overcorrect_relative_weight | 0.2984 |
| neighbor_count | 11 |
Model weights loaded in BNB 4bit quantization in Heretic. The resulting 16bit LoRA adaptor has been merged back into the BF16 model.
| Metric | This model | Original model (xtools-at/Qwen3.8-27B-CodeForge-3xMerge) |
|---|---|---|
| Refusals | 11/100 | 95/100 |
| KL divergence | 0.0128 | 0 (by definition) |
A three-way merge bringing together coding, reasoning, and distilled conversational capabilities.
Looking for quantizations/GGUFs? Click here
This model is a weighted merge of three independently fine-tuned versions of Qwen3.8-27B. The idea behind the merge is fairly straightforward: combine different training approaches and strengths without leaning too heavily into just one specialization.
The three contributors bring complementary qualities:
The goal is a versatile general-purpose model that can write and understand code, work through challenging problems, follow instructions, and handle longer reasoning tasks while avoiding unnecessary reasoning overhead.
The model was created by merging the following checkpoints with these weights:
| Model | Merge weight |
|---|---|
| nerkyor/Qwen3.8-27B-Coder390-EfficientThink-[...] | 1.00 |
| TeichAI/Qwen3.8-27B-Fable-Distill | 0.85 |
| Jackrong/Qwopus3.8-27B-Coder-Flash | 0.70 |
All three models share Qwen3.8-27B as their underlying foundation.
The weights above are the merge coefficients, not percentages of training data or a claim about each model's relative contribution to a particular capability.
This is the most extensively post-trained contributor of the three. It builds on nerkyor's own EfficientThink SFT + SimPO checkpoint, itself derived from the official Qwen3.8-27B model.
Its training combines multiple rounds of supervised fine-tuning (SFT) and Reinforcement Learning from Offline/Online-style comparisons (RLOO, as described in the upstream recipe).
The training provenance is particularly interesting:
The EfficientThink objective is to reduce unproductive reasoning loops and runaway thought sequences without removing the ability to reason deeply when a problem actually requires it.
The Coder390 name reflects the author's stated GPQA, MMLU, and LiveCodeBench performance targets. The upstream model also includes MTP and DFlash2 speculative-decoding components.
This contributor brings additional reasoning refinement, coding specialization, and an explicit focus on efficient problem-solving.
Fable Distill is a relatively light fine-tune of Qwen3.8-27B, trained on a combination of publicly identified Fable datasets and a larger private corpus of Fable 5 data.
The two publicly listed datasets are:
The model's stated goal is to transfer useful Fable 5 conversational and problem-solving behavior into the Qwen3.8 architecture. Its published ARC Challenge and BoolQ results also suggest an emphasis on retaining and improving general knowledge and instruction-following capabilities.
This contributor adds a different flavor to the merge: conversational ability, knowledge-oriented responses, and distilled teacher behavior.
A coding-focused fine-tune built on Qwen3.8-27B, with an emphasis on practical software engineering and agentic workflows.
Its training philosophy revolves around making each token count: understanding a task, planning an implementation, using tools, inspecting feedback, fixing errors, and delivering a working result.
The published training recipe describes approximately 200K code and reasoning examples, covering agent interactions, algorithmic problems, code generation, and logical reasoning. Its data sources include teacher-generated examples from Qwen3.8-Flash-Max, Qwen3.8-Max, DeepSeek-V4-Flash, and the NVIDIA Nemotron ecosystem.
This contributor is intended to bring strong implementation skills, code quality, tool-use behavior, and more purposeful reasoning.
The merged model is intended for:
It should be considered an experimental general-purpose merge rather than a model optimized for just one benchmark or task.
This is a weight-space merge, not a new round of supervised fine-tuning or reinforcement learning. Combining checkpoints does not guarantee that every capability of every contributor will be preserved.
Potential limitations include:
As always, generated code and reasoning should be checked before being used in production or other consequential settings.
A big thank-you to the people behind the three upstream models and to the wider Qwen ecosystem.
Special thanks to:
This merge builds on their work rather than replacing it. Please visit and credit the original repositories when using or redistributing the model.
The three listed upstream model repositories specify Apache-2.0. This model card uses the same license designation; users should review the upstream model and dataset terms and any applicable third-party terms before redistribution or commercial use.
model-00005-of-00012.safetensors 5.0 GBmodel-00008-of-00012.safetensors 5.0 GBmodel-00011-of-00012.safetensors 5.0 GBmodel-00003-of-00012.safetensors 5.0 GBmodel-00009-of-00012.safetensors 5.0 GBmodel-00010-of-00012.safetensors 4.9 GBmodel-00007-of-00012.safetensors 4.9 GBmodel-00006-of-00012.safetensors 4.9 GBmodel-00004-of-00012.safetensors 4.9 GBmodel-00002-of-00012.safetensors 4.8 GBmodel-00012-of-00012.safetensors 2.8 GBmodel-00001-of-00012.safetensors 2.5 GBmodel-mtp.safetensors 849 MBHave the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo xtools-at/Qwen3.8-27B-CodeForge-3xMerge-UNCENSORED-heretic ./model-folderxtools-at/Qwen3.8-27B-CodeForge-3xMerge