Boulesis-v2.1-26B-A4B-HeadTune

Composite Gemma 4 RP model (QK task arithmetic + fused LoRA + custom lm_head).

Instead of the lm_head from StyleTune-V2, a new one is used here. I trained lm_head on my own dataset.

After testing this variant, I will release Boulesis v1 with a head that is either replaced by or blended with StyleTune.

Very experimental version.

---

[!Tip]

Differences between Boulesis versions

v1: Delivers a more dynamic plot and drives the characters to take more action. Suitable for action-oriented scenarios.

v2: Writes very concisely while maintaining logic; it may even slightly deepen the understanding of the character.

v2.1: Comparable in length to v1 and slightly more measured in tone, but it has the best grasp of the characters and an excellent memory for context. Suitable for complex RP sessions involving multiple characters. This is the best version of Boulesis for my opinion.

v2.1-Headtune: Writes in a very literary, descriptive style, with lots of turns of phrase. I personally don't like it, but maybe someone needs exactly that kind of writing.

---

Using it

[!Note] Recommended settings:

Parameter	Value
Temperature	1.0
Top-K	64
Repetition Penalty	1.05-1.1
Top-P	0.95
Thanks to DifficultyThin8462

If the reasoning doesn't work when connecting GGUF ver. in KoboldCPP and SillyTavern

You need to force this in KoboldCPP. Go to the Content tab and enable these options.

For SillyTavern, it is recommended to set the template as shown:

Feedback

This is an experimental merge, and I mostly test it on my own cards, so my coverage is narrow. If you run v2.1, I would really like to know:

• Whether you ran it with thinking enabled or disabled.
• How it holds up in long sessions — scene logic, character positions, who is addressing whom. This was the main complaint about v1 and the reason v2 exists.
• Your sampler settings, if you got clearly better or worse results than with the defaults.

Open a thread in the Community tab, I read all of them. If anyone wants to be involved in v3, I am open to that as well!

Credits

Thanks to coder3101 for the fine-tune, and the entire 26B-Suite team for their intellectual support. Speсial thanks for Naphula, redaihf and Vortex5. You guys are awesome!