What's that?
This repo contains some APEX quantizations of Naphula/Goetia-26B-A4B-v1.7, created using bartowski's imatrix found here.
As explained by its creators, APEX is "a novel MoE-aware mixed-precision quantization technique for llama.cpp". I suggest reading their information on the how and why of the method.
Quantized using llama.cpp #1692f9e50
For roleplaying, I personally strongly recommend nohurry's SillyTavern presets for Gemma 4 models.
Disclosure
My only contribution is compute. This is neither my merge, nor my quantization methodology. Have fun (within the constraints of the license).
Cheers
Google - the base model.
Naphula - the Mergelord.
Everyone whose finetunes were included in the merge!
mudler - for the APEX quantization methodology.
EmanuelOverride - for the custom APEX experiments.
bartowski - for the imatrix + myriads of quants we all benefit from.