This is a Deckard(qx) experimental quant.
Brainwaves
arc arc/e boolq hswag obkqa piqa wino
qx86-hi 0.431,0.505,0.426,0.670,0.376,0.766,0.710
Base model
gemma-4-31B-it (Instruct)
qx86-hi 0.496,0.653,0.901,0.624,0.380,0.732,0.653
Previous model
gemma-3-27b-it-heretic
q8 0.557,0.711,0.868,0.533,0.452,0.706,0.695
As I don't have an easy way to test this until LMStudio supports it, please Like it only if you had a good experience.
Thank you,
-G
model-00002-of-00006.safetensors 5.4 GBmodel-00001-of-00006.safetensors 5.4 GBmodel-00005-of-00006.safetensors 5.3 GBmodel-00003-of-00006.safetensors 5.3 GBmodel-00004-of-00006.safetensors 5.3 GBmodel-00006-of-00006.safetensors 3.4 GBHave the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo CountCandy/gemma-4-31B-it-The-DECKARD-HERETIC-UNCENSORED-Thinking-GGUFs ./model-folderDavidAU/gemma-4-31B-it-The-DECKARD-HERETIC-UNCENSORED-Thinking