EXL3 quants of gemma-4-31B-it
mul1 quants (recommended, improved performance on exllamav3>=v1.0.0):
2.00 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
6.00 bits per weight
MCG quants (legacy):
2.00 bits per weight
2.25 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
Have the files? Submit a torrent.
Submit a torrent →Have the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo turboderp/gemma-4-31b-it-exl3 ./model-folder