Gemma-4-31B-Heretic-EXL3 (4.0 bpw)
ExLlamaV3 4.0 bpw quantization of Luni/Gemma-4-31B-Heretic.
- VRAM Weight: ~15.5 GB (100% VRAM resident on RTX 5090 32GB)
- Host RAM Offload: 0 GB
- Context: Up to ~64k context in VRAM with FP8 cache.
ExLlamaV3 4.0 bpw quantization of Luni/Gemma-4-31B-Heretic.
Have the files? Submit a torrent.
Submit a torrent →Have the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo Luni/Gemma-4-31B-Heretic-EXL3-4.0bpw ./model-folder