EXL3 quants of GLM-4.1V-9B-Thinking
⚠️ Requires ExLlamaV3 v0.0.15 (or v0.0.14 dev branch)
2.00 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
EXL3 quants of GLM-4.1V-9B-Thinking
⚠️ Requires ExLlamaV3 v0.0.15 (or v0.0.14 dev branch)
2.00 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight