EXL3 quants of GLM-5.3-Flash
⚠️ Requires ExLlamaV3 v1.4.5 (or dev branch)
Plain quants:
2.05 bits per weight
3.05 bits per weight
4.05 bits per weight
Self-calibrated quants and more benchmarks to follow
EXL3 quants of GLM-5.3-Flash
⚠️ Requires ExLlamaV3 v1.4.5 (or dev branch)
2.05 bits per weight
3.05 bits per weight
4.05 bits per weight
Self-calibrated quants and more benchmarks to follow