EXL3 quants of Muse-Glimmer-30B-assistant
⚠️ Needs ExLlamav3 v1.4.2 (or dev branch)
2.00 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
EXL3 quants of Muse-Glimmer-30B-assistant
⚠️ Needs ExLlamav3 v1.4.2 (or dev branch)
2.00 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight