EXL3 quants of Qwen3.5-35B-A3B

⚠️ Requires ExLlamaV3 v0.0.23 (or v0.0.22 dev branch)

Base bitrates:

2.00 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight

Optimized:

2.13 bits per weight
2.54 bits per weight
3.09 bits per weight
3.54 bits per weight
4.09 bits per weight

Benchmarks

SVG Catbench

(more coming soon)