UnstableLlama/Qwen3.6-35B-A3B-exl3-2.08bpw

🤗 Hugging Face sourceapache-2.05.6B params11 GBsafetensorsHF checksums availableupdated today
No torrent yet

Qwen / Qwen3.6-35B-A3B

QUANTIZED BY: UnstableLlama Information 2.08bpw -hq exl3 quantization of Qwen3.6-35B-A3B via exllamav3.
repo generated automatically with ezexl3. Repo Data
REVISION GiB KL DIV PPL
2.08bpw 10.50 0.1522 7.2418
2.49bpw 12.10 0.1129 7.1720
4.00bpw 18.00 0.0243 6.8293
6.00bpw 25.83 0.0068 6.7829
8.00bpw 33.77 0.0042 6.7807
bf16 66.97 0.0000 6.7802
CLI Download hf download UnstableLlama/Qwen3.6-35B-A3B-exl3-2.08bpw --local-dir ./Qwen3.6-35B-A3B-exl3-2.08bpw