UnstableLlama/Qwen3.6-35B-A3B-exl3-2.49bpw

🤗 Hugging Face sourceapache-2.06.5B params13 GBsafetensorsHF checksums availableupdated today
No torrent yet

Qwen / Qwen3.6-35B-A3B

QUANTIZED BY: UnstableLlama Information exl3 quantizations of Qwen3.6-35B-A3B via exllamav3.
repo generated automatically with ezexl3. Repo Data
REVISION GiB KL DIV PPL
2.08bpw 10.50 0.1522 7.2418
2.49bpw 12.10 0.1129 7.1720
4.00bpw 18.00 0.0243 6.8293
6.00bpw 25.83 0.0068 6.7829
8.00bpw 33.77 0.0042 6.7807
bf16 66.97 0.0000 6.7802
SVG Catbench
2.49 bpw
CLI Download hf download UnstableLlama/Qwen3.6-35B-A3B-exl3-2.49bpw --local-dir ./Qwen3.6-35B-A3B-exl3-2.49bpw