UnstableLlama/Qwen3.5-27B-exl3-4.00bpw

🤗 Hugging Face sourceapache-2.08.3B params17 GBsafetensorsHF checksums availableupdated today
No torrent yet

Qwen / Qwen3.5-27B

QUANTIZED BY: UnstableLlama Information exl3 quantizations of Qwen3.5-27B via exllamav3.
repo generated automatically with ezexl3. Repo Data
REVISION GiB KL DIV PPL
2.00bpw 9.84 0.1746 7.6985
2.10bpw 10.09 0.1412 7.3885
3.00bpw 12.67 0.0422 6.9977
3.10bpw 12.92 0.0376 6.9582
4.00bpw 15.50 0.0170 6.9331
5.00bpw 18.34 0.0070 6.8840
6.00bpw 21.17 0.0032 6.8439
8.00bpw 26.83 0.0003 6.8605
bf16 51.75 0.0000 6.8598
SVG Catbench
2.10 bpw 3.00 bpw 3.10 bpw 4.00 bpw
5.00 bpw 6.00 bpw 8.00 bpw
CLI Download hf download UnstableLlama/Qwen3.5-27B-exl3-4.00bpw --local-dir ./Qwen3.5-27B-exl3-4.00bpw