Sign up

UnstableLlama/Qwen3.5-4B-exl3-6.00bpw

🤗 Hugging Face sourceapache-2.02.6B params5.1 GBsafetensors✓ HF checksums availableupdated today
No torrent yet →

Qwen / Qwen3.5-4B-exl3

QUANTIZED BY: UnstableLlama Information exl3 quantizations of Qwen3.5-4B-exl3 via exllamav3.
repo generated automatically with ezexl3. Repo Data
REVISION GiB KL DIV PPL
2.00bpw 3.09 0.3653 12.2025
2.10bpw 3.13 0.2848 11.4102
3.00bpw 3.51 0.0631 9.9813
3.10bpw 3.54 0.0584 9.8489
4.00bpw 3.92 0.0187 9.6894
5.00bpw 4.34 0.0060 9.6490
6.00bpw 4.75 0.0020 9.6689
8.00bpw 5.58 0.0010 9.6854
bf16 8.68 0.0000 9.6736
CLI Download hf download UnstableLlama/Qwen3.5-4B-exl3-4.00bpw --local-dir ./Qwen3.5-4B-exl3-4.00bpw