Sign up

UnstableLlama/Qwen3.5-2B-exl3-4.00bpw

🤗 Hugging Face sourceapache-2.01.4B params2.8 GBsafetensors✓ HF checksums availableupdated today
No torrent yet →

Qwen / Qwen3.5-2B

QUANTIZED BY: UnstableLlama Information ⚠️ Requires ExLlamaV3 v0.0.23 (or v0.0.22 `dev` branch)
exl3 quantizations of Qwen3.5-2B via exllamav3.
repo generated automatically with ezexl3. Repo Data
REVISION GiB KL DIV PPL
2.10bpw 2.26 0.2965 15.8161
3.10bpw 2.42 0.0593 13.1512
4.00bpw 2.56 0.0140 12.3285
5.00bpw 2.72 0.0041 12.2906
6.00bpw 2.88 0.0013 12.1723
8.00bpw 3.20 0.0004 12.1875
bf16 4.24 0.0000 12.1829
CLI Download hf download UnstableLlama/Qwen3.5-2B-exl3-4.00bpw --local-dir ./Qwen3.5-2B-exl3-4.00bpw