Sign up

UnstableLlama/Ministral-3-3B-Instruct-2512-exl3

🤗 Hugging Face sourceapache-2.017 GBother⚠ No SHA-256 weightsupdated today
No torrent yet →

>> mistralai/Ministral-3-3B-Instruct-2512

[QUANTS BY :: UNSTABLELLAMA]

// REPO

EXL3 quantizations of mistralai's Ministral-3-3b-Instruct-2512-BF16.

Quantized with exllamav3 0.0.18.

// QUANTS

[BRANCH] [GiB] [K/L_DIV] [PPL]
2.10bpw 2.55 0.41369604 13.0952024
3.00bpw 2.87 0.15391978 10.63269147
3.15bpw 2.92 0.11824867 10.43570384
4.00bpw 3.23 0.03741831 9.83061761
6.00bpw 3.93 0.00459656 9.55857195
bf16 x 0 x

// DOWNLOAD

Use HF-CLI to pull specific branches to your local machine: huggingface-cli download UnstableLlama/Ministral-3-3B-Instruct-2512-exl3 --revision "3.00bpw" --local-dir ./