Sign up

UnstableLlama/SERA-14B-exl3

🤗 Hugging Face sourceapache-2.044 GBother⚠ No SHA-256 weightsupdated today
No torrent yet →

>> allenai / SERA-14B

[QUANTS BY :: UnstableLlama] // Information exl3 quantizations of SERA-14B via exllamav3.

Repo generated automatically with ezexl3. // Repo Data
REVISION GiB KL DIV PPL
2.00bpw 5.08 0.3344 11.2076
3.00bpw 6.62 0.0663 9.3265
4.00bpw 8.15 0.0174 9.1251
5.00bpw 9.69 0.0047 9.1056
6.00bpw 11.23 0.0015 9.0675
bf16 27.51 0.0000 9.0610
SVG Catbench
3.00 bpw 4.00 bpw 5.00 bpw 6.00 bpw BF16
// CLI Download huggingface-cli download UnstableLlama/SERA-14B-exl3 --revision "6.00bpw" --local-dir ./