UnstableLlama/Ministral-3-8B-Instruct-2512-exl3

🤗 Hugging Face 来源apache-2.0激活 8B24 GBother⚠ 没有 SHA-256 权重今天更新
一条命令提交

在你的模型文件夹旁边运行它。它会制作种子、将文件与 Hugging Face 比对,然后提交。你只需开始做种,并粘贴你账户中的密钥。它只读取你的文件,绝不修改。如果愿意,可以先阅读脚本。

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo UnstableLlama/Ministral-3-8B-Instruct-2512-exl3 ./model-folder
需要做种者 →

>> mistralai/Ministral-3-8B-Instruct-2512

[QUANT :: UNSTABLELLAMA]

// REPO

EXL3 quantizations of mistralai's Ministral-3-8b-Instruct-2512-BF16.

Quantized with exllamav3 0.0.18.

// QUANTS

[BRANCH] [GiB] [K/L_DIV] [PPL]
2.10bpw 4.4 no measurements
3.00bpw 4.77 0.05864883 7.89712533
3.15bpw 4.89 0.04512541 7.81142826
4.00bpw 5.63 0.0162187 7.61291338
6.00bpw 7.36 0.0162187 7.51715039
bf16 16 0 x

// DOWNLOAD

Use HF-CLI to pull specific branches to your local machine: huggingface-cli download UnstableLlama/Ministral-3-8B-Instruct-2512-exl3 --revision "3.00bpw" --local-dir ./