prism-ml/Ternary-Bonsai-1.7B-unpacked

🤗 Hugging Face 来源apache-2.01.7B 参数3.4 GBsafetensors✓ 2 个校验和今天更新

一条命令提交

在你的模型文件夹旁边运行它。它会制作种子、将文件与 Hugging Face 比对，然后提交。你只需开始做种，并粘贴你账户中的密钥。它只读取你的文件，绝不修改。如果愿意，可以先阅读脚本。

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo prism-ml/Ternary-Bonsai-1.7B-unpacked ./model-folder

Ternary-Bonsai-1.7B — Unpacked FP16 Safetensors

FP16 safetensors (HuggingFace format) of the ternary Bonsai-1.7B model. This repo exists for users who want to run Ternary Bonsai with stock HuggingFace tooling or frameworks that don't yet support any of the packed ternary format. The MLX 2-bit format is currently the only packed format available; more formats for other backends are coming soon.

We strongly recommend using the natively packed models instead. The packed format is where all the benefits of Bonsai come from — up to 9x memory reduction, 4x faster inference, and lower energy per token. This unpacked FP16 version is full-size and does not provide any of those advantages.

For the optimized ternary release model (recommended):

Ternary-Bonsai-1.7B MLX 2-bit — Ternary MLX for Apple Silicon