Beinsezii/Mistral-Small-4-119B-2603-GGUF-HALO

🤗 Hugging Face 来源apache-2.0激活 119B99 GBGGUF✓ 2 个校验和今天更新
一条命令提交

在你的模型文件夹旁边运行它。它会制作种子、将文件与 Hugging Face 比对,然后提交。你只需开始做种,并粘贴你账户中的密钥。它只读取你的文件,绝不修改。如果愿意,可以先阅读脚本。

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo Beinsezii/Mistral-Small-4-119B-2603-GGUF-HALO ./model-folder
需要做种者 →

Quant optimized for quality / speed on a Strix Halo 128GiB system. Possibly also beneficial on DGX Spark and similar systems.

The TL;DR is this quant achieves both superior quality and speed compared to homogenous Q6_K.

See the GLM version for more details on theory and comparisons.