ilintar/Ornith-1.0-35B-GGUF

🤗 Hugging Face sourcemit35B activated103 GBGGUF✓ 3 checksumsupdated today

Submit in one command

Run it next to your model folder. It makes the torrent, checks your files against Hugging Face, and submits it. You just start seeding and paste your key from your account. It only reads your files and never changes them. Read the script first if you like.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo ilintar/Ornith-1.0-35B-GGUF ./model-folder

Needs a seeder →

Optimized with my branch's custom auto-tensor-type, custom-made recipes for 2.91, 3.74 and 4.34 bpw (element-gamma=0.25, which beats the stock hand-tuned recipes at matched BPW).

Since HF doesn't recognize custom bpw tags, I've tagged them with:

Q2_K: 2.91bpw
IQ3_M: 3.74bpw
IQ4_XS: 4.34bpw

Note that the quant types are only aliases for the size and do not correspond to the actual quant types used.