Abiray/Qwen3.6-35B-A3B-Q4_K_M-GGUF

🤗 Hugging Face sourceimage-text-to-textapache-2.03B activated25 GBGGUF✓ 4 checksumsupdated today

Submit in one command

Run it next to your model folder. It makes the torrent, checks your files against Hugging Face, and submits it. You just start seeding and paste your key from your account. It only reads your files and never changes them. Read the script first if you like.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo Abiray/Qwen3.6-35B-A3B-Q4_K_M-GGUF ./model-folder

Needs a seeder →

Qwen3.6-35B-A3B - Q4_K_M GGUF Quantization

This repository contains the Q4_K_M GGUF format of the Qwen3.6-35B-A3B model.

These files were quantized by Abiray using llama.cpp to make the model accessible for consumer hardware and CPU-heavy environments.

📦 Other Available Formats

I have processed this model into several different quantization formats. You can find them in my other repositories:

Abiray/Qwen3.6-35B-A3B-Q8_0-GGUF (High quality, largest file)
Abiray/Qwen3.6-35B-A3B-Q6_K-GGUF (Very high quality)
Abiray/Qwen3.6-35B-A3B-Q5_K_M-GGUF (Great balance of quality and size)
Abiray/Qwen3.6-35B-A3B-Q4_K_M-GGUF (Good quality, recommended for most users)
Abiray/Qwen3.6-35B-A3B-Q3_K_M-GGUF (Low quality, smallest file)

💻 How to run with llama.cpp

You can run this model locally using llama-cli from the llama.cpp project.

# Example command (adjust threads and context size to your machine)
./llama-cli -m Qwen3.6-35B-A3B-Q4_K_M.gguf -p "Your prompt here" -n 512 -t 8 -c 4096