second-state/Qwen3-Coder-30B-A3B-Instruct-GGUF

🤗 Hugging Face sourcetext-generationapache-2.03B activated291 GBGGUF✓ 15 checksumsupdated today
Submit in one command

Run it next to your model folder. It makes the torrent, checks your files against Hugging Face, and submits it. You just start seeding and paste your key from your account. It only reads your files and never changes them. Read the script first if you like.

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo second-state/Qwen3-Coder-30B-A3B-Instruct-GGUF ./model-folder
Needs a seeder →

Qwen3-Coder-30B-A3B-Instruct-GGUF

Original Model

Qwen/Qwen3-Coder-30B-A3B-Instruct

Run with LlamaEdge

  • LlamaEdge version: coming soon
  • Prompt template

    • Prompt type: chatml

    • Prompt string

      <|im_start|>system
      {system_message}<|im_end|>
      <|im_start|>user
      {prompt}<|im_end|>
      <|im_start|>assistant
      
  • Context size: 256000

  • Run as LlamaEdge service

    wasmedge --dir .:. --nn-preload default:GGML:AUTO:Qwen3-Coder-30B-A3B-Instruct-Q5_K_M.gguf \
      llama-api-server.wasm \
      --model-name Qwen3-Coder-30B-A3B-Instruct \
      --prompt-template chatml \
      --ctx-size 256000
    

Quantized with llama.cpp b6209