Qwen3-Coder-30B-A3B-Instruct-GGUF
Original Model
Qwen/Qwen3-Coder-30B-A3B-Instruct
Run with LlamaEdge
- LlamaEdge version: coming soon
Prompt template
Prompt type:
chatmlPrompt string
<|im_start|>system {system_message}<|im_end|> <|im_start|>user {prompt}<|im_end|> <|im_start|>assistant
Context size:
256000Run as LlamaEdge service
wasmedge --dir .:. --nn-preload default:GGML:AUTO:Qwen3-Coder-30B-A3B-Instruct-Q5_K_M.gguf \ llama-api-server.wasm \ --model-name Qwen3-Coder-30B-A3B-Instruct \ --prompt-template chatml \ --ctx-size 256000
Quantized with llama.cpp b6209