qwen3-0.6-Claude4.6-4.7-Gpt5.5-Gemini3.1pro-gguf
The Qwen3-0.6B model, retrained on the Claude 4.6/4.7, GPT-5.5, and Gemini 3.1 Pro-style reasoning datasets.
gguf quantizations
| Type | Description | Quality loss |
|---|---|---|
| F16 | Original fp16 | None |
| Q8_0 | Minimum | |
| Q6_K | Very Small | |
| Q5_K_M | Small | |
| Q4_K_M | ~ | Moderate (recommended) |
| Q4_K_S | ~ | Moderate |
| Q3_K_M | ~ | Noticeable |
| IQ4_XS | ~ | Moderate (new format) |
| IQ3_M | ~ | Noticeable (new format) |
Usage (llama.cpp)
llama-cli -m model-q4_k_m.gguf -p "How to solve this problem?" -n 512
Usage (Python)
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("FGFGFGGDFGDFGSD/qwen3-0.6-Claude4.6-4.7-Gpt5.5-Gemini3.1pro-gguf")