Temper-2-Ion-GGUF
GGUF version of Temper-2-Ion, a 0.5B model for Rust code. Results and details are on the main model page.
Website: maylore.com/temper-2-ion
| File | Quantization | Size |
|---|---|---|
Temper-2-Ion-Q8_0.gguf |
Q8_0 | 532 MB |
Temper-2-Ion-BF16.gguf |
BF16 | 994 MB |
llama.cpp
llama-cli -hf maylore-ai/Temper-2-Ion-GGUF:Q8_0
Ollama
ollama run hf.co/maylore-ai/Temper-2-Ion-GGUF:Q8_0
Or locally with the Modelfile from this repository.
ollama create temper-ion -f Modelfile
ollama run temper-ion
License
Apache 2.0, same as Qwen2.5-Coder-0.5B-Instruct.