加载中…
加载中…
GGUF quantizations of LindotAI/Lin-1-Epsilon, a 0.5B Rust code model from LindotAI (fine-tuned from Qwen2.5-Coder-0.5B-Instruct). Benchmarks and details are on the main model card.
| File | Quant | Notes |
|---|---|---|
| Lin-1-Epsilon-Q4_K_M.gguf | Q4_K_M | smallest, good for laptops |
| Lin-1-Epsilon-Q8_0.gguf | Q8_0 | the quant we test with |
llama-cli -hf LindotAI/Lin-1-Epsilon-GGUF:Q8_0 -p "Write a Rust function that reverses a Vec<i32> in place."
ollama run hf.co/LindotAI/Lin-1-Epsilon-GGUF:Q8_0
Recommended sampling: temperature 0.2 for single answers, 0.8 when sampling several candidates and testing them. Always compile and test generated code.
Apache 2.0.
LindotAI/Lin-1-Epsilon