health-advisor-1.5b
Qwen2.5-1.5B-Instruct fine-tuned as an offline patient-education and triage-support assistant. Not a diagnostic tool — designed to explain health information, flag red-flag symptoms, and defer specific dosing questions to a qualified clinician or pharmacist.
Fine-tuned from Qwen/Qwen2.5-1.5B-Instruct, converted to GGUF, and
quantized for offline CPU inference via llama.cpp.
Files
| File | Quantization | Notes |
|---|---|---|
health-Q4_K_M.gguf |
Q4_K_M | Smaller, lower peak RAM |
health-Q5_K_M.gguf |
Q5_K_M | Larger, typically higher quality |
Usage
./llama-cli -m health-Q4_K_M.gguf -p "your prompt here"