rahuldshetty/tinyllama-python-GGUF
Quantized GGUF model files for tinyllama-python from rahuldshetty
| Name | Quant method | Size |
|---|---|---|
| tinyllama-python.fp16.gguf | fp16 | 2.20 GB |
| tinyllama-python.q2_k.gguf | q2_k | 432.13 MB |
| tinyllama-python.q3_k_m.gguf | q3_k_m | 548.40 MB |
| tinyllama-python.q4_k_m.gguf | q4_k_m | 667.81 MB |
| tinyllama-python.q5_k_m.gguf | q5_k_m | 782.04 MB |
| tinyllama-python.q6_k.gguf | q6_k | 903.41 MB |
| tinyllama-python.q8_0.gguf | q8_0 | 1.17 GB |
Original Model Card:
rahuldshetty/tinyllama-python-gguf
- Base model: unsloth/tinyllama-bnb-4bit
- Dataset: iamtarun/python_code_instructions_18k_alpaca
- Training Script: unslothai: Alpaca + TinyLlama + RoPE Scaling full example.ipynb
Prompt Format
### Instruction:
{instruction}
### Response:
Example
### Instruction:
Write a function to find cube of a number.
### Response: