Community GGUF quantizations of XHToken/Spark-X2.5-1.7B. This repository contains nine quantized files for local inference. No training or fine-tuning was performed.
☕ If this GGUF made your day easier, a coffee would make mine.| Quantization | File size (GiB) | A10M generation token/s | Validation | Recommendation / Notes |
|---|---|---|---|---|
| Q8_0 | 1.70 | 175.54 | Load/generate pass | High quality. |
| Q6_K | 1.31 | 199.07 | Load/generate pass | High quality. |
| Q5_K_M | 1.17 | 223.04 | Load/generate pass | Daily use. |
| Q4_K_M | 1.03 | 241.87 | Load/generate pass | Recommended default. |
| Q3_K_M | 0.87 | 203.60 | Load/generate pass | Lower-memory profile. |
| Q2_K | 0.74 | 231.70 | Load/generate pass | Aggressive low-memory profile. |
| IQ2_XS | 0.61 | 245.03 | Load/generate pass | Experimental. |
| IQ1_M | 0.54 | 252.02 | Load/generate pass | Experimental. |
| Q1_0 | 0.40 | 336.65 | Load/generate pass | Experimental / legacy minimum-memory option. |
The A10M generation figures were measured with single-stream llama-bench on
an NVIDIA A10M.
Q1/Q2 and the IQ variants can lose instruction following, reasoning, and tool-call reliability. Validate the chosen file on the workload that matters to you.
The upstream model is released under Apache License 2.0. Preserve the upstream attribution and license when redistributing these derivative files. This is a community GGUF quantization, not an official XHToken/SparkLLM release or endorsement.
Checksums are available in SHA256SUMS.txt.
Have the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo ngquocvinh/Spark-X2.5-1.7B-GGUF ./model-folder