Loading…
Loading…
XHToken/Spark-X2.6-4Bllama-server -m spark-ced-Q4_K_M.gguf -fa on -c 16384 -np 1 --jinja -ngl 99 (CED two-phase prefill, replay 1024; prompts under 1024 tokens do not show the prefill gain)View run on LocalMaxxing
Median of 2 community runs on 1 setups, from LocalMaxxing.
Run it yourself: setup guide