加载中…
加载中…
Run it in the Llama app: https://llama.app
Or from the terminal:
llama serve -hf ggml-org/gemma-4-12B-it-GGUF
[!IMPORTANT] This model is automatically converted using https://github.com/ggml-org/convert
google/gemma-4-12B-it
LocalMaxxing/home/cheez/Projects/local-llm/llama.cpp/build-cuda-sm120/bin/llama-bench -m '/home/cheez/Projects/local-llm/models/gguf-quants/gemma-4-12b-it-ggml/gemma-4-12B-it-Q4_K_M.gguf' -p 512 -n 128在 LocalMaxxing 上查看测试
llama-bench -m gemma-4-12B-it-Q4_K_M.gguf -p 1024 -n 128 -ngl 999 -fa on -ctk f16 -ctv f16 -fitt 1024 -r 5在 LocalMaxxing 上查看测试
来自 LocalMaxxing 的 5 次社区测试（2 种配置）的中位数。
自己运行：配置指南