MiniCPM5-1B PT-BR v3 GGUF (Q4_K_M)
GGUF quantization of marinarosa/MiniCPM5-1B-PTBR-v3 for local inference with llama.cpp.
Usage
from llama_cpp import Llama
llm = Llama(
model_path="MiniCPM5-1B-PTBR-v3-Q4_K_M.gguf",
n_ctx=8192,
)
GGUF quantization of marinarosa/MiniCPM5-1B-PTBR-v3 for local inference with llama.cpp.
from llama_cpp import Llama
llm = Llama(
model_path="MiniCPM5-1B-PTBR-v3-Q4_K_M.gguf",
n_ctx=8192,
)