This repo includes .gguf built for HuggingFace/Candle. They will not work with llama.cpp.
.gguf
llama.cpp
Refer to the original repo for more details.
