GGUF quants of GrootTeam/Groot-19B-A3B-261023, converted from the original safetensors weights to F16 and quantized with llama.cpp 1.0.0-dev (build 12366, commit 31953bcf7) in the BYOGGUF Space.
| File | Type | Size |
|---|---|---|
| Groot-19B-A3B-261023-Q8_0.gguf | Q8_0 | 18.83 GB |
llama-server -hf juiceb0xc0de/Groot-19B-A3B-261023-GGUF:Q8_0
Or bring it straight back to BYOGGUF, paste juiceb0xc0de/Groot-19B-A3B-261023-GGUF, and chat with it
on a Blackwell.
See the original model card for what the model is and how it is licensed.
GrootTeam/Groot-19B-A3B-261023