Sarvam-M

Model Information

[!Note] This repository contains gguf version of sarvam-m in q8 precision.

Learn more about sarvam-m in our detailed blog post.

Running the model on a CPU

You can use the model on your local machine (without gpu) as explained here.

Example Command:

./build/bin/llama-cli -i -m /your/folder/path/sarvam-m-q8_0.gguf -c 8192 -t 16