[!Note] This repository contains gguf version of
sarvam-min bf16 precision.
Learn more about sarvam-m in our detailed blog post.
You can use the model on your local machine (without gpu) as explained here.
Example Command:
./build/bin/llama-cli -i -m /your/folder/path/sarvam-m-bf16.gguf -c 8192 -t 16
Have the files? Submit a torrent.
Submit a torrent →Have the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo sarvamai/sarvam-m-gguf ./model-folder