This repository hosts quantized versions of the Mistral-Nemo-Instruct-2407 model.
Format: GGUF
Converter: llama.cpp 3a14e00366399040a139c67dd5951177a8cb5695
Quantizer: LM-Kit.NET 2024.7.11
For more detailed information on the base model, please visit the following link:
Have the files? Submit a torrent.
Submit a torrent →Have the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo lm-kit/mistral-nemo-2407-12.2b-instruct-gguf ./model-folder