EXL3 quants of Olmo-Hybrid-Instruct-SFT-7B
⚠️ Requires ExLlamaV3 v0.0.26 (or v0.0.25 dev branch)
2.00 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
EXL3 quants of Olmo-Hybrid-Instruct-SFT-7B
⚠️ Requires ExLlamaV3 v0.0.26 (or v0.0.25 dev branch)
2.00 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
Have the files? Submit a torrent.
Submit a torrent →Have the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo turboderp/Olmo-Hybrid-Instruct-SFT-7B-exl3 ./model-folder