EXL3 quants of LFM2.5-8B-A1B
mul1 quants
2.10 bits per weight
3.10 bits per weight
4.10 bits per weight
5.10 bits per weight
6.10 bits per weight
8.00 bits per weight
Legacy (mcg) quants:
2.10 bits per weight
2.53 bits per weight
3.10 bits per weight
3.53 bits per weight
4.10 bits per weight
5.10 bits per weight
6.10 bits per weight
8.00 bits per weight / H8
Have the files? Submit a torrent.
Submit a torrent →Have the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo turboderp/LFM2.5-8B-A1B-exl3 ./model-folder