| Metric | Value |
|---|---|
| Avg. | 29.18 |
| IFEval (0-Shot) | 64.8 |
| BBH (3-Shot) | 35.48 |
| MATH Level 5 (4-Shot) | 15.86 |
| GPQA (0-Shot) | 10.29 |
| MuSR (0-Shot) | 13.47 |
| MMLU-PRO (5-Shot) | 35.17 |
Detailed results can be found here. Personal Benchmarks - check PERSONAL_BENCHMARK.md merge
model-00002-of-00016.safetensors 1.1 GBmodel-00001-of-00016.safetensors 1.1 GBmodel-00003-of-00016.safetensors 932 MBmodel-00004-of-00016.safetensors 932 MBmodel-00005-of-00016.safetensors 932 MBmodel-00006-of-00016.safetensors 932 MBmodel-00007-of-00016.safetensors 932 MBmodel-00008-of-00016.safetensors 932 MBmodel-00010-of-00016.safetensors 932 MBmodel-00011-of-00016.safetensors 932 MBmodel-00012-of-00016.safetensors 932 MBmodel-00009-of-00016.safetensors 932 MBmodel-00013-of-00016.safetensors 932 MBmodel-00014-of-00016.safetensors 932 MBmodel-00015-of-00016.safetensors 932 MBmodel-00016-of-00016.safetensors 932 MBHave the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo sethuiyer/Qwen2.5-7B-Anvita ./model-folderQwen/Qwen2.5-7B-Instruct