DPO'd from vicgalle/franken-Beagle-11B, a Beagle-like model upscaled to 11B. It is a frankenmerge model created using mergekit. Then, we applied DPO over a high-quality preference dataset.
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 72.06 |
| AI2 Reasoning Challenge (25-Shot) | 73.63 |
| HellaSwag (10-Shot) | 87.86 |
| MMLU (5-Shot) | 63.11 |
| TruthfulQA (0-shot) | 75.92 |
| Winogrande (5-shot) | 82.08 |
| GSM8k (5-shot) | 49.73 |
model-00002-of-00005.safetensors 5.0 GBmodel-00001-of-00005.safetensors 4.9 GBmodel-00003-of-00005.safetensors 4.9 GBmodel-00004-of-00005.safetensors 4.9 GBmodel-00005-of-00005.safetensors 1.7 GBHave the files? Submit a torrent.
Submit a torrentHave the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo vicgalle/NeuralBeagle-11B-truthy ./model-folder