DPO finetune of our MetaMath SFT Model on the Truthy DPO dataset
Evaluation Results
| Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
|---|---|---|---|---|---|---|
| 75.54 | 69.20 | 84.34 | 76.46 | 67.58 | 82.87 | 72.78 |
DPO finetune of our MetaMath SFT Model on the Truthy DPO dataset
| Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
|---|---|---|---|---|---|---|
| 75.54 | 69.20 | 84.34 | 76.46 | 67.58 | 82.87 | 72.78 |
Have the files? Submit a torrent.
Submit a torrent →Have the complete files and permission to share them? Replace the example folder path. The script checks the files, makes a torrent and submits its magnet and checksums. Keep your torrent client seeding. Get your community key from your settings, and read the script before running it.
curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo abacusai/MetaMath-Bagel-DPO-34B ./model-folder