DPO finetune of our MetaMath SFT Model on the Truthy DPO dataset
Evaluation Results
| Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
|---|---|---|---|---|---|---|
| 75.54 | 69.20 | 84.34 | 76.46 | 67.58 | 82.87 | 72.78 |
DPO finetune of our MetaMath SFT Model on the Truthy DPO dataset
| Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
|---|---|---|---|---|---|---|
| 75.54 | 69.20 | 84.34 | 76.46 | 67.58 | 82.87 | 72.78 |