DPO finetune of (https://huggingface.co/abacusai/MM-Orc-Vic-bagel-34b-c1000) on the Bagel DPO dataset
Evaluation Results
| Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
|---|---|---|---|---|---|---|
DPO finetune of (https://huggingface.co/abacusai/MM-Orc-Vic-bagel-34b-c1000) on the Bagel DPO dataset
| Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
|---|---|---|---|---|---|---|