Model Card for Model ID
Model Details
Model Description
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
- Developed by: theprint/Rasmus Rasmussen
- Funded by [optional]: No one
- Shared by [optional]: You?
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 17.98 |
| IFEval (0-Shot) | 46.49 |
| BBH (3-Shot) | 19.29 |
| MATH Lvl 5 (4-Shot) | 9.74 |
| GPQA (0-shot) | 4.47 |
| MuSR (0-shot) | 6.94 |
| MMLU-PRO (5-shot) | 20.97 |