β‘ At a Glance
| Model | Params | Final Avg | Highlights |
|---|---|---|---|
| WhirlwindAI/MetaNova-Test | 70.55M | 31.94% | π ARC-Challenge (25.09%) |
| WhirlwindAI/MetaNova-0.1-70M | 70.55M | 35.36% | π ArithMark-2 (27.12%) |
| SupraLabs/Supra-50M-Base | 51.79M | 38.60% | π HellaSwag, ARC-Easy, PIQA, ARC Avg, Final Avg |
π£ Quick summary β The WhirlwindAI MetaNova models each have their own strengths: MetaNova-0.1-70M leads on ArithMark-2, while MetaNova-Test takes ARC-Challenge. Supra-50M-Base (external baseline) posts the highest Final Avg at 38.60% with the smallest parameter count.
π Full Leaderboard
| Benchmark | WhirlwindAI/ MetaNova-Test |
WhirlwindAI/ MetaNova-0.1-BF16 |
SupraLabs/ Supra-50M-Base |
|---|---|---|---|
| Params | 70.55M | 70.55M | 51.79M |
| HellaSwag | 25.37% | 27.40% | 31.65% |
| ARC-Easy | 26.89% | 31.73% | 45.58% |
| ARC-Challenge | 25.09% | 25.00% | 24.66% |
| PIQA | 52.29% | 58.54% | 61.53% |
| ArithMark-2 | 24.12% | 27.12% | 26.08% |
| ARC Avg | 25.99% | 28.37% | 35.12% |
| Final Avg | 31.94% | 35.36% | 38.60% π |
π = best score in the row. Bold = row winner.
π Metric-by-Metric View
π£ HellaSwag| Model | Score | |
|---|---|---|
| MetaNova-Test | 25.37% | ββββββββββββ |
| MetaNova-0.1-BF16 | 27.40% | ββββββββββββ |
| Supra-50M-Base | 31.65% | ββββββββββββ |
| Model | Score | |
|---|---|---|
| MetaNova-Test | 26.89% | ββββββββββββ |
| MetaNova-0.1-BF16 | 31.73% | ββββββββββββ |
| Supra-50M-Base | 45.58% | ββββββββββββ |
| Model | Score | |
|---|---|---|
| MetaNova-Test | 25.09% | ββββββββββββ |
| MetaNova-0.1-BF16 | 25.00% | ββββββββββββ |
| Supra-50M-Base | 24.66% | ββββββββββββ |
| Model | Score | |
|---|---|---|
| MetaNova-Test | 52.29% | ββββββββββββ |
| MetaNova-0.1-BF16 | 58.54% | ββββββββββββ |
| Supra-50M-Base | 61.53% | ββββββββββββ |
| Model | Score | |
|---|---|---|
| MetaNova-Test | 24.12% | ββββββββββββ |
| MetaNova-0.1-BF16 | 27.12% | ββββββββββββ |
| Supra-50M-Base | 26.08% | ββββββββββββ |
| Metric | MetaNova-Test | MetaNova-0.1-BF16 | Supra-50M-Base |
|---|---|---|---|
| ARC Avg | 25.99% | 28.37% | 35.12% |
| Final Avg | 31.94% | 35.36% | 38.60% |
π§ THINKING Chat Format
| Thinking Mode | Non-Thinking Mode |
|---|---|
<|im_start|>user
{query} /think<|im_end|>
<|im_start|>assistant
<think>
{thinking_content}
</think>
|
<|im_start|>user
{query} /no_think<|im_end|>
<|im_start|>assistant
<think>
</think>
{response}<|im_end|>
|
π΅ blue = user / assistant content Β β’Β π΄ red = mode switch + reasoning block
π§Ύ Run Summary
| Model | WhirlwindAI/MetaNova-0.1-70M |
| Model size | 70.5M params |
| Tensor type | BF16 |
| Downloads last month | 16 |
| Models compared | 3 |
| Benchmarks | HellaSwag Β· ARC-Easy Β· ARC-Challenge Β· PIQA Β· ArithMark-2 Β· ARC Avg Β· Final Avg |
| Parameter range | 51.79M β 70.55M |
| Final Avg range | 31.94% β 38.60% |
| Top Final Avg | SupraLabs/Supra-50M-Base β 38.60% |
β If this model helped you, consider leaving a like on the Hub.
WhirlwindAI Β· 2026