RoboJudge-9B
RoboJudge-9B is a multimodal judge for generated embodied-manipulation videos. It scores two axes on a 1–5 scale:
- Physical Adherence (PA): agent consistency, scene consistency, and interaction realism.
- Instruction Alignment (IA): agent match, object correctness, and goal completion.
Benchmark results on RoboJudge-Bench
| Metric | Pearson r with human ratings |
|---|---|
| PA | 0.645 |
| IA | 0.775 |
| Overall | 0.719 |
License
The RoboJudge release code and model weights are provided under Apache-2.0. Use of the associated datasets is additionally subject to the terms of their upstream sources.