SyncWorld: Visual Calibration Enables World Models as Zero-Shot Simulators
Yuncong Yang, Zhengtao Han, Furkan Özyurt, Zeyuan Yang, Han Yang, Junyi Cao, Haoyu Zhen, Yilun Du, Chuang Gan
SyncWorld is an action-conditioned world model that serves as a zero-shot simulator across unseen environments without any additional training. It leverages a visual calibration episode — paired frames and actions that showcase all the controllable degrees of freedom — to specify the setup-specific Action–Visual Mapping in context, and learns to interpret actions through visual evidence and to fall back on interaction history when explicit calibration is unavailable.
hf download yyuncong/SyncWorld --local-dir ./SyncWorld-ckpt
See the SyncWorld repository for installation and how to
run evaluation, and yyuncong/SyncWorld-Evaluation
for the evaluation sets.