pi0.5 (openpi PyTorch) fine-tuned on LIBERO with TaskFocus focus tokens: learned prefix tokens supervised to predict where the gripper, the manipulated object and the target are (now and 10 frames ahead), plus gripper–object relations, contact and task phase. The focus-loss gradient into the backbone is scaled by 0.1. Training: 8 demonstrations per task (all 40 LIBERO tasks), 30k steps, batch 16, cosine LR 5e-5 → 5e-6.
These are ablation checkpoints. Each folder <config>/<experiment>/ holds model.safetensors,
metadata.pt and assets/ (norm stats); configs are pi05_libero_tf_* in the TaskFocus openpi fork.
| Folder (config) | Variant | Seed | LIBERO-10 (50 trials) | LIBERO-Plus layout (150 tasks) | Swapped-instruction success |
|---|---|---|---|---|---|
pi05_libero_tf_focus_obj_low |
where-supervision for object + target only | 43 | 86.4 | 77.3 | 48.0 |
pi05_libero_tf_focus_objgrip_low |
+ gripper | 43 | 85.6 | 75.3 | 38.8 |
pi05_libero_tf_focus_gs01_nowrist_low |
full supervision without wrist-camera object labels | 42 | 83.4 | 73.3 | – |
pi05_libero_tf_focus_gs01_contact_low |
full supervision + contact-region head | 42 | 86.2 | 76.0 | 54.4 |
pi05_libero_tf_focus_gs01_l1w_low |
full supervision on teacher (SAM2 + gripper events) labels incl. wrist masks | 42 | 88.0 | 79.3 | 46.8 |
Reference (not in this repo): plain pi0.5 fine-tune on the same data 82.4 / 72.7 / 31.8; full TaskFocus 87.0 / 79.3 / 46.8 (means over 2 seeds). Research checkpoints, provided as is.
pi05_libero_tf_focus_autogen2s_maskonly_paste_obj_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_paste_obj_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 15 GBpi05_libero_tf_focus_autogen2_maskonly_full_rlrhalf/task_focus_tf_focus_autogen2_maskonly_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 15 GBpi05_libero_tf_focus_autogen2s_cfonly_full_rlrhalf/task_focus_tf_focus_autogen2s_cfonly_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 15 GBpi05_libero_tf_focus_autogen2s_maskonly_cig_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_cig_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 15 GBpi05_libero_tf_focus_autogen2s_maskonly_cig_hinge_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_cig_hinge_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 15 GBpi05_libero_tf_focus_autogen2s_maskonly_cig_ref_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_cig_ref_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 15 GBpi05_libero_tf_focus_autogen2s_maskonly_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 15 GBpi05_libero_tf_focus_autogen2s_maskonly_l0_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_l0_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 15 GBpi05_libero_tf_focus_autogen2s_maskonly_lto_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_lto_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 15 GBpi05_libero_tf_focus_autogen2s_maskonly_repel_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_repel_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 15 GBpi05_libero_tf_focus_autogen2s_maskonly_shuffle_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_shuffle_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 15 GBpi05_libero_tf_focus_autogen_full/task_focus_tf_focus_autogen_full_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 15 GBpi05_libero_tf_focus_autogen_maskonly_full/task_focus_tf_focus_autogen_maskonly_full_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 15 GBpi05_libero_tf_focus_autogen_maskonly_gs01_full_rlrhalf/task_focus_tf_focus_autogen_maskonly_gs01_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 15 GBpi05_libero_tf_baseline_fp32/task_focus_tf_baseline_fp32_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 14 GBpi05_libero_tf_baseline_fp32_batchaug/task_focus_tf_baseline_fp32_batchaug_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 14 GBpi05_libero_tf_baseline_lrhalf_fp32/task_focus_tf_baseline_lrhalf_fp32_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 14 GBpi05_libero_tf_baseline_lto_full_rlrhalf/task_focus_tf_baseline_lto_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 14 GBpi05_libero_tf_baseline_sam22_fp32/task_focus_tf_baseline_sam22_fp32_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 14 GBpi05_libero_tf_baseline_sam_fp32_rlrhalf/task_focus_tf_baseline_sam_fp32_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 14 GBpi05_libero_tf_focus_gs01_contact_low/task_focus_tf_focus_gs01_contact_low_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_cf_only_low/task_focus_tf_cf_only_low_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_focus_autogen_maskonly_bf16_full/task_focus_tf_focus_autogen_maskonly_bf16_full_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_focus_gs01/task_focus_tf_focus_gs01_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_focus_gs01_cf/task_focus_tf_focus_gs01_cf_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_focus_gs01_cf_bsplit_full/task_focus_tf_focus_gs01_cf_bsplit_full_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_focus_gs01_cf_cig_full/task_focus_tf_focus_gs01_cf_cig_full_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_focus_gs01_cf_low/task_focus_tf_focus_gs01_cf_low_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_focus_gs01_cf_low/task_focus_tf_focus_gs01_cf_low_cosine5e5_5e6_b16_acc1_seed43/model.safetensors 7.5 GBpi05_libero_tf_focus_gs01_cf_repel_low/task_focus_tf_focus_gs01_cf_repel_low_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_focus_gs01_cf_sam/task_focus_tf_focus_gs01_cf_sam_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_focus_gs01_cf_split_low/task_focus_tf_focus_gs01_cf_split_low_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_focus_gs01_cf_teacher_low/task_focus_tf_focus_gs01_cf_teacher_low_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_focus_gs01_l1w_low/task_focus_tf_focus_gs01_l1w_low_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_focus_gs01_low/task_focus_tf_focus_gs01_low_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_focus_gs01_low/task_focus_tf_focus_gs01_low_cosine5e5_5e6_b16_acc1_seed43/model.safetensors 7.5 GBpi05_libero_tf_focus_gs01_nowrist_low/task_focus_tf_focus_gs01_nowrist_low_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_focus_obj_low/task_focus_tf_focus_obj_low_cosine5e5_5e6_b16_acc1_seed43/model.safetensors 7.5 GBpi05_libero_tf_focus_objgrip_low/task_focus_tf_focus_objgrip_low_cosine5e5_5e6_b16_acc1_seed43/model.safetensors 7.5 GBpi05_robocasa_tf_focus_gs01/task_focus_robocasa_focus_gs01_h50_b16_seed42/model.safetensors 7.5 GBpi05_libero_tf_enrich_low/task_focus_tf_enrich_low_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_baseline/task_focus_tf_baseline_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_baseline_low/task_focus_tf_baseline_low_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_libero_tf_baseline_low/task_focus_tf_baseline_low_cosine5e5_5e6_b16_acc1_seed43/model.safetensors 7.5 GBpi05_libero_tf_baseline_sam/task_focus_tf_baseline_sam_cosine5e5_5e6_b16_acc1_seed42/model.safetensors 7.5 GBpi05_robocasa_tf_baseline/task_focus_robocasa_baseline_h50_b16_seed42/model.safetensors 7.5 GBpi05_libero_tf_focus_autogen2s_maskonly_lto_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_lto_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 12.6 kBpi05_libero_tf_baseline_lto_full_rlrhalf/task_focus_tf_baseline_lto_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 12.5 kBpi05_libero_tf_focus_autogen2s_cfonly_full_rlrhalf/task_focus_tf_focus_autogen2s_cfonly_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 9 kBpi05_libero_tf_focus_autogen2s_maskonly_l0_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_l0_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 9 kBpi05_libero_tf_focus_gs01_cf_teacher_low/task_focus_tf_focus_gs01_cf_teacher_low_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 9 kBpi05_libero_tf_focus_gs01_cf_repel_low/task_focus_tf_focus_gs01_cf_repel_low_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.9 kBpi05_libero_tf_focus_gs01_cf_split_low/task_focus_tf_focus_gs01_cf_split_low_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.9 kBpi05_libero_tf_baseline_sam22_fp32/task_focus_tf_baseline_sam22_fp32_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.9 kBpi05_libero_tf_cf_only_low/task_focus_tf_cf_only_low_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.9 kBpi05_libero_tf_focus_autogen2s_maskonly_cig_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_cig_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.9 kBpi05_libero_tf_focus_autogen2s_maskonly_cig_hinge_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_cig_hinge_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.9 kBpi05_libero_tf_focus_autogen2s_maskonly_cig_ref_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_cig_ref_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.9 kBpi05_libero_tf_focus_autogen2s_maskonly_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.9 kBpi05_libero_tf_focus_autogen2s_maskonly_paste_obj_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_paste_obj_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.9 kBpi05_libero_tf_focus_autogen2s_maskonly_repel_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_repel_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.9 kBpi05_libero_tf_focus_autogen2s_maskonly_shuffle_full_rlrhalf/task_focus_tf_focus_autogen2s_maskonly_shuffle_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.9 kBpi05_libero_tf_focus_autogen_maskonly_gs01_full_rlrhalf/task_focus_tf_focus_autogen_maskonly_gs01_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.9 kBpi05_libero_tf_focus_gs01_cf_low/task_focus_tf_focus_gs01_cf_low_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.9 kBpi05_libero_tf_focus_gs01_cf_low/task_focus_tf_focus_gs01_cf_low_cosine5e5_5e6_b16_acc1_seed43/metadata.pt 8.9 kBpi05_libero_tf_focus_autogen2_maskonly_full_rlrhalf/task_focus_tf_focus_autogen2_maskonly_full_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.8 kBpi05_libero_tf_focus_autogen_full/task_focus_tf_focus_autogen_full_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.8 kBpi05_libero_tf_focus_autogen_maskonly_bf16_full/task_focus_tf_focus_autogen_maskonly_bf16_full_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.8 kBpi05_libero_tf_focus_autogen_maskonly_full/task_focus_tf_focus_autogen_maskonly_full_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.8 kBpi05_libero_tf_baseline_fp32/task_focus_tf_baseline_fp32_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.7 kBpi05_libero_tf_baseline_fp32_batchaug/task_focus_tf_baseline_fp32_batchaug_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.7 kBpi05_libero_tf_baseline_lrhalf_fp32/task_focus_tf_baseline_lrhalf_fp32_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.7 kBpi05_libero_tf_baseline_sam_fp32_rlrhalf/task_focus_tf_baseline_sam_fp32_rlrhalf_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.7 kBpi05_libero_tf_enrich_low/task_focus_tf_enrich_low_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.7 kBpi05_libero_tf_focus_gs01_contact_low/task_focus_tf_focus_gs01_contact_low_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.6 kBpi05_libero_tf_focus_gs01_l1w_low/task_focus_tf_focus_gs01_l1w_low_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.6 kBpi05_libero_tf_focus_gs01_nowrist_low/task_focus_tf_focus_gs01_nowrist_low_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.6 kBpi05_libero_tf_focus_gs01_low/task_focus_tf_focus_gs01_low_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.5 kBpi05_libero_tf_focus_gs01_low/task_focus_tf_focus_gs01_low_cosine5e5_5e6_b16_acc1_seed43/metadata.pt 8.5 kBpi05_libero_tf_focus_obj_low/task_focus_tf_focus_obj_low_cosine5e5_5e6_b16_acc1_seed43/metadata.pt 8.5 kBpi05_libero_tf_focus_objgrip_low/task_focus_tf_focus_objgrip_low_cosine5e5_5e6_b16_acc1_seed43/metadata.pt 8.5 kBpi05_libero_tf_baseline_low/task_focus_tf_baseline_low_cosine5e5_5e6_b16_acc1_seed43/metadata.pt 8.4 kBpi05_libero_tf_focus_gs01_cf_cig_full/task_focus_tf_focus_gs01_cf_cig_full_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.4 kBpi05_libero_tf_baseline_low/task_focus_tf_baseline_low_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.2 kBpi05_libero_tf_focus_gs01_cf_bsplit_full/task_focus_tf_focus_gs01_cf_bsplit_full_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.2 kBpi05_libero_tf_focus_gs01_cf_sam/task_focus_tf_focus_gs01_cf_sam_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.1 kBpi05_libero_tf_focus_gs01_cf/task_focus_tf_focus_gs01_cf_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8.1 kBpi05_libero_tf_baseline_sam/task_focus_tf_baseline_sam_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 8 kBpi05_robocasa_tf_focus_gs01/task_focus_robocasa_focus_gs01_h50_b16_seed42/metadata.pt 7.7 kBpi05_libero_tf_focus_gs01/task_focus_tf_focus_gs01_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 7.6 kBpi05_libero_tf_baseline/task_focus_tf_baseline_cosine5e5_5e6_b16_acc1_seed42/metadata.pt 7.5 kBpi05_robocasa_tf_baseline/task_focus_robocasa_baseline_h50_b16_seed42/metadata.pt 7.5 kB