SWAM carries video priors into robot actions: 61.56% success on randomized scenes, 12.86 points above OpenWAM
Shanghai Jiao Tong University and collaborators assembled a roughly 47,000-hour multisource pool and extended a pretrained video model's language–video priors into language–video–action learning, yielding the world action model SWAM. On the 50 manipulation tasks of RoboTwin 2.0, SWAM reaches 61.56% success under the randomized Hard setting, 12.86 percentage points above the strongest baseline OpenWAM, and 88.10% under the clean Easy setting, slightly below OpenWAM's 89.30%. On a real bimanual platform, its three-task average Hard success rate is 40.00% against OpenWAM's 23.33%.