Skip to main content
Search

# World Action Model

15 related articles

Subscribe to updates
  1. arXiv

    ForceWAM splits contact learning in two: demos set the goal, play data teach force response, reaching 95% on one real-robot task

    In contact-rich manipulation, expert demonstrations cover successful paths but say little about how force responds to different actions, while task-agnostic play records broader contact dynamics without a task goal. ForceWAM gives the task-compatible motion and six-axis force/torque future to a force world model trained on demonstrations, and gives the question of which actions realize that future to an inverse dynamics model trained on both demonstrations and play; at deployment, fresh wrench feedback corrects actions between world-model updates. Across force-regulated sliding, box flipping with and without disturbances, and ring placement, the full system reaches 85%, 95%, 85%, and 90% success, above the listed baselines.

  2. arXiv

    Robots need not imagine the future at every replan: Bind-WAM routes on language-object binding uncertainty and reaches 98.60% mean success on LIBERO

    World Action Models (WAMs) predict future visual states and actions together, but generating a visual future at every replanning step is expensive and sometimes unnecessary. Bind-WAM uses whether the roles named in a language instruction are stably bound to objects in the current view as an interpretable signal: an offline pipeline labels reference mismatch, invisibility and identity drift from complete demonstrations, and a lightweight router of about 6.65M parameters switches a shared WAM between direct action prediction and joint future-action denoising. On LIBERO, Bind-WAM reaches 98.60% mean success while invoking the joint path at only 40.58% of replanning states, cutting average completion time from 15.73 s for Fast-WAM-Joint to 11.71 s.

  3. arXiv

    SWAM carries video priors into robot actions: 61.56% success on randomized scenes, 12.86 points above OpenWAM

    Shanghai Jiao Tong University and collaborators assembled a roughly 47,000-hour multisource pool and extended a pretrained video model's language–video priors into language–video–action learning, yielding the world action model SWAM. On the 50 manipulation tasks of RoboTwin 2.0, SWAM reaches 61.56% success under the randomized Hard setting, 12.86 percentage points above the strongest baseline OpenWAM, and 88.10% under the clean Easy setting, slightly below OpenWAM's 89.30%. On a real bimanual platform, its three-task average Hard success rate is 40.00% against OpenWAM's 23.33%.

  4. Runway

    Runway turns a video model into a robot controller: Praxis-1 solves 46.2% of RoboLab-120 and ships open weights

    Runway released Praxis-1, which converts a 27B-parameter video foundation model into a world action model that predicts both the next scene and the motion to reach it, and ships it as open weights. Robot data is scarce and expensive to collect, and generalist policies have leaned on teleoperation or egocentric footage; Praxis-1 instead pretrains on everyday video, then mid-trains on embodied video and jointly with an action expert. Fine-tuned on DROID, it solved 555 of 1,200 RoboLab-120 episodes (46.2%), the highest among world action models and open-source robot foundation models on that leaderboard.

  5. NVIDIA Blog

    Robots rehearse delicate assembly in simulation: NVIDIA's Isaac Lab 3.0 with Newton reaches up to 2.5x training throughput

    At CoRL, NVIDIA released an open robotics stack including GR00T 2, a world action model built on Cosmos, the Isaac Lab 3.0 simulation framework and the Isaac Lab-Arena evaluation framework. Tighter integration between Isaac Lab 3.0 and the open-source Newton physics engine lets it model deformable objects such as cables and cloth and multi-joint robotic hands; on a vision-based dexterous manipulation benchmark, Isaac Lab 3.0 with Newton reached up to 2.5x the training throughput of Isaac Lab 2.3 with PhysX. GR00T 2 averaged 71% success across 50 tasks with one demonstration per task, rising to 95% with five.

  6. arXiv

    One robot world model that also acts: GreenWAM maps 20 bodies onto 79 anatomical slots and hits 95.6% instruction success on a real humanoid

    Sber Robotics Center released GreenWAM, a robot foundation model rebuilt from Cosmos 3 Edge to serve as both a world model and a policy. A shared 79-slot anatomical action space maps the native joints of 20 robot families onto common leg, torso, arm and finger coordinates, and one model is trained jointly in seven visual and action modes. On WorldArena 1.0 it has the highest trajectory, depth and 3D accuracy among the compared world-action models and video generators; on the real Green humanoid it completes 95.6% of in-distribution instructions, against 88.9% for a policy adapted from Cosmos 3 Edge and 84.4% for π0.5.

  7. arXiv

    WorldBridge splits video prediction from action: one labeled demo per new task lifts success from 55.90% to 70.70%

    WorldBridge separates video prediction and action generation into two experts and uses structured attention to route predicted future frames into actions, then tests what video and action supervision each contribute on RoboTwin 2.0. With only in-distribution video-action supervision, out-of-distribution task success is 25.07%; adding videos of those tasks without action labels raises it to 55.90%, and one action-labeled demonstration per task raises it to 70.70%. Under the full data setting, WorldBridge reaches 96.23% average success on RoboTwin 2.0.

  8. arXiv

    GUI agents stop rebuilding future screens: latent prediction lifts success up to 40.6% and cuts world-model latency by 98.9%

    GUI agents no longer reconstruct the next screen pixel by pixel; a shared latent representation now scores candidate actions and predicts action-conditioned futures at once, raising success rates by up to 31.9% offline and 40.6% online relative to pixel-space world models while cutting world-model inference latency by up to 98.9%.

  9. arXiv

    Robot policies ship as weights alone: letting a world action model replay its own generated past cuts forgetting by over 90%

    A world action model can regenerate complete rollouts of previously learned tasks from their instructions alone, and after truncation and physical-consistency filtering, replaying them cuts the forgetting of sequential fine-tuning by over 90% on four LIBERO suites and five real-world tasks without keeping any data from previous tasks.

  10. arXiv

    A robot world-action model shrinks to 0.88B: 95.5% LIBERO success at 57 ms

    SmolWAM compresses the 2B-parameter Cosmos Policy video world-action model to 0.88B, succeeding in 95.5% of 400 LIBERO episodes at 57 ms, 2.3 TFLOP and 2.4 GiB per 16-action chunk, 11 times faster than its teacher while still forecasting scene motion.