Skip to main content
Search

# Robot Control

9 related articles

Subscribe to updates
  1. arXiv

    Cutting three-quarters of visual tokens, APS-VLA keeps 95.75% robot-policy success and drops inference to 68.75 ms

    Vision-language-action policies process hundreds of visual tokens per step, which drives up inference latency. APS-VLA keeps the backbone frozen and uses a lightweight scorer conditioned on the current observation, instruction and proprioception to pick tokens, training the retained representation both to reproduce policy outputs and to predict the subsequent visual change. On LIBERO with 128 tokens retained, mean success is 95.75%, 1.25 points below the unpruned 97.00%, and inference latency falls to 68.75 ms.

  2. arXiv

    SWAM carries video priors into robot actions: 61.56% success on randomized scenes, 12.86 points above OpenWAM

    Shanghai Jiao Tong University and collaborators assembled a roughly 47,000-hour multisource pool and extended a pretrained video model's language–video priors into language–video–action learning, yielding the world action model SWAM. On the 50 manipulation tasks of RoboTwin 2.0, SWAM reaches 61.56% success under the randomized Hard setting, 12.86 percentage points above the strongest baseline OpenWAM, and 88.10% under the clean Easy setting, slightly below OpenWAM's 89.30%. On a real bimanual platform, its three-task average Hard success rate is 40.00% against OpenWAM's 23.33%.

  3. Runway

    Runway turns a video model into a robot controller: Praxis-1 solves 46.2% of RoboLab-120 and ships open weights

    Runway released Praxis-1, which converts a 27B-parameter video foundation model into a world action model that predicts both the next scene and the motion to reach it, and ships it as open weights. Robot data is scarce and expensive to collect, and generalist policies have leaned on teleoperation or egocentric footage; Praxis-1 instead pretrains on everyday video, then mid-trains on embodied video and jointly with an action expert. Fine-tuned on DROID, it solved 555 of 1,200 RoboLab-120 episodes (46.2%), the highest among world action models and open-source robot foundation models on that leaderboard.

  4. arXiv

    Coding agents with robot arms: ArmedAgent finds up to 94.29% of tasks end in an unsafe state

    Frontier models' spatial understanding now lets coding agents control a real robot arm zero-shot and end-to-end, with no task-specific demonstrations or retraining, so risk crosses from the digital world into the physical one. ArmedAgent sorts these risks by source into benign instructions that turn unsafe, malicious use, and indirect prompt injection, across 36 tasks in 5 scenarios, evaluated in simulation and validated on a physical arm. Testing GPT-6-Astra, GPT-6-Sol and GPT-6.1-Terra under Codex, overall attack success ranges from 72.22% to 94.29%, and refusal rate is 0% for every model in every category.

  5. arXiv

    Coding agents take their first physical exam: the best setup solves only 34% of 456 core tasks under real-robot-like conditions

    The Embodied First Exam connects general coding agents to 47 simulated robots and lets each agent choose direct control, code to control, or training a policy, while the real-robot-like Standard Setting supplies only sensor observations and, by default, no resets. Among eight agents, GPT-6 Astra in Codex solves 34% of the Standard tests on 456 core tasks, while on the same 391 tasks it reaches 77% in the Privileged Setting, which exposes the full simulator state and allows unlimited resets. The exam also labels the stage at which failed attempts go wrong, so failures can be compared across settings and agents.

  6. arXiv

    Frozen generative policies need not be rebuilt: CANDO corrects in both noise and action space, reaching 91.4% final success

    Pretrained generative policies give robot control strong behavior priors, but adapting them efficiently with online reinforcement learning remains hard: noise-space residual methods regulate adaptation through fixed latent feasible regions that may exclude valuable noise edits, while action-space residual methods are more sample-efficient yet still leave room for improvement. CNDO drops predefined latent feasible regions, learning state- and noise-conditioned directions regulated by a soft conservative constraint built from conservative value estimation and gated execution; CANDO adds an action-space residual on top. Experiments report 76.1 NAUC and a 91.4% final success rate for CANDO, 6.6 NAUC and 4.1 percentage points above the best single-space results.

  7. cloud.google.com

    Robots get a cloud brain: Gemini Robotics ER 2 enters public preview with 91.3% key-frame accuracy

    Google DeepMind's Gemini Robotics ER 2, a high-level reasoning model for robots, is now in public preview on the Gemini platform, letting enterprises declare low-level controls such as vision-language-action models and navigation APIs as tools for the model to orchestrate. The model classifies task progress from continuous video and pinpoints critical event frames, with a stated 91.3% accuracy and 0.96-second mean absolute frame distance. It is described as working across embodiments from stationary arms to humanoids, with simulation, evaluation and deployment handled on Google Cloud.

  8. Robots no longer have to learn only on hardware: Gemini 4 Argon turns sketches, video and photos into runnable MuJoCo scenes

    Gemini 4 Argon puts physical understanding, code generation and visual-semantic reasoning into one model so robot tasks can be practiced in simulation first. On the Embodied Reasoning (ERQA) benchmark, which tests physical and spatial problems in 3D environments, it scores 87% using pure reasoning, above other frontier models. It can also reconstruct calibrated simulation twins from robot camera feeds, egocentric human video or hand-drawn sketches, and generate closed-loop control and training data from them.

  9. arXiv

    D-JEPA supervises relations among candidate futures with executed outcomes, reaching 87.89% on PushT and a 17-point gain on physical robots

    D-JEPA introduces a decision-aligned latent world model: it first quantifies a decision-local prediction gap in which, among the few futures competing for execution, a candidate predicted closer to the goal can fail while an available alternative succeeds; it then uses executed outcomes to supervise a bounded, permutation-equivariant set operator that learns decision-relevant relations among candidate futures, and realizes the learned decision structure in JEPA-compatible future representations so aligned actions can be read out through native latent-distance planning; it reaches 87.89% success on PushT, a 15.04-point average gain on RoboTwin, a 17-point gain on physical robot tasks, and raises mean driving PDMS from 57.36 to 95.34.

You’re all caught up