Robot world models stop learning only from success: training on human egocentric video and perturbed failures aligns predicted success with real deployment
The action-conditioned world model HF-WM trains on egocentric human manipulation video together with perturbed failure actions, reaching state-of-the-art action-conditioned video generation and predicted success rates that track real-world deployment.