Visual assistant evaluation moves into closed-loop simulation: top model Gemini 4 Argon reaches only 53.4% task success within the time limit
Salesforce AI Research released Interactive Visual Gym (IVG), which moves visual AI assistant evaluation from passively watching pre-recorded video to closed-loop simulation: the assistant watches the user's live feed and speaks guidance, and the simulated user changes its actions in response. The accompanying IVG-Bench covers 315 complex scenarios across three operational environments and evaluates 14 visual assistants; the strongest, Gemini 4 Argon, reaches only 53.4% task success within the time limit, averaged across the three environments. In an early proof of concept, an open-source model trained with the simulator, Gwen 3.5-4B, rose from 33.3% to 42.2% success on entirely new tasks it had never seen during training.