Argo-Bench tests data agents on a simulated 235-table, 7.5-billion-row delivery warehouse, and the best model solves only 34.8% of tasks
The authors built Argo-Bench: a 2024 New York City food-delivery platform simulated into an Oracle E-Business Suite-style warehouse of 235 tables and 7.49 billion rows, where agents are graded on the actions they file — banning accounts, allocating incentive budgets, filing forecasts — against the simulator's withheld ground truth; among 14 frontier and open-weight models, the strongest, Claude Opus 5.5, solves 34.8% of tasks and averages 59.5 points.