SafeActBench traces the evidence-to-action chain across 656 cases, finding strong static judgment but weaker interactive execution in tool-using agents
The authors introduce SafeActBench, 656 cases across six operational domains and five protocols, using a provenance-bound Evidence Ledger and a deterministic trajectory evaluator to check whether tool-using agents establish required evidence before acting; across ten model–harness configurations, strong static action assessment coexists with much weaker interactive execution, failures often begin with incomplete investigation or premature action, single-action execution is usually reliable once evidence is established, and multi-action workflows additionally expose unresolved prerequisites and incomplete execution.