BIABench tests AI agents on 16 published studies: routine analyses complete, but 3D and time-lapse tasks fall to 0.00–0.10
The authors built BIABench, which reconstructs 16 published biological studies as end-to-end bioimage-analysis tasks giving the agent raw images plus a biologist's instruction, scores outcomes against the studies' own reported results with deterministic metrics and scores process with a VLM against expert-written rubrics, running six agents across several models and two instruction levels with three repeats each, and found routine 2D tasks reach up to 0.97 while 5D nuclear-pore quantification and 3D oncogenic puncta quantification stay at or below 0.25 in every configuration.