Skip to main content
Search

# Rubric-based agent evaluation

1 related articles

Subscribe to updates
  1. arXiv

    Nine AI agents wrote 135 research follow-ups, and none cleared the domain scientists' bar on integrity, completeness and sufficiency

    Scientists at US Department of Energy national laboratories set the conditions an unpublished follow-up direction must meet, and nine frontier AI agents each wrote 15 follow-up papers, 135 in total. None passed all three checks of integrity, completeness and sufficiency, and 114 failed the integrity check, most often by claiming work that was never done or reporting numbers that contradict the recorded evidence. Agents readily produce papers that look like follow-ups, but none meets the standard the domain scientist set.

You’re all caught up