# AI Agent Evaluation

Google AI & Infrastructure, with Mercor, released Physical-Engineering's Last Exam (PLE), an 85-task benchmark and open competition spanning mechanical, electrical, civil and structural engineering that tests whether agents can complete real engineering work under a licensed engineer's review. Each task is a containerized project folder averaging 61 files, and an agent must find governing codes, run calculations and produce deliverables, earning points only after passing every hard safety check. On the private test set all 14 frontier models scored below 50%, with the top configuration reaching a mean of 48.3% on its native harness.

Google AI & Infrastructure, with Mercor, released Physical-Engineering's Last Exam (PLE), an 85-task benchmark and open competition spanning mechanical, electrical, civil and structural engineering that tests whether agents can complete real engineering work under a licensed engineer's review. Each task is a containerized project folder averaging 61 files, and an agent must find governing codes, run calculations and produce deliverables, earning points only after passing every hard safety check. On the private test set all 14 frontier models scored below 50%, with the top configuration reaching a mean of 48.3% on its native harness.