A safety card is not a test: turning documented claims into executable checks leaves only 17 of 56 claims exercised by benchmarks
LEST treats documented safety claims in model system cards as test specifications, finding that only 17 of 56 claims for Claude Opus 4.8 and GPT-5.5 are actually exercised by applicable benchmark prompts, and tracing validated counterexamples back to the claims they contradict.