VTR-Bench tests 11 video generators on 300 prompts and 1,202 text blocks, and the best model still shows an overall word error rate of 0.250
The authors built VTR-Bench, a benchmark that embeds prescribed text and its carriers into 300 prompts (1,202 text blocks) across advertising, science, user interfaces, culture, and daily life, scores text fidelity by carrier-specific transcription and word error rate (WER) and scene and motion fulfillment by a 20-question prompt-specific chain of query, and adds a Keyframe-Guided Agentic Framework in which a Director agent coordinates image generation, motion planning, and visual feedback; across 11 state-of-the-art models they find widespread difficulty in rendering scene text, with the best model reaching an overall WER of 0.250, while the framework cuts overall WER on Minimax H3 from 0.4468 to 0.3015 (a 32.5% relative reduction) and raises Video Score.