Skip to main content
Search

Henry Bergman

1 related articles

Subscribe to updates
  1. medRxiv

    Beyond word error rate: clinical risk as the necessary standard for ambient AI scribe evaluation: evidence from 77 global languages

    This study constructed a multilingual clinical dictation corpus (five clinical dictation scripts spanning a complexity gradient, translated into 99 languages, rendered to synthetic speech under three acoustic conditions, and transcribed by a production ambient scribe), computed six frequency metrics, and had three independent large language model raters assess clinically meaningful error patterns using a Severity x Likelihood framework; across 59,819 genuine transcription-error occurrences, 58,329 (97.5%) were LOW risk and 251 (0.42%) CRITICAL or HIGH, none of the six frequency metrics showed a detectable association with serious clinical risk (absolute Spearman rho < 0.16), a Severity x Likelihood sum remained strongly correlated with WER (rho=0.

You’re all caught up