# CredLeak-Bench

The authors introduce CredLeak-Bench, a sandboxed benchmark that measures leakage through actual submissions of synthetic credentials across directed authentication, autonomous inbox monitoring, and recovery settings with paired legitimate controls; evaluating seven models, they find every model leaks in both primary settings, phishing can induce disclosure without any authentication request, most leakage-reducing mitigations also impair legitimate task completion, and recovery ranges only from 0% to 24.2%.

The authors introduce CredLeak-Bench, a sandboxed benchmark that measures leakage through actual submissions of synthetic credentials across directed authentication, autonomous inbox monitoring, and recovery settings with paired legitimate controls; evaluating seven models, they find every model leaks in both primary settings, phishing can induce disclosure without any authentication request, most leakage-reducing mitigations also impair legitimate task completion, and recovery ranges only from 0% to 24.2%.