Skip to main content
Search

# Correlated Errors

2 related articles

Subscribe to updates
  1. arXiv

    Accuracy stops being a pass: shared errors make three observers worth one, so certify the deployment

    In multi-agent coordination, deciding whether a coordinator may act on its inferences by inference accuracy fails in both directions, approving harmful language-model deployments in Hanabi where shared errors compound and rejecting beneficial ones in task assignment where costly errors are rare.

  2. Self-consistency backfires on long context: seven of eight samples agree on the same wrong answer

    On long-context tasks, self-consistency, the practice of sampling several answers and aggregating them, no longer improves performance and often lowers it, because positional bias makes the samples repeat the same mistake and the vote turns that mistake into a consensus.

You’re all caught up