Skip to main content
Search

# Confidence-Gated Chain-of-Thought

1 related articles

Subscribe to updates
  1. aclanthology.org

    Chain-of-thought need not fire on every query: confidence gating cuts reasoning use by 30% without losing accuracy when the signal is strong

    Chain-of-thought prompting improves complex reasoning but spends extra computation even on simple queries. A Sheffield team tested "think only when unsure" gating across four training-free confidence signals, three model families and seven reasoning benchmarks, finding that effectiveness varies widely by model and task and tracing the variation to confidence-score saturation and a selection bias that sends the hardest queries to chain-of-thought. Their Pareto-optimal threshold selection reduces chain-of-thought usage by about 30% without sacrificing accuracy where the confidence signal is strong, and falls back toward full chain-of-thought where it is weak.

You’re all caught up