Skip to main content
Search

# MMLU-Pro

2 related articles

Subscribe to updates
  1. arXiv

    Majority-vote test-time RL locks each question onto one answer, and a kernel probe predicts which one before training without fitted constants

    Majority-vote test-time reinforcement learning makes each question lock onto one answer during training, often a wrong one on hard questions, and until now which answer that is became known only after training. The work treats this as a short race driven by sampling noise between the answers that are close at the start, and gives a closed-form probability for how the network kernel shifts the gap of the two leaders through updates of the trailing answers. In LoRA training on MMLU-Pro multiple-choice questions with three models from two families, predictions from a frozen-kernel chain computed before training forecast which answer each question locks into better than a logistic model refitted on the outcomes, using no fitted constants.

  2. arXiv

    Freezing debate prevented 29 collapses but lost 108 corrections across 6,925 MMLU-Pro debates

    The work introduces an auditable protocol for homogeneous three-agent LLM debate that decomposes final accuracy into preserved, collapse, correction, and unrepaired transitions with collapse onset and signed intervention utility, identifies 253 collapses across 6,925 MMLU-Pro debates, and shows via replay that a leave-one-model-out probe-gated freeze prevents 29 collapses while losing 108 corrections under equal weights, so collapse prevention alone can recommend the wrong policy.

You’re all caught up