Power sampling fails to converge at real compute budgets, and simple Best-of-N matches its reasoning gains
MCMC and SMC samplers for the power distribution fail to converge under realistic compute budgets, and their reasoning gains are largely recreated by simple Best-of-N selection; Power-RLOO, which fine-tunes directly toward the power distribution, helps only when the base model is already aligned with the task.