# ARC-AGI-2

Looped Transformers deepen reasoning by re-running a shared block at test time, but the usual carry-last rule lets later iterations overwrite correct intermediate results. InfiLoop replaces that rule with learned attention over recurrent outputs: a shared pseudo-query scores each candidate once, a learned exponential decay discounts older ones, and the aggregation has an exact streaming recurrence needing only a weighted-state vector and a normalization scalar per token. On Sudoku-Extreme a 7M-parameter model reaches 97.9% exact accuracy versus 94.2% for FPRM, and hits 90.9% at 1,872 layers where FPRM needs 3,744 layers for 90.1%.

Looped Transformers deepen reasoning by re-running a shared block at test time, but the usual carry-last rule lets later iterations overwrite correct intermediate results. InfiLoop replaces that rule with learned attention over recurrent outputs: a shared pseudo-query scores each candidate once, a learned exponential decay discounts older ones, and the aggregation has an exact streaming recurrence needing only a weighted-state vector and a normalization scalar per token. On Sudoku-Extreme a 7M-parameter model reaches 97.9% exact accuracy versus 94.2% for FPRM, and hits 90.9% at 1,872 layers where FPRM needs 3,744 layers for 90.1%.

The work introduces Allspark, a training and inference framework in which a weak teacher and a frozen copy of the same model alternate reasoning segments during training while only the teacher is updated from weak-model rollouts, and at inference a stronger frozen student replaces the frozen partner; across Qwen3-1.7B/4B math and reasoning tasks and Inkling-Small teacher evaluations on ARC-AGI-2 with Inkling, Kimi-K2.6, and Nemotron-3-Ultra students, accuracy gains are observed along with an explicit accuracy-token tradeoff.

The work introduces Allspark, a training and inference framework in which a weak teacher and a frozen copy of the same model alternate reasoning segments during training while only the teacher is updated from weak-model rollouts, and at inference a stronger frozen student replaces the frozen partner; across Qwen3-1.7B/4B math and reasoning tasks and Inkling-Small teacher evaluations on ARC-AGI-2 with Inkling, Kimi-K2.6, and Nemotron-3-Ultra students, accuracy gains are observed along with an explicit accuracy-token tradeoff.