WavePrune caps each RoPE channel at its first rotation period, raising HELMET long-context scores on four of five models and reaching 1.15x prefill speedup at 32K context
The authors propose WavePrune, a training-free method that restricts each RoPE channel to its first rotation period, removing position-aliasing "ghost" sub-diagonals; it raises HELMET scores on four of five long-context models (35.7 to 40.0 on Qwen3-8B), lowers validation loss at extrapolated lengths when pretraining from scratch, and, via FlashWavePrune, delivers 1.15x prefill and 1.24x decoding speedups over FlashAttention-2 at 32K context.