Skip to main content
Search

# Entropy-based Layer Set Iteration (ELSI)

1 related articles

Subscribe to updates
  1. arXiv

    Speculative decoding stops picking layers by position: entropy and CKA choose the set, lifting accepted tokens by about 0.085 on Qwen3

    Which target-model hidden layers a speculative-decoding draft model should see can now be chosen by information content and redundancy instead of a fixed positional rule; on Qwen3-4B-Instruct the selected three-layer set averages about 0.085 more accepted tokens than the EAGLE3 default.

You’re all caught up