Speech decoding stops waiting token by token: a draft module reuses the target model's own features for 1.9x lossless speedup on Whisper
Speech recognition decoding no longer has to wait token by token: a lightweight draft module that reuses the target model's acoustic and decoder features delivers up to 1.9x and 2.4x lossless speedups on Whisper and Conformer.