Skip to main content
Search

# Cross-speaker attention

1 related articles

Subscribe to updates
  1. arXiv

    Multi-talker transcription stops decoding each speaker alone: Pandemonium lets speakers see each other and reaches 14.7 average cpWER on meeting benchmarks

    Target-speaker recognition for multi-talker meetings previously decoded each speaker independently and was confined to 30-second windows. Pandemonium moves the diarization conditioning onto the longform Parakeet backbone, which decodes a whole conversation in one pass, and adds cross-speaker attention plus a mask refiner so that the speakers of one conversation become visible to each other inside the encoder. Trained on synthetic, pseudo-labeled and real data, it reaches state-of-the-art results across several meeting benchmarks, with an average cpWER of 19.2 under predicted diarization.

You’re all caught up