Skip to main content
Search

# Streaming Automatic Speech Recognition

2 related articles

Subscribe to updates
  1. arXiv

    A $5 chip runs open-vocabulary speech recognition: 13M-parameter model stays in flash, with 1.8–2.8 fewer errors than the vendor recognizer on the same chip

    Oído runs open-vocabulary English speech recognition entirely on a $5 ESP32-S3, a chip with no neural accelerator. Such microcontrollers previously managed only keyword spotting or a fixed command list, while a 13M-parameter Conformer-CTC occupies 14.0 MB at int8, too large for the 512 KB of on-chip SRAM and only partly placeable in PSRAM. The engine schedules execution around flash and PSRAM bandwidth, reaching 3.70%/8.23% word error rate on LibriSpeech test-clean/test-other, within 0.12 points of full precision and 1.8–2.8 fewer errors than the vendor recognizer on the same chip; measured on a board it runs at 1.97 times the audio duration on one core, not yet real time.

    Daniel Varela Sánchez（First author）
    OídoSpeech RecognitionPost-Training QuantizationStreaming Automatic Speech RecognitionConnectionist Temporal Classification
  2. arXiv

    F-DSM factorizes waiting probability from the text vocabulary distribution, beating DSM on Japanese and English streaming recognition while cutting GPU memory

    The work first shows that the padding token can be removed from Delayed Streams Modeling (DSM) while maintaining competitive recognition performance, then proposes Factorized DSM (F-DSM), which separates the waiting probability from the distribution over the original LLM vocabulary, removing ASR-specific tokens from the text prediction space and allowing the large-vocabulary softmax to be skipped on waiting steps; experiments on the Corpus of Spontaneous Japanese and LibriSpeech show that F-DSM achieves better recognition performance than DSM, greatly reduces GPU memory use while maintaining similar training throughput, provides a small inference speed improvement through softmax skipping, and reduces the degradation in text-only perplexity observed with DSM.

    Toyohashi University of Technology
    Tatsunari Takagi（First author）
    Factorized Delayed Streams ModelingDelayed Streams ModelingStreaming Automatic Speech Recognition

You’re all caught up