DeepFisFis processes 5 ms audio segments in about 2.5 ms, detecting mouse ultrasonic vocalizations in real time and triggering closed-loop stimulation
The work introduces DeepFisFis, a waveform-based neural network that classifies consecutive 5 ms audio segments to detect mouse ultrasonic vocalizations (USVs) while they are being produced, processing each segment in approximately 2.5 ms and thus faster than the incoming audio stream; in a deployed closed-loop system, detections triggered an external stimulus, demonstrating online control of ongoing vocal behaviour, and event-triggered acquisition preserved more than 99% of vocalization time while retaining only approximately 22% of the continuous recording.