bioRxiv Science⌕ Search

Biology subjects

Boyd, A. D.

Publications and source records attributed to Boyd, A. D..

3 recordsLinked to original sources

Decoding Spatial Attention in the Cocktail Party Problem Using Wearable Whole-head High-Density fNIRS

Spatial attention is critical for solving the cocktail party problem, a longstanding problem in neuroscience and artificial speech recognition. The ability to decode where humans are attending in a cocktail party like scene would empower applications in brain computer interfaces and assistive devices such as hearing aids. Here we demonstrate that, in an overt attention task, the attended spatial location can be decoded robustly from single trial hemodynamic responses, using a wearable whole head high density fNIRS system. We also identify critical brain regions that make the highest contribution to decoding accuracy. Specifically, we find that decoding based on a small fraction of channels within the left and right inferior parietal lobule (IPL), achieve maximal decoding accuracy comparable to all channels. These results open the way for the design of novel BCIs and assistive devices integrated with fNIRS, that can be steered by spatial attention.

neuroscience↗

A brain-inspired algorithm enhances automatic speech recognitionperformance in multi-talker scenes

Modern automatic speech recognition (ASR) systems are capable of impressive performance recognizing clean speech but struggle in noisy, multi-talker environments, commonly referred to as the "cocktail party problem." In contrast, many human listeners can solve this problem, suggesting the existence of a solution in the brain. Here we present a novel approach that uses a brain inspired sound segregation algorithm (BOSSA) as a preprocessing step for a state-of-the-art ASR system (Whisper). We evaluated BOSSAs impact on ASR accuracy in a spatialized multi-talker scene with one target speaker and two competing maskers, varying the difficulty of the task by changing the target-to-masker ratio. We found that median word error rate improved by up to 54% when the target-to-masker ratio was low. Our results indicate that brain-inspired algorithms have the potential to considerably enhance ASR accuracy in challenging multi-talker scenarios without the need for retraining or fine-tuning existing state-of-the-art ASR systems.

neuroscience↗

A brain-inspired algorithm improves cocktail party listening for individuals with hearing loss

Selective listening in competing-talker situations (restaurants, parties, etc.) is an extraordinarily difficult task for many people. For individuals with hearing loss, this difficulty can be so extreme that it seriously impedes communication and participation in daily life. Directional filtering is one of the only proven ways to improve speech understanding in competition, and most hearing devices now incorporate some kind of directional technology, although real-world benefits are modest, and many approaches fail in competing-talker situations. We recently developed a biologically inspired algorithm that is capable of very narrow spatial tuning and can isolate one talker from a mixture of talkers. The algorithm is based on a hierarchical network model of the auditory system, in which binaural sound inputs drive populations of neurons tuned to specific spatial locations and frequencies, and the spiking responses of neurons in the output layer are reconstructed into audible waveforms. Here we evaluated the algorithm in a group of adults with sensorineural hearing loss, using a challenging competing-talker task. The biologically inspired algorithm led to robust intelligibility gains under conditions in which a standard beamforming approach failed. The results provide compelling support for the potential benefits of biologically inspired algorithms for assisting individuals with hearing loss in "cocktail party" situations.

neuroscience↗