bioRxiv Science⌕ Search

Biology subjects

Sanchez-Costa, T.

Publications and source records attributed to Sanchez-Costa, T..

3 recordsLinked to original sources

Never mind the repeat: How speech expectations reduce tracking at the cocktail party

When the brain focuses on a conversation in a noisy environment, it exploits past experience to prioritize relevant elements from the auditory scene. This prompts the question of what changes occur in the selective neural processing of speech mixtures as listeners garner prior experience about single speech objects. In three different priming experiments, we quantified cortical selection of temporal landmarks from continuous speech, applying the temporal response function (TRF) method to single-trial electroencephalography (EEG) recordings. The designs specifically addressed how attention interacts with exact (Experiment 1), voice (Experiment 2a), or message (Experiment 2b) content priming of the target or background speakers in cortical responses to speech. Our results demonstrate that, during multispeaker listening, attentional gains typical of cortical responses under speech selection are met with attenuations as a consequence of prior experience. The changes were observed at the P2 processing stage (220-320 ms) of speech envelope onset processing and were specific to responses to primed speech targets (Experiment 1). Suppressions at stages earlier than the P2, or under partial priming conditions (Experiments 2a and 2b), were not observed. An exploratory analysis suggests the observed P2 reduction predicts listeners ability to report target words, consistent with this component encoding in part temporal prediction error about onset edge cues exclusive to target speech. Our results show that at this late and definitive stage of selective attention, the auditory system may test the evidence for its own predictive model of the noise-invariant speech stream. Precise inference of its temporal structure is bound to tag all checkpoints where auditory evidence can be most reliably connected into higher-order representations of continuous speech.

neuroscience↗

Loss of precise auditory sampling as a sign of value-driven visual attentional capture

Conditioning sensory signals endows persistent salience that influences attention, even after they no longer connect with rewards. As distractors shape multisensory target processing, conditioning phenomena remain poorly understood in relation to continuous sensory encoding. We investigate the effects of value-driven attentional capture by visual cues on the ability to reliably phase-lock cortical activity to temporal modulations of sound in audiovisual (AV) displays. Listening to periodically-modulated sound, observers discriminated between two visual object streams flickering at different rates, searching for an AV match. Also in view were peripheral color cues, used to evaluate how they modulate participant tracking fidelity as a result of color-reward associative training. Behavioral and electroencephalography (EEG) recordings (N=31) show that performance impoverished in presence of colors previously associated with reward, and so did tracking reliability measured by phase locking of AV responses. Decreased temporal precision predicted participants reward-driven distraction, evidencing the attentional shift away from the multimodal target timing structure. Loss of consistency was furthermore present in auditory response estimates, suggesting value-driven attentional capture withdraws cortical tracking fidelity across the senses. The findings are consistent with inter-modal competition at times when incentive salience cues overtake top-down tracking of multisensory streams connected in time.

neuroscience↗

Differential neural encoding of sound under visual attention is shaped by audiovisual precision and unimodal uncertainty priors

Selective attentional biases arising from one sensory modality may manifest in another. The effects of visuospatial attention, often considered a foundation for visual object perception, are unclear in the auditory domain during audiovisual (AV) scene processing. This study investigates temporal and spatial factors that facilitate such cross-modal bias transfer at the neural level. Auditory encoding of random tone pips in AV scenes was investigated via a temporal response function model (TRF) of the participants electroencephalogram (N=30). The spatially uninformative pips were associated with spatially distributed visual contrast reversals ( flips) through asynchronous, probabilistic AV temporal onset distributions. Participants deployed visuospatial selection on these AV stimuli to perform a task. A late (~300 ms) cross-modal transfer of the unimodal attentional bias was found on the neural representation of pips. Transfer depended on the selected visual input being (i) presented during or shortly after a related sound in a relatively limited temporal window (<165 ms); and (ii) positioned across limited (1:4) visual foreground to background ratios. In addition, the magnitude of attentional enhancement was proportional to the proximity of flips to the foreground area. The results indicate that ongoing neural representations of sounds can incorporate relevant visuospatial attributes for auditory stream segregation.

neuroscience↗