bioRxiv ScienceSearch

Biology subjects

Kayser, C.

Publications and source records attributed to Kayser, C..

6 recordsLinked to original sources

Early Neural Correlates of an Auditory Pitch - Visual Size Cross-modal Association

Research has shown participants associate high pitch tones with small objects, and low pitch tones with large objects. Yet it remains unclear when these associations emerge in neural signals, and whether or not they are likely the result of predictive coding mechanisms being influenced by multisensory priors. Here we investigated these questions using a modified version of the implicit association task, 128-channel human EEG, and two approaches to single-trial analysis (linear discriminant and mutual information). During two interlaced discrimination tasks (auditory high/low tone and visual small/large circle), one stimulus was presented per trial and the auditory stimulus-response assignment was manipulated. On congruent trials preferred pairings (high tone, small circle) were assigned to the same response key, and on incongruent trials non-preferred pairings were (low tone, small circle). The results showed participants (male and female) responded faster during auditory congruent than incongruent trials. The EEG results showed that acoustic pitch and visual size were represented early in the trial (~100 ms and ~220 ms), over temporal and frontal regions. Neural signals were also modulated by congruency early in the trial for auditory (<100ms) and visual modalities (~200ms). For auditory trials, EEG components were predictive of reaction times, but for visual trials they were not. These EEG results were consistent across analysis methods, demonstrating they are robust to the statistical methodology used. Overall, our data support an early origin of cross-modal associations, and suggest that these may originate during early sensory processing potentially due to predictive coding mechanisms.

neuroscience

Consistent pre-stimulus influences on auditory perception across the lifespan

As we get older, perception in cluttered environments becomes increasingly difficult as a result of changes in peripheral and central neural processes. Given the aging society it is important to understand the neural mechanisms constraining perception in the elderly. In young participants, the state of rhythmic brain activity prior to a stimulus has been shown to modulate the neural encoding and perceptual impact of this stimulus - yet it remains unclear whether, and if so, how, the perceptual relevance of pre-stimulus activity changes with age. Using the auditory system as a model, we recorded EEG activity during a frequency discrimination task from younger and older human listeners. By combining single-trial EEG decoding with linear modelling we demonstrate consistent statistical relations between pre-stimulus power and the encoding of sensory evidence in short-latency EEG components, and more variable relations between prestimulus phase and subjects decisions in fronto-parietal EEG components. At the same time, we observed a significant slowing of auditory evoked responses and a flattening of the overall EEG frequency spectrum in the older listeners. Our results point to mechanistically consistent relations between rhythmic brain activity and sensory encoding that emerge in large despite changes in neural response latencies and the relative amplitude of rhythmic brain activity with age.

neuroscience

Speech tracking in auditory and motor regions reflects distinct linguistic features

AbstractDuring online speech processing, our brain tracks the acoustic fluctuations in speech at different time-scales. Previous research has focussed on generic time-scales (for example, delta or theta bands) that are assumed to map onto linguistic features such as prosody or syllables. However, given the high inter-subject variability in speaking patterns, such a generic association between the time-scales of brain activity and speech properties can be ambiguous. Here, we analyse speech tracking in source-localised magnetoencephalographic data by directly focusing on time-scales extracted from statistical regularities in the speech material. This revealed widespread tracking at the time-scales of phrases (0.6 - 1.3 Hz), words (1.8 - 3 Hz), syllables (2.8 - 4.8 Hz), and phonemes (8 - 12.4 Hz). Importantly, when examining the relevance for single-trial comprehension, we found stronger tracking for correctly comprehended trials in the left premotor cortex at the phrasal scale, and in left middle temporal cortex at the word scale. Control analyses using generic bands confirmed that these effects were specific to the stimulus-tailored speech regularities. Furthermore, we found that the phase at the phrasal time-scale coupled to beta-power in motor areas. This cross-frequency coupling likely mediates the comprehension effect in the motor system, and implies top-down temporal prediction in speech perception. Together, our results reveal specific functional and perceptually relevant roles of distinct entrainment processes along the auditory-motor pathway. These processes act concurrently at time-scales within the traditional delta band and highlight the role of neural tracking mechanisms that reflect the temporal characteristics of speech.

neuroscience

Neurophysiological Correlates Of The Rubber Hand Illusion In Evoked And Oscillatory Brain Activity

The rubber hand illusion (RHI) allows insights into how the brain resolves conflicting multisensory information regarding body position and ownership. Previous neuroimaging studies have reported a variety of neurophysiological correlates of illusory hand ownership, with conflicting results likely originating from differences in experimental parameters and control conditions. Here, we overcome these limitations by using a fully automated and precisely-timed visuo-tactile stimulation setup to record evoked responses and oscillatory responses in the human EEG. Importantly, we relied on a combination of experimental conditions to rule out confounds of attention, body-stimulus position and stimulus duration, and on the combination of two control conditions to identify neurophysiological correlates of illusory hand ownership. In two separate experiments we observed a consistent illusion-related attenuation of ERPs around 330 ms over frontocentral electrodes, as well as decreases of frontal alpha and beta power during the illusion that could not be attributed to changes in attention, body-stimulus position or stimulus duration. Our results reveal neural correlates of illusory hand ownership in late and likely higher-order rather than early sensory processes, and support a role of premotor and possibly intraparietal areas in mediating illusory body ownership.

neuroscience

Neural Correlates of Multisensory Reliability and Perceptual Weights Emerge at Early Latencies during Audio-visual Integration

To make accurate perceptual estimates observers must take the reliability of sensory information into account. Despite many behavioural studies showing that subjects weight individual sensory cues in proportion to their reliabilities, it is still unclear when during a trial neuronal responses are modulated by the reliability of sensory information, or when they reflect the perceptual weights attributed to each sensory input during decision making. We investigated these questions using a combination of psychophysics, EEG based neuroimaging and single-trial decoding. Our results show that the weighted integration of sensory information in the brain is a dynamic process; effects of sensory reliability on task-relevant EEG components were evident around 84ms after stimulus onset, while neural correlates of perceptual weights emerged around 120ms after stimulus onset. These neural processes also had different underlying topographies, arising from areas consistent with sensory and parietal regions. Together these results reveal the temporal dynamics of perceptual and neural audio-visual integration and support the notion of temporally early and functionally specific multisensory processes in the brain.

neuroscience

Contributions of local speech encoding and functional connectivity to audio-visual speech integration

Seeing a speakers face enhances speech intelligibility in adverse environments. We investigated the underlying network mechanisms by quantifying local speech representations and directed connectivity in MEG data obtained while human participants listened to speech of varying acoustic SNR and visual context. During high acoustic SNR speech encoding by entrained brain activity was strong in temporal and inferior frontal cortex, while during low SNR strong entrainment emerged in premotor and superior frontal cortex. These changes in local encoding were accompanied by changes in directed connectivity along the ventral stream and the auditory-premotor axis. Importantly, the behavioural benefit arising from seeing the speaker's face was not predicted by changes in local encoding but rather by enhanced functional connectivity between temporal and inferior frontal cortex. Our results demonstrate a role of auditory-motor interactions in visual speech representations and suggest that functional connectivity along the ventral pathway facilitates speech comprehension in multisensory environments.

neuroscience