Freedman, E. G. — Page 2 | bioRxiv Science

bioRxiv2021

Learning a new class of multisensory associations: High-density electrophysiological mapping of the temporal course of audio-visual object processing.

Multisensory objects that are frequently encountered in the natural environment lead to strong associations across a distributed sensory cortical network, with the end result experience of a unitary percept. Remarkably little is known, however, about the cortical processes sub-serving multisensory object formation and recognition. To advance our understanding in this important domain, the present study investigated the brain processes involved in learning and identification of novel visual-auditory objects. Specifically, we introduce and test a rudimentary three-stage model of multisensory object-formation and processing. Thirty adults were remotely trained for a week to recognize a novel class of multisensory objects (3D shapes paired to complex sounds), and high-density event related potentials (ERPs) were recorded to the corresponding unisensory (shapes or sounds only) and multisensory (shapes and sounds) stimuli, before and after intensive training. We identified three major stages of multisensory processing: 1) an early, multisensory, automatic effect (<100 ms) in occipital areas, related to the detection of simultaneous audiovisual signals and not related to multisensory learning 2) an intermediate object-processing stage (100-200 ms) in occipital and parietal areas, sensitive to the learned multisensory associations and 3) a late multisensory processing stage (>250 ms) that appears to be involved in both object recognition and possibly memory consolidation. Results from this study provide support for multiple stages of multisensory object learning and recognition that are subserved by an extended network of cortical areas.

neuroscience↗

bioRxiv2020

Individuals with autism have no detectable deficit in neural markers of prediction error when presented with auditory rhythms of varied temporal complexity

The brains ability to encode temporal patterns and predict upcoming events is critical for speech perception and other aspects of social communication. Deficits in predictive coding may contribute to difficulties with social communication and overreliance on repetitive predictable environments in individuals with autism spectrum disorder (ASD). Using a mismatch negativity (MMN) task involving rhythmic tone sequences of varying complexity, we tested the hypotheses that 1) individuals with ASD have reduced MMN response to auditory stimuli that deviate in presentation timing from expected patterns, particularly as pattern complexity increases and 2) amplitude of MMN signal is inversely correlated with level of impairment in social communication and repetitive behaviors. Electroencephalography was acquired as individuals (age 6-21years) listened to repeated five-rhythm tones that varied in the Shannon entropy of the rhythm across three conditions (zero, medium-1 bit) and high-2 bit entropy). The majority of the tones conformed to the established rhythm (standard tones); occasionally the 4th tone was temporally shifted relative to its expected time of occurrence (deviant tones). Social communication and repetitive behaviors were measured using the Social Responsiveness Scale and Repetitive Behavior Scale-Revised. Both neurotypical controls (n=19) and individuals with ASD (n=21) show stepwise decreases in MMN as a function of increasing entropy. Contrary to the result forecasted by a predictive coding hypothesis, individuals with ASD do not differ from controls in these neural mechanisms of prediction error to auditory rhythms of varied temporal complexity, and there is no relationship between these signals and social communication or repetitive behavior measures. Lay SummaryWe tested the idea that the brains ability to use previous experience to influence processing of sounds is weaker in individuals with autism spectrum disorder (ASD) than in neurotypical individuals. We found no difference between individuals with ASD and neurotypical controls in brain wave responses to sounds that occurred earlier than expected in either simple or complex rhythms. There was also no relationship between these brain waves and social communication or repetitive behavior scores.

neuroscience↗