Alho, J. | bioRxiv Science

bioRxiv2018

Inferior parietal lobule and early visual areas support elicitation of individualized meanings during narrative listening

When listening to a narrative, the verbal expressions translate into meanings and flow of mental imagery, at best vividly immersing the keen listener into the sights, sounds, scents, objects, actions, and events in the story. However, the same narrative can be heard quite differently based on differences in listeners previous experiences and knowledge, as the semantics and mental imagery elicited by words and phrases in the story vary extensively between any given two individuals. Here, we capitalized on such inter-individual differences to disclose brain regions that support transformation of narrative into individualized propositional meanings and associated mental imagery by analyzing brain activity associated with behaviorally-assessed individual meanings elicited by a narrative. Sixteen subjects listed words best describing what had come to their minds during each 3-5 sec segment of an eight-minute narrative that they listened during fMRI of brain hemodynamic activity. Similarities in these word listings between subjects, estimated using latent-semantic analysis combined with WordNet knowledge, predicted similarities in brain hemodynamic activity in supramarginal and angular gyri as well as in cuneus. Our results demonstrate how inter-individual differences in semantic representations can be measured and utilized to identify specific brain regions that support the elicitation of individual propositional meanings and the associated mental imagery when one listens to a narrative.

neuroscience↗

bioRxiv2017

Skilled lipreaders read and listen to lips

Only a few of us are skilled lipreaders while most struggle at the task. To illuminate the poorly understood neural substrate of this variability, we estimated the similarity of brain activity during lipreading, listening, and reading of the same 8-min narrative with subjects whose lipreading skill varied extensively. The similarity of brain activity was estimated by voxel-wise comparison of the BOLD signal time courses. Inter-subject correlation of the time courses revealed that lipreading and listening are supported by the same brain areas in temporal, parietal and frontal cortices, precuneus and cerebellum. However, lipreading activated only a small part of the neural network that is active during listening/reading the narrative, demonstrating that neural processing during lipreading vs. listening/reading differs substantially. Importantly, skilled lipreading was specifically associated with bilateral activity in the superior and middle temporal cortex, which also encode auditory speech. Our novel results both confirm previous results from few previous studies using isolated speech segments as stimuli but also extend in an important way understanding of neural mechanisms of lipreading.

neuroscience↗