Schoot, L. | bioRxiv Science

bioRxiv2021

Dynamic predictive coding across the left fronto-temporal language hierarchy: Evidence from MEG, EEG and fMRI

We used MEG and ERPs to track the time-course and localization of evoked activity produced by expected, unexpected plausible and implausible words during incremental language comprehension. We interpret the full pattern of evoked responses and functional connectivity within a hierarchical predictive coding framework in which evoked activity reflects residual information (error) that is passed up and down the cortical hierarchy. Between 300-500ms, the three conditions produced progressively larger responses within left temporal cortex (lexico-semantic prediction error), while implausible inputs produced a selectively enhanced response within left inferior frontal cortex (event-level prediction error). Between 600-1000ms, unexpected plausible words activated left inferior frontal and middle temporal cortices (feedback activity that induced top-down shifts of event-level and lexico-semantic representations), while highly implausible inputs activated posterior fusiform and medial temporal cortices, supporting orthographic reanalysis and new learning. Therefore, predictive coding may provide a unifying theory that links language comprehension to other domains of cognition.

neuroscience↗

bioRxiv2019

Neural evidence for the prediction of animacy features during language comprehension: Evidence from MEG and EEG Representational Similarity Analysis

It has been proposed that people can generate probabilistic predictions at multiple levels of representation during language comprehension. We used Magnetoencephalography (MEG) and Electroencephalography (EEG), in combination with Representational Similarity Analysis (RSA), to seek neural evidence for the prediction of animacy features. In two studies, MEG and EEG activity was measured as human participants (both sexes) read three-sentence scenarios. Verbs in the final sentences constrained for either animate or inanimate semantic features of upcoming nouns, and the broader discourse context constrained for either a specific noun or for multiple nouns belonging to the same animacy category. We quantified the similarity between spatial patterns of brain activity following the verbs until just before the presentation of the nouns. The MEG and EEG datasets revealed converging evidence that the similarity between spatial patterns of neural activity following animate constraining verbs was greater than following inanimate constraining verbs. This effect could not be explained by lexical-semantic processing of the verbs themselves. We therefore suggest that it reflected the inherent difference in the semantic similarity structure of the predicted animate and inanimate nouns. Moreover, the effect was present regardless of whether a specific word could be predicted, providing strong evidence for the prediction of coarse-grained semantic features that goes beyond the prediction of individual words. Significance statementLanguage inputs unfold very quickly during real-time communication. By predicting ahead we can give our brains a "head-start", so that language comprehension is faster and more efficient. While most contexts do not constrain strongly for a specific word, they do allow us to predict some upcoming information. For example, following the context, "they cautioned the...", we can predict that the next word will be animate rather than inanimate (we can caution a person, but not an object). Here we used EEG and MEG techniques to show that the brain is able to use these contextual constraints to predict the animacy of upcoming words during sentence comprehension, and that these predictions are associated with specific spatial patterns of neural activity.

neuroscience↗