Biology subjects

Badier, J.-M.

Publications and source records attributed to Badier, J.-M..

3 recordsLinked to original sources

bioRxiv2023

Sentence superiority in the reading brain

When a sequence of written words is briefly presented and participants are asked to identify just one word at a post-cued location, then word identification accuracy is higher when the word is presented in a grammatically correct sequence compared with an ungrammatical sequence. This sentence superiority effect has been reported in several behavioral studies and two EEG investigations. Taken together, the results of these studies support the hypothesis that the sentence superiority effect is primarily driven by rapid access to a sentence-level representation via partial word identification processes that operate in parallel over several words. Here we used MEG to examine the neural structures involved in this early stage of written sentence processing, and to further specify the timing of the different processes involved. Source activities over time showed grammatical vs. ungrammatical differences first in the left inferior frontal gyrus (IFG: 325-400 ms), then the left anterior temporal lobe (ATL: 475-525 ms), and finally in both left IFG and left posterior superior temporal gyrus (pSTG: 550-600 ms). We interpret the early IFG activity as reflecting the rapid bottom-up activation of sentence-level representations, including syntax, enabled by partly parallel word processing. Subsequent activity in ATL and pSTG is thought to reflect the constraints imposed by such sentence-level representations on on-going word-based semantic activation (ATL), and the subsequent development of a more detailed sentence-level representation (pSTG). These results provide further support for a cascaded interactive-activation account of sentence reading.

neuroscience↗

bioRxiv2023

Dimensionality and ramping: Signatures of sentence integration in the dynamics of brains and deep language models

A sentence is more than the sum of its words: its meaning depends on how they combine with one another. The brain mechanisms underlying such semantic composition remain poorly understood. To shed light on the neural vector code underlying semantic composition, we introduce two hypotheses: First, the intrinsic dimensionality of the space of neural representations should increase as a sentence unfolds, paralleling the growing complexity of its semantic representation, and second, this progressive integration should be reflected in ramping and sentence-final signals. To test these predictions, we designed a dataset of closely matched normal and Jabberwocky sentences (composed of meaningless pseudo words) and displayed them to deep language models and to 11 human participants (5 men and 6 women) monitored with simultaneous magneto-encephalography and intracranial electro-encephalography. In both deep language models and electrophysiological data, we found that representational dimensionality was higher for meaningful sentences than Jabberwocky. Furthermore, multivariate decoding of normal versus Jabberwocky confirmed three dynamic patterns: (i) a phasic pattern following each word, peaking in temporal and parietal areas, (ii) a ramping pattern, characteristic of bilateral inferior and middle frontal gyri, and (iii) a sentence-final pattern in left superior frontal gyrus and right orbitofrontal cortex. These results provide a first glimpse into the neural geometry of semantic integration and constrain the search for a neural code of linguistic composition. Significance statementStarting from general linguistic concepts, we make two sets of predictions in neural signals evoked by reading multi-word sentences. First, the intrinsic dimensionality of the representation should grow with additional meaningful words. Second, the neural dynamics should exhibit signatures of encoding, maintaining, and resolving semantic composition. We successfully validated these hypotheses in deep Neural Language Models, artificial neural networks trained on text and performing very well on many Natural Language Processing tasks. Then, using a unique combination of magnetoencephalography and intracranial electrodes, we recorded high-resolution brain data from human participants while they read a controlled set of sentences. Time-resolved dimensionality analysis showed increasing dimensionality with meaning, and multivariate decoding allowed us to isolate the three dynamical patterns we had hypothesized.

neuroscience↗

bioRxiv2022

Magnetoencephalography can reveal deep brain network activities linked to memory processes

Recording from deep neural structures such as hippocampus non-invasively and yet with high temporal resolution remains a major challenge for human neuroscience. Although it has been proposed that deep neuronal activity might be recordable during cognitive tasks using magnetoencephalography (MEG), this remains to be demonstrated as the contribution of deep structures to MEG recordings may be too small to be detected or might be eclipsed by the activity of large-scale neocortical networks. In the present study, we disentangled mesial activity and large-scale networks from the MEG signals thanks to blind source separation (BSS). We then validated the MEG BSS components using intracerebral EEG signals recorded simultaneously in patients during their presurgical evaluation of epilepsy. In the MEG signals obtained during a memory task involving the recognition of old and new images, we identified with BSS a putative mesial component, which was present in all patients and all control subjects. The time course of the component selectively correlated with SEEG signals recorded from hippocampus and rhinal cortex, thus confirming its mesial origin. This finding complements previous studies with epileptic activity and opens new possibilities for using MEG to study deep brain structures in cognition and in brain disorders.

neuroscience↗