bioRxiv Science⌕ Search

Biology subjects

Belanger, J.

Publications and source records attributed to Belanger, J..

11 recordsLinked to original sources

Estimation of neuronal tuning for word meaning from passively recorded naturalistic speech

The ability to derive neural-level language coding models holds great scientific and clinical potential. Current approaches are limited by the scale and ethological validity of input data; applications requiring large, rare, or naturalistic samples in particular would benefit from the ability to infer neural coding from incidental everyday speech. Here we present a novel pipeline designed to leverage spontaneous and incidental naturalistic speech. This pipeline performs transcription, segmentation, and video-assisted diarization, as well as alignment and spike detection of neural data. We apply this pipeline to a dataset derived from 21 patients (6+ days each, over 800 hours and 5 million words total). We benchmark both encoding and decoding models against extensive and rare ground-truth control datasets consisting of human-curated word-level temporal alignment and manually sorted spikes. We further validate our approach by quantifying representational drift, effect of dataset size, and differences between six brain areas. Together, these findings demonstrate that incidental natural speech is sufficiently processed in the brain to enable the estimation neural-level embeddings.

neuroscience↗

A number simplex in the human medial temporal lobe

Humans handle numbers nimbly, suggesting a richer neural manifold structure than the prevalent mental number line model. In populations of medial temporal lobe (MTL) neurons in humans performing two simple tasks (dot counting and arithmetic), we find robust neural coding of numerosity that results in high dimensional, simplex-shaped manifolds. This shape affords more flexibility than a linear manifold due to its high shattering dimensionality and expressibility. Dot arrays and Arabic numerals evoked distinct simplicial population codes, yet they were linked by a linearly transferable latent structure within the same task. We find similar simplicial geometry of number representations in large language models (LLMs). Moreover, subjects internally computed arithmetic results were decodable during the calculation period, with decoding accuracy correlating with individual mathematical capacity. Finally, linear transformations of simplicial operand representations modeled the brains conversion of operands into decodable results, suggesting that the brains arithmetic procedures have some resemblance to the attention architecture of LLMs. Together, these findings establish a high dimensional representational foundation for numerical cognition in the brain.

neuroscience↗

Polysemanticity in human hippocampal neurons

To comprehend language, the brain must navigate a high-dimensional semantic landscape while seamlessly contextualizing meaning. Inspired by recent advances in the mechanistic interpretability of large language models (LLMs), we hypothesized that the brain utilizes polysemanticity, a coding strategy wherein individual neurons represent multiple semantically unrelated features through high-dimensional superposition (Elhage et al., 2022; Olah et al., 2020). We recorded single-unit activity from the human hippocampus during podcast listening. We found that hippocampal neurons exhibit dense semantic codes characterized by multiple tuning peaks with an overdispersed, isotropic geometry. This geometry satisfies the theoretical requirements for interference minimization in superimposed codes. Furthermore, semantic responses are strongly modulated by lexical and speaker-identity context; nonetheless, the underlying population geometry remains stable. This coding strategy permits rapid contextualization without requiring specialized, context-specific neurons. Indeed, we show clear pattern separation of similar terms, along with pattern completion for held-out words. Together, these results demonstrate that the human brain leverages superposition to solve a universal computational problem: maximizing semantic capacity within a constrained representational space.

neuroscience↗

Neural signatures of impaired semantic contextualization in Autism Spectrum Disorder

Social and communicative deficits are defining characteristics of autism spectrum disorder (ASD). Some theories suggest that these challenges, among other autistic traits, may arise from differences in predictive coding, or how the brain uses context to predict and interpret incoming information. This idea has the potential to link symptoms of autism to specific neurocomputational processes, and is especially promising for communication, whose impairment is a hallmark of ASD. Here we leveraged the ability of large language models (LLMs) to quantify semantic contextualization to analyze a unique dataset of responses from hippocampal neurons obtained during language listening in three mild-to-severe autistic individuals with comorbid epilepsy. Key elements of semantic coding were preserved in all three individuals with ASD: single-neuron response dynamics, representation of word-word semantic relationships, and patterns of context-dependent shifts in meaning. However, relative to controls, ASD resulted in reduced neural signatures of contextualization: (1) neuronal responses were aligned with earlier, less contextual layers of GPT-2, (2) ASD patients had lower effective dimensionality of the neural subspace predicting semantics, (3) neural representations of word meaning were less influenced by preceding context, and (4) neural signatures of lexical surprisal were reduced. Together, these results support theories of autism that emphasize impairments in contextualization, and highlight the power of LLMs as a tool for quantifying the computational basis of neurodevelopmental disorders.

neuroscience↗

Semantic axes in the brain support analogical representations

ABSTRACTIn language models of word meaning, directions in the embedding space often correspond to semantic features that can be reused across different words. For example, a single direction corresponding to gender may differentiate word pairs like "boy/girl", "uncle/aunt" and "king/queen". Here we show that the same principle governs semantically driven neural responses in the human brain. We recorded populations of single neurons during podcast listening and identified word sets with consistent meaning differences. Across fifteen sets, including gender, plural, and negation, we observed consistent vectorial directions, resulting in parallelogram structures within the neural manifold. Deviation from parallelism in large language models (LLMs) predicted corresponding deviations in brain-derived parallelism. Among pronouns, vectors corresponding to case, number and person exhibited parallelogram structures individually and, collectively, obeyed the principle of commutativity, resulting in a prismatic structure. Finally, different semantic variables were preferentially associated with discrete groups of neurons, consistent with energy-efficiency theories. Together, these results establish a geometric foundation for the neural encoding of word meaning.

neuroscience↗

Shared neural geometries for bilingual semantic representations

The human brain has the remarkable ability to comprehend and express similar concepts in multiple languages. To understand how it does so, we examined responses of hippocampal neurons during passive listening, directed speaking, and spontaneous conversation, in both English and Spanish, in a small group of balanced bilinguals. We find a small number of putative cross-language neurons, whose responses to equivalent words (e.g., "tierra" and "earth") are correlated. However, neurons semantic tunings differed substantially by language, suggesting language-specific neural implementations. Instead, the crucial driver of translation was a preserved geometric organization of neural responses between the two languages, one that did not depend on neuron level functional overlap. Indeed, that geometry was implemented by a common set of neurons along distinct readout axes; this difference in readout may help prevent cross-language interference. Together, these results suggest that hippocampus encodes a language-independent internal model for meaning.

neuroscience↗

A semantotopic map in human hippocampus

The hippocampus plays a central role in encoding abstract conceptual and semantic information. However, little is known about the topography of that encoding. We leveraged the rare opportunity to examine neural responses densely along a small portion of the human hippocampus, specifically, the mediolateral axis of the anterior body. We collected responses to passive language listening using Neuropixels probes in three anesthetized patients during clinically indicated neurosurgical procedures. We computed semantic tuning functions for each recording site by regressing threshold crossing events and single unit responses against semantic embeddings from GPT-2, Word2Vec, and SBERT. We find that tuning functions of more distant recording sites are more dissimilar, supporting the hypothesis semantotopic organization. Multiple semantic features showed systematic changes along that axis, including animacy, concreteness, and familiarity; notably, effects were individual-specific. Surprisingly, we also found a small but significant increase in semantic similarity as a function of distance between recording sites, on a shorter spatial scale, suggesting a modest periodic organization. Together, these results demonstrate the presence of a multiscale functional organization of semantics in the hippocampus.

neuroscience↗

Mirror manifolds: partially overlapping neural subspaces for speaking and listening

We utilize internal representations of meaning for two purposes: to understand the words we hear and to generate our own speech. This dual requirement necessitates abstract, modality-agnostic representations. Building on work identifying it as a hub for relational mapping, we hypothesized that the hippocampus supports abstract, cross-person representations, and uses shared semantic geometries to do so. We tested this hypothesis by examining hippocampal activity in a remarkable single-neuron dataset derived from conversational speech. Neurons robustly encoded meanings of both spoken and heard words, and used common geometric embeddings for both, leading to abstract meaning performance. Speaker identity was aligned with meaning via partial subspace alignment, which affords speaker-meaning binding by partitioning meaning by speaker while maintaining cross-speaker generalization. Degrees of subspace rotation varied on a single word level and depended systematically on semantic category. Together, these findings indicate how geometric principles allow for abstract cross-personal meanings while preserving binding to speaker identity.

neuroscience↗

Astrocytic activation of EMMPRIN contributes to their pathological phenotype in ALS.

Amyotrophic Lateral Sclerosis (ALS) is a fatal disease characterised by the degeneration of upper and lower motoneurons. Onset and progression of the disease are determined by both cell-autonomous neuronal dysfunctions and non-cell-autonomous factors, mainly due to activation of glial cells such as astrocytes and microglia. The Extracellular Matrix Metalloproteinases INducer (EMMPRIN), a glycoprotein expressed by various cell types including neurons, is the major activator of matrix metalloproteinases (MMPs) synthesis and release. EMMPRIN activation can be induced by peptidyl-prolyl isomerase A (PPIA), a chaperone protein with cis/trans isomerase activity, that exhibits cytokine- and chemokine-like behaviour. Previous studies showed that PPIA is highly released in the cerebrospinal fluid (CSF) of ALS patients and animal models where, by activating EMMPRIN on motoneurons, induces neuronal death. Here, we show that EMMPRIN is expressed also by astrocytes, suggesting this cell type as sensitive as motoneurons to PPIA-mediated EMMPRIN activation. We observed that that PPIA-mediated EMMPRIN activation prompt astrocytes toward a pro-inflammatory profile. Interestingly, we found that this pathogenic profile can be reverted by an anti-EMMPRIN antibody. Finally, we provide evidence that the activation of EMMPRIN is relevant for mutant SOD1 and TDP-43 conditions. In conclusion, we demonstrate that EMMPRIN activation in ALS occurs also in astrocytes where it exacerbates their pathological phenotype possibly contributing to the progression of the disease. Furthermore, we suggest the potential use of an anti-EMMPRIN antibody to reduce astrocytic activation during the disease.

neuroscience↗

A vectorial code for semantics in human hippocampus

As we listen to speech, our brains track the meanings of the words we hear. Recent successes of large language models suggest that distributed population geometry can capture rich semantic relationships between words. Motivated by this idea, we hypothesized that semantic information in the brain may likewise be expressed in distributed patterns of activity across neurons, rather than in the activity of neurons narrowly tuned to a specific word. We recorded responses of hundreds of neurons in the human hippocampus while participants listened to narrative speech. We find encoding of contextual word meaning in the simultaneous activity of neurons whose individual selectivities span multiple unrelated semantic categories. Decoding and population geometry analyses revealed distinct neural coding principles for low-versus high-frequency words, likely reflecting the greater polysemy of common words. Similar to embedding vectors in semantic language models, distance between neural population responses correlates with semantic distance; however, this effect was only observed in contextual embedding models (GPT-2 and BERT), suggesting that the semantic distance effect depends critically on contextualization. Consistent with this, we find that neural population activity supports a multidimensional semantic subspace that aligns most closely with the contextual structure captured by GPT-2. Moreover, for semantically similar words, even contextual embedders showed an inverse correlation between semantic and neural distances; we attribute this pattern to the noise-mitigating benefits of contrastive coding. Ultimately, these results provide a neurocomputational account for understanding how neural populations track word meaning.

neuroscience↗

Antisense oligonucleotide-based therapeutic strategy for progranulin-deficient frontotemporal dementia

Heterozygous GRN (progranulin) mutations cause frontotemporal dementia (FTD) due to haploinsufficiency, and increasing progranulin levels is a major therapeutic goal. Several microRNAs, including miR-29b, negatively regulate progranulin protein levels. Antisense oligonucleotides (ASOs) are emerging as a promising therapeutic modality for neurological diseases, but strategies for increasing target protein levels are limited. Here, we tested the efficacy of ASOs as enhancers of progranulin expression by sterically blocking the miR-29b binding site in the 3 UTR of the human GRN mRNA. We found 16 ASOs that increase progranulin protein in a dose-dependent manner in neuroglioma cells. A subset of these ASOs also increased progranulin protein in iPSC-derived neurons and in a humanized GRN mouse model. In FRET-based assays, the ASOs effectively competed miR-29b from binding to the GRN 3 UTR RNA. The ASOs increased levels of newly synthesized progranulin protein by increasing its translation, as revealed by ribosomal profiling. Together, our results demonstrate that ASOs can be used to effectively increase target protein levels by partially blocking miR binding sites. This ASO strategy may be therapeutically feasible for progranulin-deficient FTD as well as other conditions of haploinsufficiency.

neuroscience↗