bioRxiv Science⌕ Search

Biology subjects

Nunez-Elizalde, A. O.

Publications and source records attributed to Nunez-Elizalde, A. O..

3 recordsLinked to original sources

Optimizing Language Model Embeddings to Voxel Activity Improves Brain Activity Predictions

Recent studies have shown that contextual semantic embeddings from language models can accurately predict human brain activity during language processing. However, most studies use contextual embeddings with the same context length and model layer for all voxels, potentially overlooking meaningful variations across the brain. In this study, we investigate whether optimizing contextual embeddings for individual voxels improves their ability to predict brain activity during reading. We optimize embeddings for each voxel by selecting the best-predicting context length, model layer, or both. We perform this optimization with two different types of stimuli (isolated sentences and narratives), and quantify the performance gains of optimized embeddings over standard fixed embeddings. Our results show that voxel-specific optimization substantially improves the prediction accuracy of contextual semantic embeddings. These findings demonstrate that voxel-specific contextual tuning provides a more accurate and nuanced account of how the contextual semantic information is represented across the cortex.

neuroscience↗

Neural basis of functional ultrasound signals

Functional ultrasound imaging (fUSI) is a popular method for measuring blood flow and thus infer brain activity, but it relies on the physiology of neurovascular coupling and requires extensive signal processing. To establish to what degree its trial-by-trial signals reflect neural activity, we performed simultaneous fUSI and neural recordings with Neuropixels probes in awake mice. fUSI signals strongly correlated with the slow (<0.3 Hz) fluctuations in local firing rate, and were closely predicted by the smoothed firing rate of local neurons, particularly putative inhibitory neurons. The optimal smoothing filter had width ~3 s, matched the hemodynamic response function of awake mouse, was invariant across mice and stimulus conditions, and similar in cortex and hippocampus. fUSI signals also matched neural firing spatially: firing rates were as highly correlated across hemispheres as fUSI signals. Thus, hemodynamic signals measured by ultrasound bear a simple and accurate relationship to neuronal firing.

neuroscience↗

Voxelwise encoding models with non-spherical multivariate normal priors

Predictive models for neural or fMRI data are often fit using regression methods that employ priors on the model parameters. One widely used method is ridge regression, which employs a spherical Gaussian prior that assumes equal and independent variance for all parameters. However, a spherical prior is not always optimal or appropriate. There are many cases where expert knowledge or hypotheses about the structure of the model parameters could be used to construct a better prior. In these cases, non-spherical Gaussian priors can be employed using a generalized form of ridge known as Tikhonov regression. Yet Tikhonov regression is only rarely used in neuroscience. In this paper we discuss the theoretical basis for Tikhonov regression, demonstrate a computationally efficient method for its application, and show several examples of how Tikhonov regression can improve predictive models for fMRI data. We also show that many earlier studies have implicitly used Tikhonov regression by linearly transforming the regressors before performing ridge regression.

neuroscience↗