Biology subjects

Jagadeesh, A.

Publications and source records attributed to Jagadeesh, A..

2 recordsLinked to original sources

bioRxiv2025

Monkey See, Model Knew: Large Language Models Accurately Predict Visual Brain Responses in Humans and Non-Human Primates

AO_SCPLOWBSTRACTC_SCPLOWRecent progress in multimodal AI and language-aligned visual representation learning has rekindled debates about the role of language in shaping the human visual system. In particular, the emergent ability of language-aligned vision models (e.g. CLIP) - and even pure language models (e.g. BERT) - to predict image-evoked brain activity has led some to suggest that human visual cortex itself may be language-aligned in comparable ways. But what would we make of this claim if the same procedures could model visual activity in a species without language? Here, we conducted controlled comparisons of pure-vision, pure-language, and multimodal vision-language models in their prediction of human (N=4) and rhesus macaque (N=6, 5:IT, 1:V1) ventral visual activity to the same set of 1000 captioned natural images (the NSD1000). The results revealed markedly similar patterns in model predictivity of early and late ventral visual cortex across both species. This suggests that language model predictivity of the human visual system is not necessarily due to the evolution or learning of language perse, but rather to the statistical structure of the visual world that is reflected in natural language.

neuroscience↗

bioRxiv2022

Efficient coding of natural images in the mouse visual cortex

How communication between neurons gives rise to natural vision remains a matter of intense investigation. The mid-level visual areas along the ventral stream, as studies in primates have shown, are selective to a common class of natural images--textures--but a circuit-level understanding of this selectivity and its link to perception remain unclear. We addressed these questions in mice, first showing that they can perceptually discriminate between texture types and statistically simpler spectrally matched stimuli. Then, at the neural level, we found that the secondary visual area (LM), more than the primary one (V1), was selective for the higher-order statistics of textures, both at the mesoscopic and single-cell levels. At the circuit level, textures were encoded in neural activity subspaces whose relative distances correlated with the statistical complexity of the images and with the mices ability to discriminate between them. These dependencies were more significant in LM, in which the texture-related subspaces were smaller and closer to each other, enabling better stimulus decoding in this area. Together, our results demonstrate texture vision in mice, finding a linking framework between stimulus statistics, neural representations, and perceptual sensitivity--a distinct hallmark of efficient coding computations.

neuroscience↗