bioRxiv Science⌕ Search

Biology subjects

Kimmel, D. L.

Publications and source records attributed to Kimmel, D. L..

3 recordsLinked to original sources

Neural representations supporting generalization under continual learning

Abstraction and generalization are essential for flexible decision-making in novel situations. Recent work in humans and monkeys has shown how abstract variables are encoded by the representational geometry of neural population activity. However, these observations--which are typically made after learning has converged--demonstrate the product of abstraction, but not the process by which abstract knowledge is learned: how are the inputs from concrete experiences transformed into abstract knowledge, and how do neural circuits perform these operations and relay this knowledge? To address these questions, we developed a factorized model of temporal abstraction that builds on the successor representation. The model disentangles the contributions of different levels of abstract learning--from stimulus-stimulus associations to a generalizable task schema--in the form of a factorized prediction error that relates the change in relational knowledge to a predicted change in representational geometry on each trial. We fit the model to the behavior of human participants performing a context-dependent decision task during fMRI. The model captured the learning dynamics at multiple timescales, including the increasing contribution of generalization as participants transferred abstracted relational knowledge between novel task instances. In fMRI, BOLD activity in hippocampus--where, in past work, abstract knowledge was represented after learning--was increasingly attributed to the acquisition of abstract knowledge based on generalization. A similar temporal pattern was observed in entorhinal cortex, a putative source of low-dimensional structural information, and orbitofrontal cortex (OFC), which may depend on relational knowledge to represent state relationships as a cognitive map that guides choices. Indeed, individual variation in the generalization signal in OFC correlated with behavioral performance on key trials that required relational knowledge. Our findings show how the brain regions previously shown to represent abstract knowledge after learning also support the process of abstraction as it evolves from learning concrete associations to a generalizable schema. Our approach offers a computational framework for disentangling the operations driving abstract learning and probing their neural correlates in the dynamics of representational geometry.

neuroscience↗

Abstract representations emerge in human hippocampal neurons during inference behavior

Humans have the remarkable cognitive capacity to rapidly adapt to changing environments. Central to this capacity is the ability to form high-level, abstract representations that take advantage of regularities in the world to support generalization1. However, little is known about how these representations are encoded in populations of neurons, how they emerge through learning, and how they relate to behavior2,3. Here we characterized the representational geometry of populations of neurons (single-units) recorded in the hippocampus, amygdala, medial frontal cortex, and ventral temporal cortex of neurosurgical patients who are performing an inferential reasoning task. We find that only the neural representations formed in the hippocampus simultaneously encode multiple task variables in an abstract, or disentangled, format. This representational geometry is uniquely observed after patients learn to perform inference, and consisted of disentangled directly observable and discovered latent task variables. Interestingly, learning to perform inference by trial and error or through verbal instructions led to the formation of hippocampal representations with similar geometric properties. The observed relation between representational format and inference behavior suggests that abstract/disentangled representational geometries are important for complex cognition.

neuroscience↗

Value and choice as separable, stable representations in orbitofrontal cortex

Value-based decision-making operates on multiple variables--including offer value, choice, expected outcome, and recent history--each functioning at different times in the decision process. Orbitofrontal cortex (OFC) has long been implicated in value-based decision-making, but it is unclear how downstream circuits might read out complex OFC responses into separate representations of the relevant variables to support different cognitive functions at specific times. We recorded from single neurons in OFC while macaque monkeys made cost-benefit decisions to juice offers. Using a novel analysis--optimal targeted dimensionality reduction--we discovered orthogonal, static dimensions (i.e. linear combinations of neurons) that selectively represented the value, choice, and expected reward of the present and, separately, previous offers. The neural composition of most representations was stable over discrete time periods that aligned to concurrent cognitive demands. We applied a new set of statistical methods to determine that the sensitivity, specificity and stability of the representations were greater than expected from the low-level features--dimensionality and temporal smoothness--of the responses alone. The separability and stability of OFC representations suggest a mechanism by which downstream circuits can read out specific task-relevant variables at appropriate times.

neuroscience↗