bioRxiv Science⌕ Search

bioRxiv · 10.1101/2024.12.23.628672

Reactivation of reward representations associated with the reinforcement of behavior

Abstract

Reward-related representations are found distributed throughout many human subcortical and neocortical regions that support different neural processes. These representations get reinstated for different but related tasks. There is rising evidence that representations reactivate during learning to reinforce prior rewarding choices. However, there remains a critical lack of understanding for whether and how reactivations in humans can facilitate behavioral reinforcement. To investigate this, we recorded from the temporal lobe and prefrontal cortex with intracranial electrocorticography while human subjects learnt two-choice decisions across two different scenes. Crucially, subjects were able to straightforwardly reactivate knowledge gained in a prior scene to make decisions in the current scene, but only when the reward contingencies stayed the same between the two scenes. Using a Bayesian learner, we inferred reward expectation from choice behavior, and measured representations of these reward expectations in electrocorticography data. We found that the representations of reward expectation in the medial temporal lobe and orbitofrontal cortex were reactivated, only when the subjects could straightforwardly transfer knowledge between the two scenes. In the anterior temporal lobe, the reactivation of reward representations increased as learning increased, suggesting an area of plasticity during learning. This work presents a novel framework for measuring the reinforcement, or reactivation, of representations from human electrophysiology during the reinforcement of behavior. Significance statementThis study provides a framework for how the brain processes and reinstates reward-related information during the reinforcement of behavior. Using intracranial electrocorticography, the researchers found that reward information is encoded in distant brain regions, the medial temporal lobe and orbitofrontal cortex. These representations are dynamically reinstated across scenes when reward contingencies align and when knowledge can be transferred. Additionally, reward-related representations in the anterior temporal lobe become increasingly reinforced or reinstated as learning progresses, revealing an area of plasticity during learning. These findings offer new insights into the neural mechanisms underlying decision-making and highlight potential avenues for addressing conditions like addiction or depression, where reward processing and decision-making are disrupted.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Tong, A. P. S., Sreekumar, V., Inati, S. K., Zaghloul, K. A., Woolrich, M. W.. 2024-12-24. Reactivation of reward representations associated with the reinforcement of behavior. https://doi.org/10.1101/2024.12.23.628672

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Cofilin Suppresses Tau-Induced Defects in Dense-Core Granule Formation and Aβ-Induced Neurodegeneration

Intracellular neurofibrillary tangles formed from hyperphosphorylated tau and extracellular amyloid plaques containing aggregated A{beta}-peptides, specific cleavage products of the Amyloid Precursor Protein (APP), are the primary histopathological hallmarks of Alzheimers Disease (AD), the leading cause of dementia in humans. However, the initiating steps that lead to these pathologies and early neurodegeneration, and the mechanisms by which tau- and A{beta}-induced effects might be linked remain unclear. Using the prostate-like secondary cell (SC) in Drosophila, we recently showed that A{beta} modulates normal APP- and membrane-associated protein aggregation in the dense-core granule (DCG) compartments of the regulated secretory pathway by interfering with subsequent membrane:DCG dissociation. This disrupts endolysosomal trafficking and propagates the resulting endolysosomal defects to other cells that endocytose the secreted abnormal DCG proteins. Here we show that overexpressing human tau also disrupts DCG aggregation and membrane:DCG dissociation inside SC secretory compartments, leading to increased endolysosomal targeting of these compartments. In a genetic screen, we find that knockdown of cofilin, which encodes an actin-severing protein required for dynamic remodelling of microfilaments, generates a similar phenotype. Consistent with this, overexpression of Cofilin, which is known to suppress tau-induced neurodegeneration in flies, reduces tau-induced DCG defects in SCs. Indeed, we find that Cofilin overexpression also suppresses A{beta}-induced degeneration in the fly eye. We conclude that membrane:DCG aggregate dissociation in DCG compartments is disrupted by both tau- and A{beta}-induced genetic changes that are relevant to AD, and this partially involves inhibition of actin cytoskeleton dynamics. Increasing actin remodelling activity can suppress neurodegeneration induced by both tau and A{beta}, suggesting that this process provides an important functional link between them that might be targeted therapeutically.

neuroscience↗

Lactate Promotes an Anti-Inflammatory Phenotype in Activated Microglia

Microglial activation is a central component of neuroinflammatory responses in many brain pathologies. Increasing evidence indicates that microglial phenotype is tightly linked to cellular metabolism, with pro-inflammatory activation associated with enhanced glycolytic flux. Lactate, traditionally considered a metabolic substrate, has recently emerged as a signaling molecule capable of modulating immune responses. However, its direct impact on microglial inflammatory activation remains incompletely understood. In the present study, we investigated the effects of lactate on microglial phenotype under inflammatory conditions using primary rat microglial cultures stimulated with lipopolysaccharide (LPS). Microglial activation was assessed through the expression of phenotypic markers, cytokine production, and secreted chemokine profiles. LPS stimulation induced a strong pro-inflammatory response characterized by increased CD86 expression, elevated TNF-alpha secretion, and enhanced release of several pro-inflammatory chemokines. Post-treatment with sodium L-lactate significantly attenuated these inflammatory responses, reducing pro-inflammatory marker expression and cytokine secretion, while restoring the anti-inflammatory marker CD206. To explore the relevance of these findings in a pathological context, the effects of lactate were further examined in a neonatal rat model of hypoxia-ischemia. Sodium L-lactate administration after injury reduced microglial activation and promoted a shift toward an anti-inflammatory phenotype in cortical regions, whereas hippocampal microglia showed a more limited response. Together, these results demonstrate that lactate directly modulates microglial inflammatory activation and cytokine production in vitro and suggest that lactate-mediated metabolic signaling may contribute in vivo to the regulation of neuroinflammatory responses.

neuroscience↗

Different hippocampal subfield volumes predict source memory performance and general cognitive ability in an adult lifespan sample

Modest positive associations between episodic memory performance and whole hippocampal and hippocampal subfield volumes have been reported in numerous prior studies. A smaller number of studies have reported associations between hippocampal volume and performance on tests of non-mnemonic cognition. The present study examined whether these associations were evident in a lifespan sample of cognitively healthy adults. Of particular interest was whether any identified associations were sensitive to age, and whether associations between subfield volumes and mnemonic and non-mnemonic performance were subfield dependent. We acquired high-resolution T1- and T2-weighted structural images from 163 adults (18-87 years of age). Participants also undertook a comprehensive neuropsychological test battery and an in-scanner test of source memory. Principal components analysis was employed to reduce the neuropsychological test scores to 5 cognitive components. Two components reflected memory performance while the other three reflected different aspects of non-mnemonic cognition. Hippocampal subfields (Cornu Ammonis (CA)1, CA2-3, dentate gyrus (DG) and subiculum) were segmented and measured with the Automated Segmentation of Hippocampus Subfields (ASHS) package. Source memory performance was selectively associated across participants with CA2-3 volume. By contrast, both mnemonic and non-mnemonic component scores derived from the test battery were associated exclusively with the volume of the DG. All associations were age-invariant. The findings indicate that different cognitive domains can be dissociated by virtue of their associations with different hippocampal subfields. Of importance, these associations appear to be life-long and hence are unlikely to reflect individual differences in age-related decline in structural integrity.

neuroscience↗