bioRxiv Science⌕ Search

Biology subjects

Wassum, K. M.

Publications and source records attributed to Wassum, K. M..

13 recordsLinked to original sources

The Dorsomedial Prefrontal Cortex Uses Reward Predictions to Regulate How Rewards Are Pursued

Reward-predictive cues regulate not only whether but how rewards are pursued, and their influence depends on the strength of their predictive relationship with reward. Whereas weak cues signaling sparse or uncertain reward invigorate instrumental reward seeking, cues signaling imminent reward produce little net invigoration of instrumental behavior and instead promote conditioned goal-approach. We propose that this reflects two opposing influences: an automatic motivational impulse to seek reward, and a top-down, expectancy-dependent control process that constrains it. On this view, the muted or even suppressive effect of imminent-reward cues on instrumental reward seeking reflects an active constraint on motivation rather than its absence. Consistent with this account, we found that selectively devaluing the predicted reward unmasked a latent motivational influence. Cues for imminent reward now invigorated rather than constrained instrumental seeking, suggesting the involvement of a goal-directed regulatory process. Separately, shifting rats from hunger to general satiety abolished the cue-specific regulation of instrumental seeking. We then tested whether the dorsomedial prefrontal cortex (dmPFC) mediates this control. Bulk calcium recordings revealed phasic dmPFC activity that encoded predicted reward probability, dipped when reward was omitted, and covaried with instrumental performance in a cue-dependent manner. Moreover, chemogenetic dmPFC inhibition disrupted the cue-specific regulation of instrumental seeking, leaving rats unable to use these predictions to determine how vigorously to press. These findings identify the dmPFC as a substrate for top-down, expectancy-dependent control over reward pursuit and suggest that its dysfunction may contribute to impulsive or maladaptive reward seeking.

neuroscience↗

Dopamine projections to the basolateral amygdala enable reward prediction

Reward predictions are critical to both adaptive learning and decision making. Such predictions are supported by environmental cues that signal the availability and identity of rewarding events. Here we used fiber photometry, cell-type and pathway-specific optogenetic inhibition, Pavlovian cue-reward conditioning, and decision-making tests in male and female rats to reveal that ventral tegmental area dopamine (VTADA) projections to the basolateral amygdala (BLA) support cue-reward predictions. Reward-predictive cues trigger dopamine release in the BLA that encodes the value of the predicted reward. This cue-evoked VTADA[->]BLA activity mediates the ability of cue-reward predictions to bias action selection and adapt cue-response decisions based on the current value of the predicted reward. Cue-evoked VTADA[->]BLA activity also mediates the constraining influence of cue-reward predictions on new learning. Thus, cue-evoked BLA dopamine supports the reward predictions that both enable adaptive decision making and constrain learning.

neuroscience↗

Dopamine supports reward prediction to constrain reward seeking

Reward predictions not only promote reward pursuit, they also shape how reward is pursed. Such predictions are supported by environmental cues that signal reward availability and probability. Such cues trigger dopamine release in the nucleus accumbens core (NAc). Thus, here we used dopamine sensor fiber photometry, cell-type and pathway-specific optogenetic inhibition, Pavlovian cue-reward conditioning, and test of cue-induced reward-pursuit strategy in male and female rats, to ask whether cue-evoked phasic dopamine release is shaped by reward prediction to support reward pursuit. We found that cue-evoked NAc core dopamine is positively shaped by reward prediction and inversely relates to and predicts instrumental reward seeking. Cues that predicted imminent reward with high probability triggered a large NAc dopamine response and this was associated checking for the expected reward in the delivery location, rather than instrumental reward seeking. Cues that predicted reward with low probability elicited less dopamine and this was associated with a bias towards seeking, rather than check for reward. Correspondingly, inhibition of cue-evoked NAc dopamine increased instrumental reward-seeking and decreased reward-checking behavior. Thus, transient, cue-evoked NAc core dopamine release supports reward prediction to shape reward-pursuit strategy. SIGNIFICANCE STATEMENTCues that signal reward availability can cause us to pursue reward. To ensure this is adaptive, we use the predictions these cues enable to help us decide how to pursue reward. When reward prediction is low, well seek out new reward opportunities. When it is high, well exploit the expected reward by checking for it in its usual location. Here we discovered that transient, cue-evoked nucleus accumbens dopamine fluctuations support reward predictions to shape how reward is pursued. The data show that dopamine can actually constrain reward seeking and promoting reward checking when reward is predicted strongly and imminently. These results provide new information on how dopamine shapes behavior in the moment and help understand the link between motivational and dopamine disruptions in psychiatric conditions such as addictions and depression.

neuroscience↗

Striatal cell-type specific stability and reorganization underlying agency and habit

Goal-directed behavior is guided by learned action-outcome associations, allowing actions to adapt when outcomes change. With repetition, behavioral control shifts toward habit, enabling more automatic action execution, but reducing flexibility to outcome changes. Here, we used longitudinal, cellular-resolution calcium imaging, chemogenetics, instrumental conditioning, and the outcome devaluation test to ask how dorsomedial striatum D1+ and D2/A2A+ neurons contribute to the formation of goal-directed behavior and habit. DMS D1+ neurons stably encode instrumental actions, carry information about behavioral engagement and organization, and develop and maintain action-reward representational similarity and conjunctive activation with learning. Correspondingly, these neurons are critical for action-outcome learning and goal-directed decision making. In contrast, one ensemble of DMS A2A+ neurons transiently encodes actions during early action-outcome learning and another slowly starts to encode actions as habits form. Similarly, DMS A2A+ neurons transiently mediate action-outcome learning and become dispensable for goal-directed decision making. Thus, action-outcome associations are learned through DMS D1+ and A2A+ neuronal activity but only DMS D1+ neurons maintain support of adaptive, goal-directed decision making. Habit formation is associated with reorganization of A2A+ neuronal encoding. These data reveal a cell-type-specific dissociation between stable v. reorganizing striatal action representations paralleled by persistent v. transient contributions to goal-directed control.

neuroscience↗

A common stay-on-goal mechanism in anterior cingulate cortex for information and effort choices

Humans and non-humans alike often make choices to gain information, even when the information cannot be used to change the outcome. Prior research has shown the anterior cingulate cortex (ACC) is important for evaluating options involving reward-predictive information. Here we studied the role of ACC in information choices using optical inhibition to evaluate the contribution of this region during specific epochs of decision making. Rats could choose between an uninformative option followed by a cue that predicted reward 50% of the time vs. a fully informative option that signaled outcomes with certainty, but was rewarded only 20% of the time. Reward seeking during the informative S+ cue decreased following ACC inhibition, indicating a causal contribution of this region in supporting reward expectation to a cue signaling reward with certainty. Separately in a positive control experiment and in support of a known role for this region in sustaining high-effort behavior for preferred rewards, we observed reduced lever presses and lower breakpoints in effort choices following ACC inhibition. The lack of changes in reward latencies in both types of decisions indicate the motivational value of rewards remained intact, revealing instead a common role for ACC in maintaining persistence toward certain and valuable rewards. Graphical Summary O_FIG O_LINKSMALLFIG WIDTH=200 HEIGHT=59 SRC="FIGDIR/small/619920v2_ufig1.gif" ALT="Figure 1"> View larger version (11K): org.highwire.dtl.DTLVardef@6fa3b2org.highwire.dtl.DTLVardef@1642fa8org.highwire.dtl.DTLVardef@74d4d9org.highwire.dtl.DTLVardef@421297_HPS_FORMAT_FIGEXP M_FIG C_FIG Significance StatementWe often make choices to gain information, even when the information cannot be used to change the outcome. Here we investigated the precise timing of the role of the anterior cingulate cortex (ACC) in decisions that involve seeking certain versus uncertain rewards. By optically inhibiting ACC neurons, we demonstrate that this region is crucial for maintaining persistence toward rewards signaled with certainty, without altering the motivational value of the reward itself. In a positive control experiment, we also confirm that ACC is important in effort-based choice. The findings reveal a common role for ACC in maintaining persistence toward certain and valuable rewards, necessary for making optimal decisions. These results have implications for understanding psychiatric disorders involving maladaptive reward-seeking behavior.

neuroscience↗

A dual-pathway architecture enables chronic stress to promote habit formation

Chronic stress can change how we learn and, thus, how we make decisions. Here we investigated the neuronal circuit mechanisms that enable this. Using a multifaceted systems neuroscience approach in male and female mice, we reveal a dual pathway, amygdala-striatal neuronal circuit architecture by which a recent history of chronic stress disrupts the action-outcome learning underlying adaptive agency and promotes the formation of inflexible habits. We found that the basolateral amygdala projection to the dorsomedial striatum is activated by rewarding events to support the action-outcome learning needed for flexible, goal-directed decision making. Chronic stress attenuates this to disrupt action-outcome learning and, therefore, agency. Conversely, the central amygdala projection to the dorsomedial striatum mediates habit formation. Following stress this pathway is progressively recruited to learning to promote the premature formation of inflexible habits. Thus, stress exerts opposing effects on two amygdala-striatal pathways to disrupt agency and promote habit. These data provide neuronal circuit insights into how chronic stress shapes learning and decision making, and help understand how stress can lead to the disrupted decision making and pathological habits that characterize substance use disorders and mental health conditions.

neuroscience↗

Dopamine projections to the basolateral amygdala drive the encoding of identity-specific reward memories

To make adaptive decisions, we build an internal model of the associative relationships in an environment and use it to make predictions and inferences about specific available outcomes. Detailed, identity-specific cue-reward memories are a core feature of such cognitive maps. Here we used fiber photometry, cell-type and pathway-specific optogenetic manipulation, Pavlovian cue-reward conditioning, and decision-making tests in male and female rats, to reveal that ventral tegmental area dopamine (VTADA) projections to the basolateral amygdala (BLA) drive the encoding of identity-specific cue-reward memories. Dopamine is released in the BLA during cue-reward pairing and VTADA[->]BLA activity is necessary and sufficient to link the identifying features of a reward to a predictive cue, but does not assign general incentive properties to the cue or mediate reinforcement. These data reveal a dopaminergic pathway for the learning that supports adaptive decision making and help explain how VTADA neurons achieve their emerging multifaceted role in learning.

neuroscience↗

The cognitive basis of intracranial self-stimulation of midbrain dopamine neurons

Recently there has been a reckoning in the dopamine field. This has suggested that the dopamine prediction error may function as a teaching signal, without endowing preceding events with value. We studied the cognitive basis of intracranial self-stimulation (ICSS), a setting where dopamine appears to be valuable. Physiological frequencies seen during reinforcement learning did not support robust ICSS or promote behavior that would indicate the stimulation was represented as a meaningful reward in a specific or general sense. This was despite demonstrating that this same physiologically-relevant signal could function as a teaching signal. However, supraphysiological frequencies supported robust ICSS where the stimulation was represented as a specific sensory event, which acted as a goal to motivate behavior. This demonstrates that dopamine neurons only support ICSS at supraphysiological frequencies, and in a manner that does not reflect our subjective experience with endogenous firing of dopamine neurons during reinforcement learning. One sentence summaryDopamine neurons only support ICSS at supraphysiological frequencies and in a manner not reflecting dopamines role in learning.

neuroscience↗

The medial orbitofrontal cortex - basolateral amygdala circuit regulates the influence of reward cues on adaptive behavior and choice

Adaptive reward-related decision making requires accurate prospective consideration of the specific outcome of each option and its current desirability. Often this information must be inferred based on the presence of predictive environmental events. The basolateral amygdala (BLA) and medial orbitofrontal cortex (mOFC) are two key nodes in the circuitry supporting such outcome expectations, but very little is known about the function of direct connections between these regions. Here, in male rats, we first anatomically confirmed the existence of bidirectional, direct projections between the mOFC and BLA and found that BLA projections to mOFC are largely distinct from those to lateral OFC (lOFC). Next, using pathway-specific chemogenetic inhibition and the outcome-selective Pavlovian-to-instrumental transfer and devaluation tests, we interrogated the function of the bidirectional mOFC-BLA connections in reward-directed behavior. We found evidence that the mOFC[->]BLA pathway mediates the use of environmental cues to understand which specific reward is predicted, information needed to infer which action to choose, and how desirable that reward is to ensure adaptive responses to the cue. By contrast, the BLA[->]mOFC pathway is not needed to use the identity of an expected reward to guide choice, but does mediate adaptive responses to cues based on the current desirability of the reward they predict. These functions differ from those we previously identified for the lOFC-BLA circuit. Collectively, the data reveal the mOFC-BLA circuit as critical for the cue-dependent reward outcome expectations that influence adaptive behavior and decision making. SIGNIFICANCE STATEMENTTo make good decisions we evaluate how advantageous a particular course of action would be. This requires understanding what rewarding outcomes can be expected and how desirable they currently are. Such prospective considerations are critical for adaptive decision making but disrupted in many psychiatric diseases. Here we reveal that direct connections between the medial orbitofrontal cortex and basolateral amygdala mediate these functions. These findings are especially important in light of evidence of dysfunction in this circuit in substance use disorder and mental illnesses marked by poor decision making.

neuroscience↗

A bidirectional corticoamygdala circuit for the encoding and retrieval of detailed reward memories

Adaptive reward-related decision making often requires accurate and detailed representation of potential available rewards. Environmental reward-predictive stimuli can facilitate these representations, allowing one to infer which specific rewards might be available and choose accordingly. This process relies on encoded relationships between the cues and the sensory-specific details of the reward they predict. Here we interrogated the function of the basolateral amygdala (BLA) and its interaction with the lateral orbitofrontal cortex (lOFC) in the ability to learn such stimulus-outcome associations and use these memories to guide decision making. Using optical recording and inhibition approaches, Pavlovian cue-reward conditioning, and the outcome-selective Pavlovian-to-instrumental transfer (PIT) test in male rats, we found that the BLA is robustly activated at the time of stimulus-outcome learning and that this activity is necessary for sensory-specific stimulus-outcome memories to be encoded, so they can subsequently influence reward choices. Direct input from the lOFC was found to support the BLA in this function. Based on prior work, activity in BLA projections back to the lOFC was known to support the use of stimulus-outcome memories to influence decision making. By multiplexing optogenetic and chemogenetic inhibition we performed a serial circuit disconnection and found that the lOFC[->]BLA and BLA[->]lOFC pathways form a functional circuit regulating the encoding (lOFC[->]BLA) and subsequent use (BLA[->]lOFC) of the stimulus-dependent, sensory-specific reward memories that are critical for adaptive, appetitive decision making.

neuroscience↗

Nucleus accumbens cholinergic interneurons oppose cue-motivated behavior

BackgroundEnvironmental reward-predictive stimuli provide a major source of motivation for adaptive reward pursuit behavior. This cue-motivated behavior is known to be mediated by the nucleus accumbens core (NAc). The cholinergic interneurons in the NAc are tonically active and densely arborized and, thus, well-suited to modulate NAc function. But their causal contribution to adaptive behavior remains unknown. Here we investigated the function of NAc cholinergic interneurons in cue-motivated behavior.\n\nMethodsTo do this, we used chemogenetics, optogenetics, pharmacology, and a translationally analogous Pavlovian-to-instrumental transfer behavioral task designed to assess the motivating influence of a reward-predictive cue over reward-seeking actions in male and female rats.\n\nResultsThe data show that NAc cholinergic interneuron activity is necessary and sufficient to oppose the motivating influence of appetitive cues. Chemogenetic inhibition of NAc cholinergic interneurons augmented cue-motivated behavior. Optical stimulation of acetylcholine release from NAc cholinergic interneurons prevented cues from invigorating reward-seeking behavior, an effect that was mediated by activation of {beta}2-containing nicotinic acetylcholine receptors.\n\nConclusionsThus, NAc cholinergic interneurons provide a critical regulatory influence over adaptive cue-motivated behavior and, therefore, are a potential therapeutic target for the maladaptive cue-motivated behavior that marks many psychiatric conditions, including addiction and depression.

neuroscience↗

Chemogenetic inhibition of ventral tegmental area dopamine neurons or their inputs to the nucleus accumbens disrupts cue-triggered reward seeking but not reward taking

Reward-paired cues stimulate reward-seeking behavior through a combination of motivational and cognitive processes. We used pathway-specific chemogenetic inhibition of dopamine neurons to determine their role in the cue-elicited reward seeking, and applied a novel analytic approach to assay cue-induced changes in reward expectancy. Inhibiting ventral tegmental area dopamine neurons abolished cue-induced reward seeking but not reward retrieval, indicating that this pathway modulates response vigor but not reward expectancy. Locally inhibiting dopamine inputs to nucleus accumbens also disrupted cue-elicited reward seeking but not retrieval. Interestingly, the suppression produced by this treatment was greater in rats that responded to cues with exploratory reward seeking, without attempting to retrieve reward, than in rats exhibiting complete bouts of seeking with retrieval, indicating that individuals differ in their reliance on a dopamine-mediated motivational process. These findings shed new light on the behavioral and neural mechanisms of adaptive and compulsive forms of cue-motivated behavior.

neuroscience↗

Distinct cortical-amygdala projections drive reward value encoding and retrieval

The value of an anticipated rewarding event is crucial information in the decision to engage in its pursuit. The networks responsible for encoding and retrieving this value are largely unknown. Using glutamate biosensors and pharmacological manipulations, we found that basolateral amygdala (BLA) glutamatergic activity tracks and mediates both the encoding and retrieval of the state-dependent incentive value of a palatable food. Projection-specific and bidirectional chemogenetic and optogenetic manipulations revealed the orbitofrontal cortex (OFC) supports the BLA in these processes. Critically, the function of ventrolateral (lOFC) and medial (mOFC) OFC[->]BLA projections was found to be doubly dissociable. Whereas activity in lOFC[->]BLA projections is necessary for and sufficient to drive encoding of a positive change in the value of a reward, mOFC[->]BLA projections are necessary and sufficient for retrieving this value from memory to guide its pursuit. These data reveal a new circuit for adaptive reward valuation and pursuit, indicate dissociability in the encoding and retrieval of reward memories, and provide insight into the dysfunction in these processes that characterizes myriad psychiatric diseases.

neuroscience↗