Biology subjects

Janak, P. H.

Publications and source records attributed to Janak, P. H..

26 records · Page 2Linked to original sources

bioRxiv2022

Basolateral amygdala and orbitofrontal cortex, but not dorsal hippocampus, are necessary for the control of reward-seeking by occasion setters

Reward-seeking in the world is driven by cues that can have ambiguous predictive and motivational value. To produce adaptive, flexible reward-seeking it is necessary to exploit occasion setters, other distinct features in the environment, to resolve the ambiguity of Pavlovian reward-paired cues. Despite this, very little research has investigated the neurobiological underpinnings of occasion setting and as a result little is known about which brain regions are critical for occasion setting. To address this, we exploited a recently developed task that was amenable to neurobiological inquiry where a conditioned stimulus is only predictive of reward delivery if preceded in time by the non-overlapping presentation of a separate cue - an occasion setter. This task required male rats to maintain and link cue-triggered expectations across time to produce adaptive reward-seeking. We interrogated the contributions of the basolateral amygdala and orbitofrontal cortex to occasion setting as these regions are thought to be critical for the computation and exploitation of state value, respectively. Reversible inactivation of either structure prior to the occasion-setting task resulted in a profound inability of rats to use the occasion setter to guide reward seeking. In contrast, inactivation of the dorsal hippocampus, a region fundamental for context-specific responding was without effect nor did inactivation of the basolateral amygdala or orbitofrontal cortex in a standard Pavlovian conditioning preparation affect conditioned responding. We conclude that neural activity within the orbitofrontal cortex and basolateral amygdala circuit is necessary to update and resolve ambiguity in the environment to promote cue-driven reward-seeking.

neuroscience↗

bioRxiv2021

Unveiling the neural correlates of habit in the dorsal striatum

We have recently reported sustained inhibition in the dorsomedial striatum (DMS) and sustained excitation in the dorsolateral striatum (DLS) during execution of a lever press sequence in a discrete-trials task promoting habit. This sustained dorsostriatal activity was present early on, and did not clearly change in step with improved performance over ten training sessions. Early onset of sequence-related neural activity could have resulted from rapid habitual learning promoted by presentation of lever cues, predicting reward availability and delivery. To test this hypothesis, we compared DLS and DMS spiking activity in the discrete trials habit-promoting task with two task variants that promote goal-directed behavior. Comparison of the three tasks revealed that mean neuronal spiking activity was generally sustained across the lever press sequence in the task promoting habit and characterized by overall excitation in DLS and inhibition in DMS relative to baseline. In contrast, mean activity differences in DLS and DMS were much less prominent, and most changes occurred transiently around individual lever presses, in the tasks promoting goal-directed behavior. These results indicate that sequence delineation cues, such as the lever cues in these studies, promote habitual behavior and that this habitual behavior is encoded in the striatum by cue-triggered sustained DLS excitation and DMS inhibition that likely reflects cue-elicited behavioral chunking.

neuroscience↗

bioRxiv2021

Dorsomedial striatal activity tracks completion of behavioral sequences

For proper execution of goal-directed behaviors, individuals require both a general representation of the goal and an ability to monitor their own progress toward that goal. Here, we examine how dorsomedial striatum (DMS), a region pivotal for forming associations among stimuli, actions, and outcomes, encodes the execution of goal-directed action sequences that require self-monitoring of behavior. We trained rats to complete a sequence of at least 5 consecutive lever presses (without visiting the reward port) to obtain a reward and recorded the activity of individual cells in DMS while rats performed the task. We found that the pattern of DMS activity gradually changed during the execution of the sequence, permitting accurate decoding of sequence progress from neural activity at a population level. Moreover, this sequence-related activity was blunted on trials where rats did not complete a sufficient number of presses. Overall, these data suggest a link between DMS activity and the execution of behavioral sequences that require monitoring of ongoing behavior.

neuroscience↗

bioRxiv2019

A history-derived reward prediction error signal in ventral pallidum

Learning from past interactions with the environment is critical for adaptive behavior. Within the framework of reinforcement learning, the nervous system builds expectations about future reward by computing reward prediction errors (RPEs), the difference between actual and predicted rewards. Correlates of RPEs have been observed in the midbrain dopamine system, which is thought to locally compute this important variable in service of learning. However, the extent to which RPE signals may be computed upstream of the dopamine system is largely unknown. Here, we quantify history-based RPE signals in the ventral pallidum (VP), an input region to the midbrain dopamine system implicated in reward-seeking behavior. We trained rats to associate cues with future delivery of reward and fit computational models to predict individual neuron firing rates at the time of reward delivery. We found that a subset of VP neurons encoded RPEs and did so more robustly than nucleus accumbens, an input to VP. VP RPEs predicted trial-by-trial task engagement, and optogenetic inhibition of VP reduced subsequent task-related reward seeking. Consistent with reinforcement learning, activity of VP RPE cells adapted when rewards were delivered in blocks. We further found that history- and cue-based RPEs were largely separate across the VP neural population. The presence of behaviorally-instructive RPE signals in the VP suggests a pivotal role for this region in value-based computations.

neuroscience↗

bioRxiv2019

Recruitment and disruption of value encoding during alcohol seeking

A critical area of inquiry in the neurobiology of alcohol abuse is the neural mechanisms by which cues gain the ability to elicit alcohol use. We previously showed that cue-evoked activity in rat ventral pallidum (VP) robustly encodes the value of cues trained under both Pavlovian and instrumental contingencies, despite a stronger relationship between cue-evoked responses and behavioral latency after instrumental training. Here, we assessed VP neural representations of cue value in rats trained with a Pavlovian conditioned stimulus (CS+) that predicted alcohol delivery, and in rats trained with an instrumental discriminative stimulus (DS) that predicted alcohol availability if the rat entered the reward port during the cue. We also examined the impact of alcohol exposure itself on the integrity of this type of signaling in rats trained with sucrose. Decoding of cue value based on VP firing was blunted for an alcohol CS+ versus an alcohol DS, as well as in comparison to a sucrose DS or CS+. Further, homecage alcohol exposure had opposing effects on VP encoding of cue value for a sucrose DS versus a sucrose CS+, enhancing decoding accuracy for the DS and reducing decoding accuracy for the CS+. These findings suggest that problem alcohol seeking may result from biased engagement of specific reward-related processes via changes in VP signaling.

neuroscience↗

bioRxiv2018

Setting the occasion for incentive motivation: implications for addiction

The context in which reward-paired cues are encountered sets the occasion for appropriate reward-seeking but may also spur inappropriate behaviors such as the renewal of drug-seeking. The psychological processes underlying occasion setting remain unclear as contexts are diffuse and difficult to isolate from other stimuli. To overcome this, we modeled a context as a phasic and discrete event - an occasion setter - which allowed for control over its presentation and influence on cue-driven reward-seeking. This allowed us to directly assess how occasion setters, like contexts, regulate the predictive and motivational significance of Pavlovian cues. Male rats (n=50) were trained in a Pavlovian paradigm where the presentation of an ambiguous conditioned stimulus was reinforced only if preceded by an occasion setting cue. We assessed the motivational value of the occasion setter and conditioned stimulus alone or in combination using conditioned reinforcement. Rats showed enhanced conditioned approach to the reward port during the reward-adjacent conditioned stimulus when it was preceded by the occasion setter. When allowed the opportunity, rats responded more to obtain presentations of the conditioned stimulus in combination with the occasion setter than the conditioned stimulus alone. Critically, rats also worked to obtain presentations of the occasion setter alone more than the conditioned stimulus, and this was resistant to manipulations of the value of the occasion setter. We conclude that occasion setting can act via incentive motivational mechanisms and that, apart from resolving predictive information about ambiguous reward-paired cues, occasion setters themselves generate states of appetitive motivation that can facilitate reward-seeking.

neuroscience↗

bioRxiv2017

Phasic Activation of Ventral Tegmental, but not Substantia Nigra, Dopamine Neurons Promotes Model-Based Pavlovian Reward Learning

Dopamine (DA) neurons in the ventral tegmental area (VTA) and substantia nigra (SNc) encode reward prediction errors (RPEs) and are proposed to mediate error-driven learning. However the learning strategy engaged by DA-RPEs remains controversial. Model-free associations imbue cue/actions with pure value, independently of representations of their associated outcome. In contrast, model-based associations support detailed representation of anticipated outcomes. Here we show that although both VTA and SNc DA neuron activation reinforces instrumental responding, only VTA DA neuron activation during consumption of expected sucrose reward restores error-driven learning and promotes formation of a new cue[->]sucrose association. Critically, expression of VTA DA-dependent Pavlovian associations is abolished following sucrose devaluation, a signature of model-based learning. These findings reveal that activation of VTA-or SNc-DA neurons engages largely dissociable learning processes with VTA-DA neurons capable of participating in model-based predictive learning, while the role of SNc-DA neurons appears limited to reinforcement of instrumental responses.

neuroscience↗

bioRxiv2017

Long-Lasting Contribution Of Dopamine In The Nucleus Accumbens Core, But Not Dorsal Lateral Striatum, To Sign-Tracking

The attribution of incentive salience to reward-paired cues is dependent on dopamine release in the nucleus accumbens core. These dopamine signals conform to traditional reward-prediction error signals and have been shown to diminish with time. Here we examined if the diminishing dopamine signal in the nucleus accumbens core has functional implications for the expression of sign-tracking, a Pavlovian conditioned response indicative of the attribution of incentive salience to reward-paired cues. Food-restricted male Sprague-Dawley rats were trained in a Pavlovian paradigm in which an insertable lever predicted delivery of food reward in a nearby food cup. After 7 or 14 training sessions, rats received infusions of saline, the dopamine antagonist flupenthixol (100 mM), or the GABA agonists baclofen and muscimol (0.5 mM baclofen/0.05 mM muscimol) into the nucleus accumbens core or the dorsal lateral striatum. Dopamine antagonism within the nucleus accumbens core attenuated sign-tracking, whereas reversible inactivation did not affect sign-tracking but increased non-specific food cup checking behaviors. Neither drug in the dorsal lateral striatum affected sign-tracking behavior. Critically, extended training did not alter these effects. Though extended experience with an incentive stimulus may reduce cue-evoked dopamine in the nucleus accumbens core, this does not alter the function of dopamine in this region to promote Pavlovian cue approach nor result in the recruitment of dorsal lateral striatal systems for this behavior. These data support the notion that dopamine within the mesoaccumbal system, but not the nigrostriatal system, contributes critically to incentive motivational processes independent of the length of training.\n\nAbbreviations

neuroscience↗