Role of dopamine in reward expectation and predictability during execution of action sequences

Abstract

BackgroundMesolimbic dopamine (DA) neurons are central to cue guided reward seeking and action sequence learning. Yet, the mechanisms by which cue-induced DA neural activity drives goal-directed or habitual sequence execution remain unknown. MethodsWe designed two novel tasks to isolate the effect of sequence-delineating cues on DA-driven behavioral strategies and learning. In the lever insertion fixed-ratio 5 task (LI5), the lever insertion marked sequence initiation. In the lever retraction fixed-ratio 5 task (LR5), the lever retraction served as both sequence termination and reward-predictive cue. ResultsWe found that sequence initiation and termination cues differentially affect reward expectation during action sequences, with only the termination cue contributing to greater outcome devaluation insensitivity, automaticity and behavioral chunking. Mesolimbic fiber photometry recording revealed that this habit-like behavior was associated with a rapid backpropagation in DA signals from the reward to the immediately preceding cue and with attenuated DA reward prediction error signals, which reflected greater behavioral inflexibility. Finally, in absence of external cues, brief optogenetic stimulation of VTA DA neurons at sequence termination was sufficient to drive automaticity and, to some extent, behavioral chunking. ConclusionOur results highlight the critical role of cue-evoked DA signals at sequence termination in mediating credit assignment and driving the development of habitual action sequence execution.