bioRxiv Science⌕ Search

Biology subjects

Hamilos, A. E.

Publications and source records attributed to Hamilos, A. E..

5 recordsLinked to original sources

A mechanism linking dopamine's roles in reinforcement, movement and motivation

Dopamine neurons (DANs) play seemingly distinct roles in reinforcement,1-3 motivation,4,5 and movement,6,7 and DA-modulating therapies relieve symptoms across a puzzling spectrum of neurologic and psychiatric symptoms.8 Yet, the relationship among these roles is unknown. Here, we show DAs tripartite functions are causally linked by a process in which phasic striatal DA rapidly and persistently recalibrates the propensity to move, a measure of vigor. Using a self-timed movement task, we found that single exposures to reward-related DA transients (both endogenous and exogenously-induced) exerted one-shot updates to movement timing--but in a surprising fashion. Rather than reinforce specific movement times, DA transients quantitatively changed movement timing on the next trial, with larger transients leading to earlier movements (and smaller to later), consistent with a stochastic search process that calibrates the frequency of movement. Both abrupt and gradual changes in external and internal contingencies--such as timing criterion, reward content, and satiety state--caused changes to the amplitude of DA transients that causally altered movement timing. The rapidity and bidirectionality of the one-shot effects are difficult to reconcile with gradual synaptic plasticity, and instead point to more flexible cellular mechanisms, such as DA-dependent modulation of neuronal excitability. Our findings shed light on how natural reinforcement, as well as DA-related disorders such as Parkinsons disease, could affect behavioral vigor.

neuroscience↗

Dopamine mediates the bidirectional update of interval timing

The role of dopamine as a reward prediction error signal in reinforcement learning tasks has been well-established over the past decades. Recent work has shown that the reward prediction error interpretation can also account for the effects of dopamine on interval timing by controlling the speed of subjective time. According to this theory, the timing of the dopamine signal relative to reward delivery dictates whether subjective time speeds up or slows down: Early DA signals speed up subjective time and late signals slow it down. To test this bidirectional prediction, we reanalyzed measurements of dopaminergic neurons in the substantia nigra pars compacta of mice performing a self-timed movement task. Using the slope of ramping dopamine activity as a read-out of subjective time speed, we found that trial-by-trial changes in the slope could be predicted from the timing of dopamine activity on the previous trial. This result provides a key piece of evidence supporting a unified computational theory of reinforcement learning and interval timing.

neuroscience↗

How ATP and dATP act as molecular switches to regulate enzymatic activity in the prototypic bacterial class Ia ribonucleotide reductase

Class Ia ribonucleotide reductases (RNRs) are subject to allosteric regulation to maintain the appropriate deoxyribonucleotide levels for accurate DNA biosynthesis and repair. RNR activity requires a precise alignment of its 2 and {beta}2 subunits such that a catalytically-essential radical species is transferred from {beta}2 to 2. In E. coli, when too many deoxyribonucleotides are produced, dATP binding to RNR generates an inactive 4{beta}4 state in which {beta}2 and 2 are separated, preventing radical transfer. ATP binding breaks the -{beta} interface, freeing {beta}2 and restoring activity. Here we investigate the molecular basis for allosteric activity regulation in the prototypic E. coli class Ia RNR. Through the determination of six crystal structures we are able to establish how dATP binding creates a binding pocket for {beta} on that traps {beta}2 in the inactive 4{beta}4 state. These structural snapshots also reveal the numerous ATP-induced conformational rearrangements that are responsible for freeing {beta}2. We further discover, and validate through binding and mutagenesis studies, a previously unknown nucleotide binding site on the subunit that is crucial for the ability of ATP to dismantle the inactive 4{beta}4 state. These findings have implications for the design of allosteric inhibitors for bacterial RNRs.

biochemistry↗

Application of a unifying reward-prediction error (RPE)-based framework to explain underlying dynamic dopaminergic activity in timing tasks

Dopaminergic neurons (DANs) exhibit complex dynamics across a variety of behavioral contexts, often in ways that seem task-specific and even incompatible with results across different paradigms. Dopaminergic signaling during timing tasks has been a prime example. In behavioral timing, dopaminergic dynamics predict the initiation of self-timed movement via a seconds-long ramp up of activity prior to movement onset, similar to ramping seen in visuospatial reward approach and multi-step, goal-directed behaviors. By contrast, in perceptual timing, DANs exhibit more complex dynamics whose direction of modulation seems to be the opposite of that observed in behavioral timing. Mikhael et al. (2022) recently proposed a formal model in which dopaminergic dynamics encode reward expectation in the form of an "ongoing" reward-prediction error (RPE) that arises from resolving uncertainty of ones position in the value landscape (i.e., ones spatial-temporal distance to reward delivery/omission). Here, we show that application of this framework recapitulates and reconciles the seemingly contradictory dopaminergic dynamics observed in behavioral vs perceptual timing. These results suggest a common neural mechanism that broadly underlies timing behavior: trial-by-trial variation in the rate of the internal "pacemaker," manifested in DAN signals that reflect stretching or compression of the derivative of the subjective value function relative to veridical time. In this view, faster pacemaking is associated with relatively high amplitude dopaminergic signaling, whereas slower pacemaking is associated with relatively low levels of dopaminergic signaling, consistent with findings from pharmacological and lesion studies.

animal behavior and cognition↗

Dynamic dopaminergic activity controls the timing of self-timed movement

Clues from human movement disorders have long suggested that the neurotransmitter dopamine plays a key role in motor control, but how the endogenous dopaminergic system regulates movement is unknown. Here we show dynamic dopaminergic signaling over seconds-long timescales controls movement timing in mice. Animals were trained to initiate licking after a self-timed interval following a start-timing cue. The movement time was variable from trial-to-trial, as expected from previous studies. Surprisingly, dopaminergic signals ramped-up over seconds between the start-timing cue and the self-timed movement, with variable dynamics that predicted the movement time on single trials. Steeply rising signals preceded early lick-initiation, whereas slowly rising signals preceded later initiation. Higher baseline signals also predicted earlier self-timed movements. Optogenetic activation of dopamine neurons during self-timing did not trigger immediate movements, but rather caused systematic early-shifting of movement initiation, whereas inhibition caused late-shifting, as if modulating the probability of movement. Consistent with this view, the dynamics of the endogenous dopaminergic signals quantitatively predicted the moment-by-moment probability of movement initiation on single trials. These results reveal a causal role for dynamic dopaminergic signaling unfolding over seconds in modulating the decision of when to move.

neuroscience↗