Biernacki, K. | bioRxiv Science

bioRxiv2022

Causal effects of prefrontal transcranial magnetic stimulation on dopamine-mediated reinforcement learning in healthy adults

Background10-Hz repetitive transcranial magnetic stimulation (rTMS) to the left dorsal lateral prefrontal cortex (DLPFC) has been shown to increase dopaminergic activity in the dorsal striatum, a region strongly implicated in reinforcement learning. However, the behavioural influence of this effect remains largely unknown. ObjectiveHere, we tested the causal effects of rTMS on behavioral and computational characteristics of reinforcement learning. Methods40 healthy individuals were randomized into Active and Sham rTMS groups. Each participant underwent one 10-Hz rTMS session (1500 pulses) in which stimulation was applied over the left DLPFC using a robotic arm. Participants then completed a reinforcement learning task sensitive to striatal dopamine functioning. Participants trial-to-trial training choices were modelled using a reinforcement learning model (Q-learning) that calculates separate learning rates associated with positive and negative reward prediction errors. ResultsSubjects receiving Active TMS exhibited an increased reward rate (number of correct responses per second of task activity) compared to the Sham rTMS group. Computationally, the Active rTMS group displayed a higher learning rate for correct trials (G) compared to incorrect trials (L). Finally, when tested with novel pairs of stimuli, the Active group displayed extremely fast reaction times, and a trend towards a higher reward rate. ConclusionsThe present study provided specific behavioral and computational accounts of altered striatal-mediated reinforcement learning induced by a proposed increase of dopamine activity by 10-Hz rTMS to the left DLPFC. Together, these findings bolster the use of TMS to target neurocognitive disturbances attributed to the dysregulation of dopaminergic-striatal circuits.

neuroscience↗

bioRxiv2022

Suboptimal foraging decisions and involvement of the ventral tegmental area in human opioid addiction

Addiction is marked by a tendency to exploit sources of reward despite diminishing returns. This behavior is aptly captured by animal patch-foraging models that have recently been extended to humans. Dopamine and norepinephrine centrally mediate addictive behavior and activity in both catecholaminergic systems is proposed to reflect the computations necessary for optimal foraging. However, the specific neural bases of excessive foraging and their role in human addiction are largely unknown. To address this gap, we studied the behavior of people with and without opioid use disorder (OUD) on a patch-foraging task in which they made serial decisions to "harvest" a depleting resource ("patch") for reward or incur a varying cost to "travel" to a replenished patch. In a subset of participants, we used high-resolution neuromelanin-sensitive MRI to image neuromelanin concentration, a proxy for long-term catecholaminergic function, in distinct dopaminergic nuclei (ventral tegmental area, substantia nigra subregions) and the noradrenergic locus coeruleus. While all participants were sensitive to the long-run reward rates of different patch-foraging environments, OUD participants stayed in reward patches longer than optimal--markedly overharvesting a source of reward despite its declining value--and this correlated with more chronic drug use. Overharvesting was selectively associated with lower neuromelanin signal in the ventral tegmental area but not other dopaminergic nuclei, nor the locus coeruleus. Our findings suggest that foraging decisions relevant to addiction involve a ventral-tegmental-area circuit that may signal reward rates in dynamic environments and implicate this circuit in maladaptive reward pursuit in human addiction to opioids. Significance statementPatch-foraging provides a potentially important translational framework for understanding addictive behavior by revealing how maladaptive reward pursuit emerges in more ecologically valid decision contexts. Here, we show that the tendency to exploit sources of reward despite diminishing returns is associated with chronic drug use in people with opioid use disorder, a particularly devastating form of addiction. We further use neuromelanin-sensitive MRI, a neuroimaging measure of the long-term function of dopamine neurons, to reveal that variation in ventral tegmental area neuromelanin signal selectively underlies individual differences in this overharvesting bias. These findings establish a role for specific dopaminergic circuits in patch-foraging decisions and advance understanding of the neurobiology of human addiction to opioids that has so far eluded the field.

neuroscience↗