Biology subjects

Chakroun, K.

Publications and source records attributed to Chakroun, K..

4 recordsLinked to original sources

bioRxiv2022

Dopamine regulates decision thresholds in human reinforcement learning.

Dopamine fundamentally contributes to reinforcement learning by encoding prediction errors, deviations of an outcome from expectation. Prediction error coding in dopaminergic regions in human functional neuroimaging studies is well replicated. In contrast, replications of behavioral and neural effects of pharmacological modulations of the dopamine system in human reinforcement learning are scarce. Additionally, dopamine contributes to action selection, but direct evidence and process-specific accounts in human reinforcement learning are lacking. Here we examined dopaminergic mechanisms underlying human reinforcement learning in a within-subjects pharmacological approach in male human volunteers (n=31, within-subjects design; Placebo, 150mg L-dopa, 2mg Haloperidol) in combination with functional magnetic resonance imaging and a stationary reinforcement learning task. We had two aims. First, we aimed to replicate previously reported beneficial effects of L-dopa vs. Haloperidol on reinforcement learning from gains. This replication was not successful. We observed no performance benefit of L-Dopa vs. Haloperidol, and no evidence for alterations in neural prediction error signaling. In contrast, Bayesian analyses provided moderate evidence in favor of the null hypothesis. This unsuccessful replication is likely at least partly due to a number of differences in experimental design. Second, using combined reinforcement learning drift diffusion models, we tested the recent proposal that dopamine contributes to action selection by regulating decision thresholds. Model comparison revealed that the data were best accounted for by a reinforcement learning drift diffusion model with separate learning rates for positive and negative prediction errors. The model accounted for both reductions in RTs and increases in accuracy over the course of learning. The only parameter showing robust drug effects was the boundary separation parameter, which revealed reduced decision thresholds under both L-Dopa and Haloperidol, compared to Placebo, and the degree of threshold reduction accounted for individual differences in RTs between conditions. Results are in line with the idea that striatal dopamine regulates decision thresholds during action selection, and that lower dosages of D2 receptor antagonists increase striatal DA release via an inhibition of autoreceptor-mediated feedback mechanisms.

neuroscience↗

bioRxiv2019

Attenuated directed exploration during reinforcement learning in gambling disorder

Gambling disorder is a behavioral addiction associated with impairments in value-based decision-making and behavioral flexibility and might be linked to changes in the dopamine system. Maximizing long-term rewards requires a flexible trade-off between the exploitation of known options and the exploration of novel options for information gain. This exploration-exploitation trade-off is thought to depend on dopamine neurotransmission. We hypothesized that human gamblers would show a reduction in directed (uncertainty-based) exploration, accompanied by changes in brain activity in a fronto-parietal exploration-related network. Twenty-three frequent, non-treatment seeking gamblers and twenty-three healthy matched controls (all male) performed a four-armed bandit task during functional magnetic resonance-imaging. Computational modeling using hierarchical Bayesian parameter estimation revealed signatures of directed exploration, random exploration, and perseveration in both groups. Gamblers showed a reduction in directed exploration, whereas random exploration and perseveration were similar between groups. Neuroimaging revealed no evidence for group differences in neural representations of basic task variables (expected value, prediction errors). Our hypothesis of reduced frontal pole recruitment in gamblers was not supported. Exploratory analyses revealed that during directed exploration, gamblers showed reduced parietal cortex and substantia-nigra / ventral-tegmental-area activity. Cross-validated classification analyses revealed that connectivity in an exploration-related network was predictive of group status, suggesting that connectivity patterns might be more predictive of problem gambling than univariate effects. Findings reveal specific reductions in strategic exploration gamblers that might be linked to altered processing in a fronto-parietal network and/or changes in dopamine neurotransmission implicated in gambling disorder. Significance statementWiehler et al. report that gamblers rely less on the strategic exploration of unknown, but potentially better rewards during reward learning. This is reflected in a related network of brain activity. Parameters of this network can be used to predict the presence of problem gambling behavior in participants.

neuroscience↗

bioRxiv2019

Dopaminergic modulation of the exploration/exploitation trade-off in human decision-making

A central issue in reinforcement learning and decision-making is whether to exploit knowledge of reward values, or to explore novel options. Although it is widely hypothesized that dopamine neurotransmission plays a key role in regulating this balance, causal evidence for a role of dopamine in human exploration is still lacking. Here, we use a combination of computational modeling, pharmacological intervention and functional magnetic resonance imaging (fMRI) to test for a causal effect of dopamine transmission on the exploration-exploitation trade-off in humans. 31 healthy male subjects performed a restless four-armed bandit task in a within-subjects design under three drug conditions: 150mg of the dopamine precursor L-dopa, 2mg of the D2 receptor antagonist haloperidol, and placebo. In all conditions, choice behavior was best explained by an extension of an established Bayesian learning model accounting for perseveration, uncertainty-based exploration and random exploration. Uncertainty-based exploration was attenuated under L-dopa compared to placebo and haloperidol. There was no evidence for a modulation of prediction error signaling or categorical effects of exploration/exploitation under L-dopa, whereas model-based fMRI revealed that L-dopa attenuated neural representations of overall uncertainty in insula and dorsal anterior cingulate cortex. Our results highlight the computational role of these regions in exploration and suggest that dopamine modulates exploration by modulating how this circuit tracks accumulating uncertainty during decision-making.

neuroscience↗

bioRxiv2017

A potential link between gambling addiction severity and central dopamine levels -- evidence from spontaneous eye blink rates in gamblers and controls

Accumulating evidence points at similarities between substance use disorders and pathological gambling on the behavioral and neural level. In substance addiction, dysregulation of striatal dopamine transmission has been consistently revealed. Due to the neurotoxicity of stimulating substances, it is still debated if this constitutes mainly a consequence of recurrent substance abuse or a vulnerability marker for addiction disorders. For gambling addiction, no clear association with striatal dopamine levels has been unveiled so far. With its presumably negligible dopaminergic toxicity, possible differences in striatal dopamine transmission in gambling addiction might therefore constitute a vulnerability marker. Spontaneous eye blink rate (sEBR) is controversially discussed as a potential proxy measure for striatal dopamine levels. Here we examined sEBR in 21 male problem gamblers and 20 healthy control participants. In addition, participants completed a screening questionnaire for overall psychopathology and self-reported measures of alcohol and nicotine consumption. We found no significant difference in sEBR between gamblers and controls. However, in gamblers, sEBR was negatively associated with addiction severity and positively associated with psychopathology. A final exploratory analysis revealed that healthy controls with low sEBR displayed higher alcohol and nicotine consumption than healthy participants with high sEBR. Although the association between dopamine transmission and sEBR is still debated, our findings reveal that sEBR is sensitive to inter-individual differences in addiction severity in problem gamblers.

neuroscience↗