Biology subjects

Adcock, R. A.

Publications and source records attributed to Adcock, R. A..

7 recordsLinked to original sources

bioRxiv2022

Between heuristics and optimality: Flexible integration of cost and evidence during information sampling

Effective decision making in an uncertain world requires balancing the benefits of acquiring relevant information with the costs of delaying choice. Optimal strategies for information sampling can be accurate but computationally expensive, whereas heuristic strategies are often computationally simple but rigid. To characterize the computations that underlie information sampling, we examined choice processes in human participants who sampled sequences of images (e.g. indoor and outdoor scenes) and attempted to infer the majority category (e.g. indoor or outdoor) under two reward conditions. We examined how behavior maps onto potential information sampling strategies. We found that choices were best described by a flexible function that lay between optimality and heuristics; integrating the magnitude of evidence favoring each category and the number of samples collected thus far. Integration of these criteria resulted in a trade-off between evidence and samples collected, in which the strength of evidence needed to stop sampling decreased linearly as the number of samples accumulated over the course of a trial. This non-optimal trade-off best accounted for choice behavior even under high reward contexts. Our results demonstrate that unlike the optimal strategy, humans are performing simple accumulations instead of computing expected values, and that unlike a simple heuristic strategy, humans are dynamically integrating multiple sources of information in lieu of using only one source. This evidence-by-costs tradeoff illustrates a computationally efficient strategy that balances competing motivations for accuracy and cost minimization.

animal behavior and cognition↗

bioRxiv2021

Tuned to Learn: An anticipatory hippocampal convergence state conducive to memory formation revealed during midbrain activation

The hippocampus has been a focus of memory research since H.Ms surgery in 1953 abolished his ability to form new memories, yet its mechanistic role in memory is still debated. Here, we identify a novel, systems-level candidate memory mechanism: an anticipatory hippocampal "convergence state", observed while awaiting valuable information, that both predicts later memory, and accounts for the relationship between midbrain activation and enhanced learning. To reveal this state, we leveraged endogenous neuromodulation associated with motivation: During fMRI, participants viewed trivia questions eliciting high or low curiosity, each followed seconds later by its answer. We reasoned that memory encoding success requires a convergence of factors, and as such, hippocampal states associated with remembered trials would be less variable than forgotten ones. Using a novel multivariate approach, we measured convergence by quantifying the typicality of spatially distributed patterns. We found that during anticipation of trivia answers, hippocampal states showed greater convergence under high than low curiosity. Crucially, convergence in the hippocampus increased with greater midbrain activation and uniquely accounted for the association between midbrain activation and subsequent memory recall. We propose that this novel convergence state in the hippocampus reflects a mechanism of its contribution to long term memory formation and that engagement of this convergence state completes the cascade from motivation to midbrain activity to memory enhancement.

neuroscience↗

bioRxiv2020

Determinants of Real-Time fMRI Neurofeedback Performance and Improvement: a Machine Learning Mega-Analysis

Real-time fMRI neurofeedback is an increasingly popular neuroimaging technique that allows an individual to gain control over his/her own brain signals, which can lead to improvements in behavior in healthy participants as well as to improvements of clinical symptoms in patient populations. However, a considerably large ratio of participants undergoing neurofeedback training do not learn to control their own brain signals and, consequently, do not benefit from neurofeedback interventions, which limits clinical efficacy of neurofeedback interventions. As neurofeedback success varies between studies and participants, it is important to identify factors that might influence neurofeedback success. Here, for the first time, we employed a big data machine learning approach to investigate the influence of 20 different design-specific (e.g. activity vs. connectivity feedback), region of interest-specific (e.g. cortical vs. subcortical) and subject-specific factors (e.g. age) on neurofeedback performance and improvement in 608 participants from 28 independent experiments. With a classification accuracy of 60% (considerably different from chance level), we identified two factors that significantly influenced neurofeedback performance: Both the inclusion of a pre-training no-feedback run before neurofeedback training and neurofeedback training of patients as compared to healthy participants were associated with better neurofeedback performance. The positive effect of pre-training no-feedback runs on neurofeedback performance might be due to the familiarization of participants with the neurofeedback setup and the mental imagery task before neurofeedback training runs. Better performance of patients as compared to healthy participants might be driven by higher motivation of patients, higher ranges for the regulation of dysfunctional brain signals, or a more extensive piloting of clinical experimental paradigms. Due to the large heterogeneity of our dataset, these findings likely generalize across neurofeedback studies, thus providing guidance for designing more efficient neurofeedback studies specifically for improving clinical neurofeedback-based interventions. To facilitate the development of data-driven recommendations for specific design details and subpopulations the field would benefit from stronger engagement in Open Science and data sharing.

neuroscience↗

bioRxiv2020

Prediction errors during naturalistic events modulate hippocampal representations and drive episodic memory updating

The brain supports adaptive behavior by generating predictions, learning from errors, and updating memories to incorporate new information. Prediction error, or surprise, triggers learning when reality contradicts expectations. Prior studies have shown that the hippocampus signals prediction errors, but the hypothesized link to memory updating has not been demonstrated. In a human fMRI study, we elicited mnemonic prediction errors by interrupting familiar narrative videos immediately before the expected endings. We found that prediction error reversed the relationship between univariate hippocampal activation and memory: greater hippocampal activation predicted memory preservation after expected endings, but memory updating after surprising endings. In contrast to previous studies, we showed that univariate activation was insufficient for understanding hippocampal prediction error signals. We explained this surprising finding by tracking both the evolution of hippocampal activation patterns and connectivity between the hippocampus and neuromodulatory regions. We found that hippocampal activation patterns stabilized as each narrative episode unfolded, suggesting sustained episodic representations. Prediction errors disrupted these sustained representations, and the degree of disruption predicted memory updating. The relationship between hippocampal activation and subsequent memory depended on concurrent basal forebrain activation, supporting the idea that cholinergic modulation regulates attention and memory. We conclude that prediction errors create conditions that favor memory updating, prompting the hippocampus to abandon ongoing predictions and make memories malleable. SignificanceOur brains draw on memories to predict the future; when our predictions are incorrect, we must update our memories to improve future predictions. Past studies have demonstrated that the hippocampus signals prediction error, or surprise, but have not linked this neural signal to memory updating. Here, we uncover this missing connection: We show that mnemonic prediction errors change the role of the hippocampus, reversing the relationship between hippocampal activation and memory outcomes. We examine the mechanisms of this shift in neural processing, showing that prediction errors disrupt the temporal continuity of hippocampal patterns. We propose that prediction errors disrupt sustained representations and enable memory updating. Our findings bear implications for improving education, understanding eyewitness memory distortion, and treating pathological memories.

neuroscience↗

bioRxiv2019

Brain-wide electrical spatiotemporal dynamics encode reward anticipation

Anticipation of an upcoming stimulus induces neural activity across cortical and subcortical regions and influences subsequent behavior. Nevertheless, the network mechanism whereby the brain integrates this information to signal the anticipation of rewards remains relatively unexplored. Here we employ multi-circuit electrical recordings from six brain regions as mice perform a sample-to-match task in which reward anticipation is operationalized as their progress towards obtaining a potential reward. We then use machine learning to discover the naturally occurring network patterns that integrate this neural activity across timescales. Only one of the networks that we uncovered signals responses linked to reward anticipation, specifically relative proximity and reward magnitude. Activity in this Electome (electrical functional connectivity) network is dominated by theta oscillations leading from prelimbic cortex and striatum that converge on ventral tegmental area, and by beta oscillations leading from striatum that converge on prelimbic cortex. Network activity is also synchronized with brain-wide cellular firing. Critically, this network generalizes to new groups of healthy mice, as well as a mouse line that models aberrant neural circuitry observed in brain disorders that show altered reward anticipation. Thus, our findings reveal the network-level architecture whereby the brain integrates spatially distributed activity across timescales to signal reward anticipation.

neuroscience↗

bioRxiv2018

Expected reward value and reward uncertainty have temporally dissociable effects on memoryformation

Anticipating rewards has been shown to enhance memory formation. While substantial evidence implicates dopamine in this behavioral effect, the precise mechanisms remain ambiguous. Because dopamine nuclei show two distinct physiological signatures of reward prediction, we hypothesized two dissociable effects on memory formation. These two signatures are a phasic dopamine response immediately following a reward cue that encodes its expected value, and a sustained, ramping dopamine response that is greater during high reward uncertainty (Fiorillo, Tobler, & Schultz, 2003). Here, we show in humans that the impact of reward anticipation on memory for an event depends on its timing relative to these physiological signatures. By manipulating reward probability (100%, 50%, or 0%) and the timing of the event to be encoded (just after the reward cue versus just before expected reward outcome), we demonstrated the predicted double dissociation: early during reward anticipation, memory formation was improved by increased expected reward value, whereas late during reward anticipation, memory formation was enhanced by reward uncertainty. Moreover, while the memory benefits of high expected reward in the early interval were consolidation-dependent, the memory benefits of high uncertainty in the later interval were not. These findings support the view that expected reward benefits memory consolidation via phasic dopamine release. The novel finding of a dissociable memory enhancement, temporally consistent with sustained anticipatory dopamine release, points toward new mechanisms of memory modulation by reward now ripe for further investigation.

neuroscience↗

bioRxiv2018

Single Session Real-time fMRI Neurofeedback has a Lasting Impact on Cognitive Behavioral Therapy Strategies

To benefit from cognitive behavioral therapy (CBT), individuals must not only learn new skills but also strategically implement them outside the session. Here, we tested a novel technique for personalizing CBT skills and facilitating their generalization to daily life. We hypothesized that showing participants the impact of specific CBT strategies on their own brain function using real-time functional magnetic imaging (rt-fMRI) neurofeedback would increase their metacognitive awareness, help them identify effective strategies, and motivate real-world use. In a within-subjects design, participants who had completed a clinical trial of a standardized course of CBT created a personal repertoire of negative autobiographical stimuli and mood regulation strategies. From each participants repertoire, a set of experimental and control strategies were identified; only experimental strategies were practiced in the scanner. During the rt-fMRI neurofeedback session, participants used negative stimuli and strategies from their repertoire to manipulate activation in the anterior cingulate cortex, a region implicated in emotional distress. The primary outcome measures were changes in participant ratings of strategy difficulty, efficacy, and frequency of use. As predicted, ratings for unscanned control strategies were stable across observations, whereas ratings for experimental strategies changed after neurofeedback. At follow-up one month after the session, efficacy and frequency ratings for scanned strategies were predicted by neurofeedback during the rt-fMRI session. These results suggest that rt-fMRI neurofeedback created a salient and durable learning experience for patients, extending beyond the clinic to guide and motivate CBT skill use weeks later. This metacognitive approach to neurofeedback offers a promising model for increasing clinical benefits from cognitive-behavioral therapy by personalizing skills and facilitating generalization.

neuroscience↗