Biology subjects

Ebitz, R. B.

Publications and source records attributed to Ebitz, R. B..

13 recordsLinked to original sources

bioRxiv2026

Shared Latent Decision Strategies Underlie Reward-Guided Behavior Across Species

Adaptive behavior requires that organisms learn which actions are rewarded and to update action selection when the environment changes. While human and non-human animals exhibit adaptive behavior, whether apparently similar behavior reflects common decision strategies remains unclear. Probabilistic reversal learning provides a cross-species assay of reward-guided choice, yet standard metrics such as accuracy or reward rate can obscure underlying strategies that generate choices. Here, we applied parallel probabilistic reversal learning tasks in mice and humans and used a generalized linear model-hidden Markov model to infer latent decision strategies from trial-by-trial behavior. Across species, choices were organized into stable behavioral states with differing reliance on choice history, reward history, and response bias. Among these latent states, we identify a conserved reward-learning strategy in mice and humans characterized by the greatest feedback sensitivity, reward efficiency, and adaptation after reversal. Simulating choice behavior using state-specific decision policies reproduced the empirical hierarchy of performance, confirming that the latent states capture meaningful behavioral strategies. Although mice and humans differ in the temporal dynamics of reward learning, both species ultimately converge on the same optimized strategy. These findings identify a conserved latent reward-learning strategy in mice and humans, defining a translational framework for studying how adaptive decision-making is shaped by task experience, stress, affective processes, and neural circuit function.

neuroscience↗

bioRxiv2025

16p11.2 duplication shows early male-biased impacts on reward learning, but NMDA receptor antagonism reduces optimal choice selection in both wildtypes and 16p11.2 duplication

Rationale16p11.2 duplication is associated with numerous neuropsychiatric conditions at a genome-wide level, including psychosis. Mice modeling 16p11.2 duplication may provide important insights into cognitive risk factors, in particular in reward-guided decision making. NMDAR function has also been implicated in psychosis phenotypes, but whether these phenotypes differ by genetic risk factor is unknown. ObjectivesWe aimed to: 1) identify sex and genotype differences in early operant training and two-arm spatial restless bandit task performance; 2) examine the effects of an NMDAR antagonist on task performance and strategy across genotypes. Methods16p11.2 duplication and wildtype mice completed a series of training schedules of escalating difficulty followed by bandit tasks. MK-801 and saline were administered in alternating sessions prior to later bandit task performance. ResultsLarge sex differences in early operant training revealed some male-biased impacts of 16p11.2 duplication, contingent on training schedule difficulty. Once on the two-arm spatial restless bandit task, 16p11.2 duplication was no longer a strong contributor to decision making. However, MK-801 decreased the tendency to stay with a rewarded choice, lowered the probability of selecting the highest rewarded option, and decreased the influence of prior outcomes on choice. ConclusionsThe male-biased vulnerability in early operant training suggests that strategies for learning early schemas or in novel environments may be impacted by 16p11.2 duplication in males. In contrast, NMDAR are influential in the ability to flexibly switch between choices, and disrupting this function significantly impairs decision making in all animals.

animal behavior and cognition↗

bioRxiv2025

Sex-biased computations underlying differential set shift performance in mice

Cognitive flexibility can be defined as the ability to adaptively shift between choices or strategies based on environmental feedback and it is disrupted in numerous neuropsychiatric conditions. Individual differences in the computations supporting cognitive flexibility are poised to reveal mechanisms of neuropsychiatric risk and resilience. One critical variable well known to influence individual differences in neuropsychiatric risk is sex. While previous research has identified sex differences in value based decision making in mice, whether sex reflects a major source of variation in cognitive flexibility remains unknown. To directly assess sex-biased individual differences in cognitive flexibility, we developed a novel touchscreen Set Shift task that permits robust and continuous testing in mice. Using this task, we discovered that female mice completed significantly more rule shifts with fewer errors than males. We next employed a suite of computational models that revealed sex-biased individual differences in the computations underlying cognitive flexibility. Overall, our results suggest that following rule shifts, female mice learn the new rule faster and commit to exploiting rule choices sooner compared to males - sometimes because they commit to multiple rules simultaneously. This suggests that increased choice stability in female rodents enhances commitment to a strategy during periods of uncertainty and directly contributes to increased rule shifting. This supports the counterintuitive conclusion that a high degree of stable choice is a strong requirement for enhanced cognitive flexibility in the Set Shift task, one of the gold standard cognitive flexibility tasks.

animal behavior and cognition↗

bioRxiv2024

Touchscreen response precision is sensitive to the explore/exploit tradeoff

The explore/exploit tradeoff is a fundamental property of choice selection during reward-guided decision making. In perceptual decision making, higher certainty decisions are more motorically precise, even when the decision does not require motor accuracy. However, while we can parametrically control uncertainty in perceptual tasks, we do not know what variables - if any - shape motor precision and reflect subjective certainty during reward-guided decision making. Touchscreens are increasingly used across species to measure choice, but provide no tactile feedback on whether an action is precise or not, and therefore provide a valuable opportunity to determine whether actions differ in precision due to explore/exploit state, reward, or individual variables. We find all three of these factors exert independent drives towards increased precision. During exploit states, successive touches to the same choice are closer together than those made in an explore state, consistent with exploit states reflecting higher certainty and/or motor stereotypy in responding. However, exploit decisions might be expected to be rewarded more frequently than explore decisions. We find that exploit choice precision is increased independently of a separate increase in precision due to immediate past reward, suggesting multiple mechanisms regulating choice precision. Finally, we see evidence that male mice in general are less precise in their interactions with the touchscreen than females, even when exploiting a choice. These results suggest that as exploit behavior emerges in reward-guided decision making, individuals become more motorically precise reflecting increased certainty, even when decision choice does not require additional motor accuracy, but this is influenced by individual differences and prior reward. These data uncover the hidden potential for touchscreen tasks in any species to uncover the latent neural states that unite cognition and movement.

animal behavior and cognition↗

bioRxiv2024

Persistent Decision-Making in Mice, Monkeys, and Humans

Humans have the capacity to persist in behavioural policies, even in challenging environments that lack immediate reward. Persistence is the scaffold on which many higher executive functions are built. However, it remains unclear whether humans are uniquely persistent or, instead, if this capacity is widely conserved across species. To address this question, we compared humans with mice and monkeys in harmonised versions of a dynamic decision-making task. The task encouraged all species to strike a balance between persistently exploiting one policy and exploring alternative policies that could become better at any moment. Although all three species had similar strategies, we found that both primate species--humans and monkeys--were able to persist in exploitation for longer than the mice. The similarities in persistence patterns in humans and monkeys, as opposed to mice, may be related to the various ecological, neurobiological, or cognitive factors that differ systematically between these species.

animal behavior and cognition↗

bioRxiv2023

Pupil size predicts the onset of exploration in brain and behavior.

In uncertain environments, intelligent decision-makers exploit actions that have been rewarding in the past, but also explore actions that could be even better. Several neuromodulatory systems are implicated in exploration, based, in part, on work linking exploration to pupil size-a peripheral correlate of neuromodulatory tone and index of arousal. However, pupil size could instead track variables that make exploration more likely, like volatility or reward, without directly predicting either exploration or its neural bases. Here, we simultaneously measured pupil size, exploration, and neural population activity in the prefrontal cortex while two rhesus macaques explored and exploited in a dynamic environment. We found that pupil size under constant luminance specifically predicted the onset of exploration, the first exploratory trial in a sequence, beyond what could be explained by reward history. Pupil size also predicted disorganized patterns of prefrontal neural activity at both the single neuron and population levels, even within periods of exploitation. Ultimately, our results support a model in which pupil-linked mechanisms promote the onset of exploration via driving the prefrontal cortex through a critical tipping point where prefrontal control dynamics become disorganized and exploratory decisions are possible. Significance StatementHumans and other animals learn about the world through exploration: through making decisions that offer the opportunity to learn and discover, even when these decisions are not the best option in the moment. Neuroscience research has historically focused on understanding good choices, delivering many key insights into the neural mechanisms involved in these calculations. However, much less is known about how the brain generates exploratory decisions. This study identifies certain "early warning signs" of exploratory decisions in the brain and body, including certain signals in size of the pupil and the speed of neural activity in the prefrontal cortex. These early warning signs suggest that exploration may be the result of a critical tipping point in prefrontal brain states.

neuroscience↗

bioRxiv2023

Dopamine and norepinephrine differentially mediate the exploration-exploitation tradeoff

The catecholamines dopamine (DA) and norepinephrine (NE) have been implicated in neuropsychiatric vulnerability, in part via their roles in mediating the decision making processes. Although the two neuromodulators share a synthesis pathway and are co-activated, they engage in distinct circuits and roles in modulating neural activity across the brain. However, in the computational neuroscience literature, they have been assigned similar roles in modulating the exploration-exploitation tradeoff. Revealing how each neuromodulator contributes to this explore-exploit process is important in guiding mechanistic hypotheses emerging from computational psychiatric approaches. To understand the differences and overlaps of the roles of dopamine and norepinephrine in mediating exploration, a direct comparison using the same dynamic decision making task is needed. Here, we ran mice in a restless bandit task, which encourages both exploration and exploitation. We systemically administered a nonselective DA antagonist (flupenthixol), a nonselective DA agonist (apomorphine), a NE beta-receptor antagonist (propranolol), and a NE beta-receptor agonist (isoproterenol), and examined changes in exploration within subjects across sessions. We found a bidirectional modulatory effect of dopamine receptor activity on exploration - increasing dopamine activity decreased exploration and decreasing dopamine activity increased exploration. The modulation of exploration via beta-noradrenergic activity was mediated by sex. Computational model parameters revealed that dopamine modulation affected exploration via decision noise and norepinephrine modulation via outcome sensitivity. Together, these findings suggested that the mechanisms that govern the transition between exploration and exploitation are sensitive to changes in both catecholamine functions and revealed differential roles for NE and DA in mediating exploration. Significance StatementBoth dopamine (DA) and norepinephrine (NE) has been implicated in the decision making process. Although these two catecholamines have shared aspects of their biosynthetic pathways and projection targets, they are thought to exert many core functions via distinct neural targets and receptor subtypes. However, the computational neuroscience literature often ascribes similar roles to these catecholamines, despite the above evidence. Resolving this discrepancy is important in guiding mechanistic hypotheses emerging from computational psychiatric approaches. This study examines the role of dopamine and norepinephrine on the explore-exploit tradeoff. By testing mice, we were able to compare multiple pharmacological agents within subjects, and examine source of individual differences, allowing direct comparison between the effects of these two catecholamines in modulating decision making.

animal behavior and cognition↗

bioRxiv2022

Irrational choices via a curvilinear representational geometry for value

We make decisions by comparing values, but how is value represented in the brain? Many models assume, if only implicitly, that the representational geometry of value is linear. However, in part due to a historical focus on noisy single neurons, rather than neuronal populations, this hypothesis has not been rigorously tested. Here, we examined the representational geometry of value in the ventromedial prefrontal cortex (vmPFC), a part of the brain linked to economic decision-making. We found that values were encoded along a curved manifold in vmPFC. This curvilinear geometry predicted a specific pattern of irrational decision-making: that decision-makers will make worse choices when an irrelevant, decoy option is worse in value, compared to when it is better. Indeed, we observed these irrational choices in behavior. Together, these results not only suggest that the representational geometry of value is nonlinear, but that this nonlinearity could impose bounds on rational decision-making.

neuroscience↗

bioRxiv2021

Hierarchical organization of rhesus macaque behavior

Primatologists, psychologists and neuroscientists have long hypothesized that primate behavior is highly structured. However, fully delineating that structure has been impossible due to the difficulties of precision behavioral tracking. Here we analyzed a dataset consisting of continuous measures of the 3D position of fifteen body landmarks from two male rhesus macaques (Macaca mulatta) performing three different tasks in a large unrestrained environment over many hours. Using an unsupervised embedding approach on the tracked joints, we identified commonly repeated pose patterns, which we call postures. We found that macaques behavior is characterized by 49 distinct identifiable postures, lasting an average of 0.6 seconds each. We found evidence that behavior is hierarchically organized, in that transitions between poses tend to occur within larger modules, which correspond to intuitively identifiably actions; these actions are in turn organized hierarchically. Our behavioral decomposition allows us to identify universal (cross-individual and cross-task) and unique (specific to each individual and task) principles of behavior. These results demonstrate the hierarchical nature of primate behavior and provide a method for the automated "ethogramming" of primate behavior.

animal behavior and cognition↗

bioRxiv2021

Tonic activity in lateral habenula neurons promotes disengagement from reward-seeking behavior

Survival requires both the ability to persistently pursue goals and the ability to determine when it is time to stop, an adaptive balance of perseverance and disengagement. Neural activity in the lateral habenula (LHb) has been linked to aversion and negative valence, but its role in regulating the balance between reward-seeking and disengaged behavioral states remains unclear. Here, we show that LHb neural activity is tonically elevated during minutes-long disengagements from reward-seeking behavior, whether due to repeated reward omission or following sufficient consumption of reward. Further, we show that LHb inhibition extends ongoing reward-seeking behavioral states but does not prompt re-engagement. We find no evidence for similar tonic activity fluctuations in ventral tegmental area (VTA) dopamine neurons. Our findings implicate the LHb as a key mediator of disengagement from reward-seeking behavior in multiple contexts and argue against the idea that the LHb contributes to decisions solely by signaling aversion.

neuroscience↗

bioRxiv2020

Sex differences in learning from exploration

Sex-based modulation of cognitive processes could set the stage for individual differences in vulnerability to neuropsychiatric disorders. While value-based decision making processes in particular have been proposed to be influenced by sex differences, the overall correct performance in decision making tasks often show variable or minimal differences across sexes. Computational tools allow us to uncover latent variables that define different decision making approaches, even in animals with similar correct performance. Here, we quantify sex differences in mice in the latent variables underlying behavior in a classic value-based decision making task: a restless 2-armed bandit. While male and female mice had similar accuracy, they achieved this performance via different patterns of exploration. Male mice tended to make more exploratory choices overall, largely because they appeared to get "stuck" in exploration once they had started. Female mice tended to explore less, but learned more quickly during exploration. Together, these results suggest that sex exerts stronger influences on decision making during periods of learning and exploration than during stable choices. Exploration during decision making is altered in people diagnosed addictions, depression, and neurodevelopmental disabilities, pinpointing the neural mechanisms of exploration as a highly translational avenue for conferring sex-modulated vulnerability to neuropsychiatric diagnoses.

animal behavior and cognition↗

bioRxiv2019

Divergent strategies for learning in males and females

A frequent assumption in value-based decision-making tasks is that agents make decisions based on the feature dimension that reward probabilities vary on. However, in complex, multidimensional environments, stimuli can vary on multiple dimensions at once, meaning that the feature deserving the most credit for outcomes is not always obvious. As a result, individuals may vary in the strategies used to sample stimuli across dimensions, and these strategies may have an unrecognized influence on decision-making. Sex is a proxy for multiple genetic and endocrine influences that can influence decision-making strategies, including how environments are sampled. In this study, we examined the strategies adopted by female and male mice as they learned the value of stimuli that varied in both image and location in a visually-cued two-armed bandit, allowing two possible dimensions to learn about. Female mice acquired the correct image-value associations more quickly than male mice, and they used a fundamentally different strategy to do so. Female mice constrained their decision-space early in learning by preferentially sampling one location over which images varied. Conversely, male strategies were inconsistent, changing frequently and strongly influenced by the immediate experience of stochastic rewards. Individual strategies were related to sex-gated changes in neuronal activation in early learning. Together, we find that in mice, sex is linked with divergent strategies for sampling and learning about the world, revealing substantial unrecognized variability in the approaches implemented during value-based decision-making.

animal behavior and cognition↗

bioRxiv2018

Exploratory noise governs both flexibility and spontaneous errors and is regulated by cocaine

In many cognitive processes, lapses (spontaneous errors) are attributed to nuisance processes like sensorimotor noise or disengagement. However, some lapses could also be caused by exploratory noise: behavioral randomness that facilitates learning in changing environments. If so, strategic processes would need only up-regulate (rather than generate) exploration to adapt to a changing environment. This view predicts that lapse rates should be correlated with flexibility because they share a common cause. We report that when macaques performed a set-shifting task, lapse rates were negatively correlated with perseverative error frequency. Furthermore, chronic exposure to cocaine, which impairs cognitive flexibility, increased perseverative errors, but, surprisingly, improved overall performance by reducing lapse rates. We reconcile these results with a model in which cocaine decreased exploration by deepening attractor basins corresponding to rules. These results support the idea that exploratory noise contributes to lapses, meaning that it affects rule-based decision-making even when it has no strategic value.

neuroscience↗