Biology subjects

Berke, J. D.

Publications and source records attributed to Berke, J. D..

11 recordsLinked to original sources

bioRxiv2026

Meta-learning is expressed through altered prefrontal cortical dynamics

Learning where and when rewards like food and water are available is essential for survival1,2. In the simplest cases where resource availability is stable, animals can learn reward contingencies by integrating outcomes across repeated samples of each possible action. In more natural settings, however, reward availability is governed by structured higher-order rules such as depletion and repletion over time. To adapt flexibly to such changing environments, optimal choices require meta-learning wherein animals learn how to learn from external feedback, ultimately enabling them to infer the underlying reward structure from abstract, generalizable rules rather than relying solely on recent outcomes3,4. The existence of meta-learning in animal behavior is well established3-8, yet the neural circuits and computations that implement it remain poorly understood9-11. Here we investigated meta-learning using a spatial foraging task in which rats acquired a depletion-repletion rule that regulated reward availability, and carried out longitudinal, high-density recordings from the medial prefrontal cortex (mPFC). We show that meta-learning engages specific, systematic changes in mPFC neural dynamics that embed the learned rule and thereby alter how the network learns action values from reward outcomes. These dynamics are based on mixed coding of task structure and value in individual mPFC neurons. At the population level, this coding organizes into low-dimensional dynamical motifs that generalize across task conditions. As meta-learning progresses, these motifs are reshaped to instantiate both rule-guided inference of future states before outcome delivery and rule-based value updating during the outcome period. These results indicate that meta-learning sculpts pre-existing prefrontal dynamics to support the acquisition of new, generalizable reward-learning strategies.

neuroscience↗

bioRxiv2025

Parvalbumin interneurons gate and shape striatal sequences

Impulsive and uncontrolled behaviors are associated with loss of parvalbumin-expressing striatal interneurons (PV+). To understand this microcircuit mechanism we compared spiking of five classes of identified neurons in sensorimotor striatum, as rats waited for a cue, then performed brief actions. During waiting PV+ increased firing, and suppression of PV+ increased premature movements, supporting a role in action restraint. Once underway, each action was accompanied by a rapid striatal firing sequence, including PV+ and direct and indirect pathway spiny projection neurons (SPNs). Nearby PV+ and SPNs showed millisecond-level synchrony, and PV+ firing inhibited SPNs ~2ms later. Suppressing PV+ immediately changed which SPNs participated in sequences, and slowed movements. PV+ thus provide both broad restraint and precise sculpting of striatal output to achieve fluid, appropriately timed behavior.

neuroscience↗

bioRxiv2024

Hippocampal representations of alternative possibilities are flexibly generated to meet cognitive demands

The cognitive ability to go beyond the present to consider alternative possibilities, including potential futures and counterfactual pasts, can support adaptive decision making. Complex and changing real-world environments, however, have many possible alternatives. Whether and how the brain can select among them to represent alternatives that meet current cognitive needs remains unknown. We therefore examined neural representations of alternative spatial locations in the rat hippocampus during navigation in a complex patch foraging environment with changing reward probabilities. We found representations of multiple alternatives along paths ahead and behind the animal, including in distant alternative patches. Critically, these representations were modulated in distinct patterns across successive trials: alternative paths were represented proportionate to their evolving relative value and predicted subsequent decisions, whereas distant alternatives were prevalent during value updating. These results demonstrate that the brain modulates the generation of alternative possibilities in patterns that meet changing cognitive needs for adaptive behavior.

neuroscience↗

bioRxiv2024

A mismatch between striatal cholinergic pauses and dopaminergic reward prediction errors

Movement, motivation and reward-related learning depend strongly on striatal dopamine and acetylcholine. These neuromodulators each regulate the other, and disturbances to their coordinated signals contribute to human disorders ranging from Parkinsons Disease to depression and addiction. Pauses in the firing of cholinergic interneurons (CINs) are thought to coincide with pulses in dopamine release that encode reward prediction errors (RPEs), together shaping synaptic plasticity and thereby learning. However, such models are based upon recordings from unidentified neurons, and do not incorporate the distinct characteristics of striatal subregions. Here we compare the firing of identified, individual CINs to dopamine release as unrestrained rats performed a probabilistic decision-making task. The relationships between CIN spiking, dopamine release, and behavior varied strongly by subregion. In dorsal-lateral striatum a Go! cue evoked burst-pause CIN spiking, quickly followed by a very brief (~150ms) dopamine pulse that was unrelated to RPE. In dorsal-medial striatum the same cue evoked only a CIN pause; this pause was curtailed by a movement-selective rebound in firing. Finally in ventral striatum a reward cue evoked slower, RPE-coding increases in both dopamine and CIN firing, without any distinct pause. Our results demonstrate a spatial and temporal dissociation between CIN pauses and dopamine RPE signals, and will inform new models of striatal microcircuits and their contributions to behavior.

neuroscience↗

bioRxiv2023

Comment on 'Accumbens cholinergic interneurons dynamically promote dopamine release and enable motivation'

Acetylcholine is widely believed to modulate the release of dopamine in the striatum of mammals. Experiments in brain slices clearly show that synchronous activation of striatal cholinergic interneurons is sufficient to drive dopamine release via axo-axonal stimulation of nicotinic acetylcholine receptors. However, evidence for this mechanism in vivo has been less forthcoming. A recent paper in eLife (Mohebi et al., 2023) reported that, in awake behaving rats, optogenetic activation of striatal cholinergic interneurons with blue light readily evokes dopamine release measured with the red fluorescent sensor RdLight1. Here, we show that blue light alone alters the fluorescent properties of RdLight1 in a manner that may be misconstrued as phasic dopamine release, and that this artefactual photoactivation can account for the effects attributed to cholinergic interneurons. Our findings indicate that measurements of dopamine using the red-shifted fluorescent sensor RdLight1 should be interpreted with caution when combined with optogenetics. In light of this and other publications that did not observe large acetylcholine-evoked dopamine transients in vivo, the conditions under which such release occurs in behaving animals remain unknown.

neuroscience↗

bioRxiv2023

Reward expectation selectively boosts the firing of accumbens D1+ neurons during motivated approach.

The nucleus accumbens (NAc) helps govern motivation to pursue rewards. Two distinct sets of NAc projection neurons-expressing dopamine D1 versus D2 receptors-are thought to promote and suppress motivated behaviors respectively. However, support for this conceptual framework is limited: in particular the spiking patterns of these distinct cell types during motivated behavior have been largely unknown. We monitored identified D1+ and D2+ neurons in the NAc Core, as unrestrained rats performed an operant task in which motivation to initiate work tracks recent reward rate. D1+ neurons preferentially increased firing as rats initiated trials, and fired more when reward expectation was higher. By contrast, D2+ cells preferentially increased firing later in the trial especially in response to reward delivery - a finding not anticipated from current theoretical models. Our results provide new evidence for the specific contribution of NAc D1+ cells to self-initiated approach behavior, and will spur updated models of how we learn from rewards.

neuroscience↗

bioRxiv2023

Dual credit assignment processes underliedopamine signals in a complex spatialenvironment.

Dopamine in the nucleus accumbens helps motivate behavior based on expectations of future reward ("values"). These values need to be updated by experience: after receiving reward, the choices that led to reward should be assigned greater value. There are multiple theoretical proposals for how this credit assignment could be achieved, but the specific algorithms that generate updated dopamine signals remain uncertain. We monitored accumbens dopamine as freely behaving rats foraged for rewards in a complex, changing environment. We observed brief pulses of dopamine both when rats received reward (scaling with prediction error), and when they encountered novel path opportunities. Furthermore, dopamine ramped up as rats ran towards reward ports, in proportion to the value at each location. By examining the evolution of these dopamine place-value signals, we found evidence for two distinct update processes: progressive propagation along taken paths, as in temporal-difference learning, and inference of value throughout the maze, using internal models. Our results demonstrate that within rich, naturalistic environments dopamine conveys place values that are updated via multiple, complementary learning algorithms.

neuroscience↗

bioRxiv2022

Cholinergic Interneurons Drive Motivation by Promoting Dopamine Release in the Nucleus Accumbens

Motivation to work for potential rewards is critically dependent on dopamine (DA) in the nucleus accumbens (NAc). DA release from NAc axons can be controlled by at least two distinct mechanisms: 1) action potentials propagating from DA cell bodies in the ventral tegmental area (VTA), and 2) activation of {beta}2* nicotinic receptors by local cholinergic interneurons (CINs). How CIN activity contributes to NAc DA dynamics in behaving animals remains unclear. We monitored DA release in the NAc Core of awake, unrestrained rats while simultaneously monitoring or manipulating CIN activity at the same location. CIN stimulation rapidly evoked DA release, and in contrast to slice preparations, this DA release showed no indication of short-term depression or receptor desensitization. The sound of food delivery evoked a brief joint increase in CIN population activity and DA release, with a second joint increase as rats approached the food. In an operant task, we observed fast ramps in CIN activity during approach behaviors, either to start the trial or to collect rewards. These CIN ramps co-occurred with DA release ramps, without corresponding changes in the firing of VTA DA neurons. Finally, we examined the effects of blocking CIN influence over DA release through local NAc infusion of DH{beta}E, a selective antagonist of [Formula] nicotinic receptors. DH{beta}E dose-dependently interfered with motivated approach decisions, mimicking the effects of a DA antagonist. Our results support a key influence of CINs over motivated behavior via the local regulation of DA release.

neuroscience↗

bioRxiv2022

Altered basal ganglia output during self-restraint

Suppressing actions is essential for flexible behavior. Multiple neural circuits involved in behavioral inhibition converge upon a key basal ganglia output nucleus, the substantia nigra pars reticulata (SNr). To examine how changes in basal ganglia output contribute to self-restraint, we recorded SNr neurons during a proactive behavioral inhibition task. Rats responded to Go! cues with rapid leftward or rightward movements, but also prepared to cancel one of these movement directions on trials when a Stop! cue might occur. This action restraint - visible as direction-selective slowing of reaction times - altered both rates and patterns of SNr spiking. Overall firing rate was elevated before the Go! cue, and this effect was driven by a subpopulation of direction-selective SNr neurons. In neural state space, this corresponded to a shift away from the restrained movement. SNr neurons also showed more variable inter-spike-intervals during proactive inhibition. This corresponded to more variable state-space trajectories, which may slow reaction times via reduced preparation to move. These findings open new perspectives on how basal ganglia dynamics contribute to movement preparation and cognitive control.

neuroscience↗

bioRxiv2020

Accurate inference in parametric models reshapes neuroscientific interpretation and improves data-driven discovery

A central goal of systems neuroscience is to understand the relationships amongst constituent units in neural populations and their modulation by external factors using high-dimensional and stochastic neural recordings. Statistical models, particularly parametric models, play an instrumental role in accomplishing this goal, because their fitted parameters can provide insight into the underlying biological processes that generated the data. However, extracting conclusions from a parametric model requires that it is fit using an inference procedure capable of selecting the correct parameters and properly estimating their values. Traditional approaches to parameter inference have been shown to suffer from failures in both selection and estimation. Recent development of algorithms that ameliorate these deficiencies raises the question of whether past work relying on such inference procedures have produced inaccurate systems neuroscience models, thereby impairing their interpretation. Here, we used the Union of Intersections, a statistical inference framework capable of state-of-the-art selection and estimation performance, to fit functional coupling, encoding, and decoding models across a battery of neural datasets. We found that, compared to baseline procedures, UoI inferred models with increased sparsity, improved stability, and qualitatively different parameter distributions, while maintaining predictive performance across recording modality, brain region, and task. Specifically, we obtained highly sparse functional coupling networks with substantially different community structure, more parsimonious encoding models, and decoding models that rely on fewer single-units. Together, these results demonstrate that accurate parameter inference reshapes interpretation in diverse neuroscience contexts. The ubiquity of model-based data-driven discovery in biology suggests that analogous results would be seen in other fields.

neuroscience↗

bioRxiv2018

Knock-in rat lines with Cre recombinase at the dopamine D1 and adenosine 2a receptor loci.

Genetically-modified mice have become standard tools in neuroscience research. Our understanding of the basal ganglia in particular has been greatly assisted by BAC mutants with selective transgene expression in striatal neurons forming the direct or indirect pathways. However, for more sophisticated behavioral tasks and larger intracranial implants, rat models are preferred. Furthermore, BAC lines can show variable expression patterns depending upon genomic insertion site. We therefore used CRISPR/Cas9 to generate two novel knock-in rat lines specifically encoding Cre recombinase immediately after the dopamine D1 receptor (Drd1a) or adenosine 2a receptor (Adora2a) loci. Here we validate these lines using in situ hybridization and viral vector mediated transfection to demonstrate selective, functional Cre expression in the striatal direct and indirect pathways respectively. We used whole-genome sequencing to confirm the lack of off-target effects, and established that both rat lines have normal locomotor activity and learning in simple instrumental and Pavlovian tasks. We expect these new D1-Cre and A2a-Cre rat lines will be widely used to study both normal brain functions and neurological and psychiatric pathophysiology.

neuroscience↗