Biology subjects

Stephenson-Jones, M.

Publications and source records attributed to Stephenson-Jones, M..

6 recordsLinked to original sources

bioRxiv2026

Modelling dopaminergic signals associated with habit formation through temporal-difference action learning

Action-selection is determined by a combination of goal-directed and habitual processes. Habits are defined as the reward-independent, stimulus-response relationships which form when an action is regularly executed in the same context, regardless of outcome. An influential computational model proposes that habit formation is driven by action prediction errors which occur when non-habitual actions are taken. It has been further suggested that action prediction errors are encoded in activity of specific dopamine neurons, and it has been recently observed that dopamine activity in the tail of the striatum follows a pattern consistent with the action prediction errors. However, the original models capture changes in habits across trials, but do not describe the time-course of action prediction errors within trials, hence it is difficult to directly compare them with dopamine activity. We begin by outlining the 'temporal-difference action learning' algorithm, which uses biologically-plausible mechanisms to determine how dynamic changes in action intensity influence the resultant prediction errors across near-continuous time. We then demonstrate that dopaminergic data recently collected from the tail of the striatum is better represented by action prediction errors than reward prediction errors. Overall, our results support the existence of value-free action prediction errors and associated habitual behaviour in dopaminergic signals.

neuroscience↗

bioRxiv2025

Most ventral pallidal cholinergic neurons are cortically projecting bursting basal forebrain cholinergic neurons

The ventral pallidum (VP) lies at the intersection of basal ganglia and basal forebrain circuitry, possessing attributes of both major subcortical systems. Basal forebrain cholinergic neurons are rapidly recruited by reinforcement feedback and project to cortical and subcortical forebrain targets; in contrast, striatal cholinergic cells are local interneurons exhibiting classical pause-burst responses to rewards. However, VP cholinergic neurons (VPCNs) are less characterized, and it is unclear whether basal forebrain and striatal type cholinergic neurons mix in the VP. Therefore, we performed anterograde and mono-transsynaptic retrograde labeling, in vitro acute slice recordings and bulk calcium recordings of VPCNs. We found that VPCNs broadly interact with the affective circuitry that processes rewards and punishments, targeting the basolateral amygdala, the nucleus accumbens, the medial prefrontal cortex and the lateral habenula, while receiving inputs from the nucleus accumbens, hypothalamus, central amygdala, bed nucleus of stria terminalis and the ventral tegmental area. Bulk calcium recordings revealed VPCN responses to rewards, punishments and reward-predicting cues, like those of the horizontal diagonal band of Broca of the basal forebrain. Acute slice recordings showed that most VPCNs resembled the bursting type of basal forebrain cholinergic neurons (BFCNs), while a few of them were of the regular rhythmic type, which sharply differentiated most VPCNs from striatal cholinergic interneurons. These results were confirmed by in vivo electrophysiological recordings of putative VPCNs largely resembling bursting BFCNs. We conclude that most VPCNs are BFCNs with specialized connectivity to relay aversive and appetitive stimuli to the reinforcement circuitry, possibly implicated in mood disorders and addiction.

neuroscience↗

bioRxiv2024

Replay of procedural experience is independent of the hippocampus

Sleep is critical for consolidating all forms of memory1-3, from episodic experience to the development of motor skills4-6. A core feature of the consolidation process is offline replay of neuronal firing patterns that occur during experience7,8. This replay is thought to originate in the hippocampus and trigger the reactivation of ensembles of cortical and subcortical neurons1,3,9-18. However, non-declarative memories do not require the hippocampus for learning or for sleep-dependent consolidation19-26 meaning what drives their consolidation is unknown. Here we show, using an unsupervised method, that replay occurs in the dorsal striatum of mice during offline consolidation of a non-declarative, procedural, memory and that this replay is generated independently of the hippocampus. Replay occurred at both real-world and time-compressed speeds and was also prioritised both at the level of the individual neurons and the type of neural sequence. Complete bilateral lesions of the hippocampus had no effect on any feature of this replay. Our results demonstrate that procedural replay during consolidation of a non-declarative memory is independent of the hippocampus. These results support the view that replay drives active consolidation of all types of memory during sleep but challenges the idea that the hippocampus is the source of this replay.

neuroscience↗

bioRxiv2024

Repix: reliable, reusable, versatile chronic Neuropixels implants using minimal components

Neuropixels probes represent the state-of-the-art for high-yield electrophysiology in neuroscience: the simultaneous recording of hundreds of neurons is now routinely carried out in head-restrained animals. In contrast, neural recording in unrestrained animals, as well as recording and tracking neurons over days, remains challenging, though it is possible using chronic implants. A major challenge is the availability of simple methods that can be implemented with limited or no prior experience with Neuropixels probes, while achieving reliable, reusable, versatile high-density electrophysiology. Here we developed, deployed, and evaluated the real-world performance of Repix, a chronic implantation system that permits the repeated re-use of Neuropixels probes. The lightweight system allows implanted animals to express a full range of natural behaviors, including social behaviors. We show that Repix allows the recording of hundreds of neurons across many months, up to a year, with implants across cortical and subcortical brain regions. Probes can be reused repeatedly with stable yield. Repix has been used by 16 researchers in 10 laboratories to date, and we evaluated the real-world performance of Repix in a variety of chronic recording paradigms in both mice and rats with a combined 209 implantations. We found that the key advantage of Repix is robustness and simplicity. Adopters of Repix became proficient at five procedures on average, regardless of prior experience with in vivo electrophysiology. With the companion protocol alongside this article, the performance and user-friendliness of Repix should facilitate a wide uptake of chronic Neuropixels recordings.

neuroscience↗

bioRxiv2022

Action prediction error: a value-free dopaminergic teaching signal that drives stable learning

Animals choice behavior is characterized by two main tendencies: taking actions that led to rewards and repeating past actions. Theory suggests these strategies may be reinforced by different types of dopaminergic teaching signals: reward prediction error (RPE) to reinforce value-based associations and movement-based action prediction errors to reinforce value-free repetitive associations. Here we use an auditory-discrimination task in mice to show that movement-related dopamine activity in the tail of the striatum encodes the hypothesized action prediction error signal. Causal manipulations reveal that this prediction error serves as a value-free teaching signal that supports learning by reinforcing repeated associations. Computational modeling and experiments demonstrate that action prediction errors alone cannot support reward-guided learning but when paired with the RPE circuitry they serve to consolidate stable sound-action associations in a value-free manner. Together we show that there are two types of dopaminergic prediction errors that work in tandem to support learning.

neuroscience↗

bioRxiv2019

Opposing contributions of GABAergic and glutamatergic ventral pallidal neurons to motivational behaviours

The ventral pallidum (VP) is critical for invigorating reward seeking and is also involved in punishment avoidance, but how it contributes to such opposing behavioural actions remains unclear. Here we show that GABAergic and glutamatergic VP neurons selectively control behaviour in opposing motivational contexts. In vivo recording combined with optogenetics in mice revealed that these two populations oppositely encode positive and negative motivational value, are differentially modulated by animals internal state and determine the behavioural response during motivational conflict. Furthermore, GABAergic VP neurons are essential for movements towards reward in a positive motivational context, but suppress movements in an aversive context. In contrast, glutamatergic VP neurons are essential for movements to avoid a threat but suppress movements in an appetitive context. Our results indicate that GABAergic and glutamatergic VP neurons encode the drive for approach and avoidance, respectively, with the balance between their activities determining the type of motivational behaviour.

neuroscience↗