bioRxiv Science⌕ Search

Biology subjects

Botvinick, M.

Publications and source records attributed to Botvinick, M..

9 recordsLinked to original sources

Functional reorganization of motor cortex connectivity during learning

Learning new tasks requires the brain to reshape the flow of neural activity, but how these changes arise from dynamic neural connectivity remains unclear. Here, we used two-photon photostimulation and calcium imaging to map learning-related changes in connectivity in layer 2/3 of mouse motor cortex, induced by learning of an optical brain-computer interface (BCI) task. Mice rapidly (within minutes) learned to change activity in a conditioned neuron to earn rewards. Activity changes were sparse; the conditioned neuron increased activity more than surrounding neurons. Mapping connectivity before and after learning revealed changes in motor cortex connectivity, enriched in neurons that were active before trial initiation, analogous to motor cortex populations that are active preceding movement. Motor cortex plasticity reroutes preparatory activity to neurons that are active later and control the conditioned neuron. Our findings show how rapid learning can be achieved through structured changes in motor cortex connectivity.

neuroscience↗

DiscoGen: Learning to Discover Gene Regulatory Networks

Accurately inferring Gene Regulatory Networks (GRNs) is a critical and challenging task in biology. GRNs model the activatory and inhibitory interactions between genes and are inherently causal in nature. To accurately identify GRNs, perturbational data is required. However, most GRN discovery methods only operate on observational data. Recent advances in neural network-based causal discovery methods have significantly improved causal discovery, including handling interventional data, improvements in performance and scalability. However, applying state-of-the-art (SOTA) causal discovery methods in biology poses challenges, such as noisy data and a large number of samples. Thus, adapting the causal discovery methods is necessary to handle these challenges. In this paper, we introduce DiscoGen, a neural network-based GRN discovery method that can denoise gene expression measurements and handle interventional data. We demonstrate that our model outperforms SOTA neural network-based causal discovery methods.

genomics↗

BCI learning phenomena can be explained by gradient-based optimization

Brain-computer interface (BCI) experiments have shown that animals are able to adapt their recorded neural activity in order to receive reward. Recent studies have highlighted two phenomena. First, the speed at which a BCI task can be learned is dependent on how closely the required neural activity aligns with pre-existing activity patterns: learning "out-of-manifold" tasks is slower than "in-manifold" tasks. Second, learning happens by "re-association": the overall distribution of neural activity patterns does not change significantly during task learning. These phenomena have been presented as distinctive aspects of BCI learning. Here we show, using simulations and theoretical analysis, that both phenomena result from the simple assumption that behaviour and representations are improved via gradient-based algorithms. We invoke Occams Razor to suggest that this straightforward explanation should be preferred when accounting for these experimental observations.

neuroscience↗

Pre-trial predictors of conflict response efficacy in human dorsolateral prefrontal cortex

The ability to perform motor actions depends, in part, on the brains initial state, that is, the ensemble firing rate pattern prior to the initiation of action. We hypothesized that the same principle would apply to cognitive functions as well. To test this idea, we examined a unique set of single unit data collected in human dorsolateral prefrontal (dlPFC) cortex. Data were collected in a conflict task that interleaves Simon (motor-type) and Eriksen (flanker-type) conflict trials. In dlPFC, variability in pre-trial firing rate predicted the ability to resolve conflict, as inferred from reaction times. Ensemble patterns that predicted faster Simon reaction times overlapped slightly with those predicting Erikson performance, indicating that the two conflict types are associated with near-orthogonal initial states, and suggesting that there is a weak abstract or amodal conflict preparatory state in this region. These codes became fully orthogonalized in the response state. We interpret these results in light of the initial state hypothesis, arguing that the firing patterns in dlPFC immediately preceding the start of a task predispose it for the efficient implementation of cognitive action.

neuroscience↗

Generative replay for compositional visual understanding in the prefrontal-hippocampal circuit

Understanding the visual world is a constructive process. Whilst a frontal-hippocampal circuit is known to be essential for this task, little is known about the associated neuronal computations. Visual understanding appears superficially distinct from other known functions of this circuit, such as spatial reasoning and model-based planning, but recent models suggest deeper computational similarities. Here, using fMRI, we show that representations of a simple visual scene in these brain regions are relational and compositional - key computational properties theorised to support rapid construction of hippocampal maps. Using MEG, we show that rapid sequences of representations, akin to replay in spatial navigation and planning problems, are also engaged in visual construction. Whilst these sequences have previously been proposed as mechanisms to plan possible futures or learn from the past, here they are used to understand the present. Replay sequences form constructive hypotheses about possible scene configurations. These hypotheses play out in an optimal order for relational inference, progressing from predictable to uncertain scene elements, gradually constraining possible configurations, and converging on the correct scene configuration. Together, these results suggest a computational bridge between apparently distinct functions of hippocampal-prefrontal circuitry, and a role for generative replay in constructive inference and hypothesis testing.

neuroscience↗

A rapid and efficient learning rule for biological neural circuits

The dominant view in neuroscience is that changes in synaptic weights underlie learning. It is unclear, however, how the brain is able to determine which synapses should change, and by how much. This uncertainty stands in sharp contrast to deep learning, where changes in weights are explicitly engineered to optimize performance. However, the main tool for that, backpropagation, has two problems. One is neuro-science related: it is not biologically plausible. The other is inherent: networks trained with this rule tend to forget old tasks when learning new ones. Here we introduce the Dendritic Gated Network (DGN), a variant of the Gated Linear Network, which offers a biologically plausible alternative to backpropagation. DGNs combine dendritic gating (whereby interneurons target dendrites to shape neuronal responses) with local learning rules to yield provably efficient performance. They are significantly more data efficient than conventional artificial networks, and are highly resistant to forgetting. Consequently, they perform well on a variety of tasks, in some cases better than backpropagation. Importantly, DGNs have structural and functional similarities to the cerebellum, a link that we strengthen by using in vivo two-photon calcium imaging to show that single interneurons suppress activity in individual dendritic branches of Purkinje cells, a key feature of the model. Thus, DGNs leverage targeted dendritic inhibition and local learning - two features ubiquitous in the brain - to achieve fast and efficient learning.

neuroscience↗

Human dorsal anterior cingulate neurons signal conflict by amplifying task-relevant information

Hemodynamic activity in dorsal anterior cingulate cortex (dACC) correlates with conflict, suggesting it contributes to conflict processing. This correlation could be explained by multiple neural processes that can be disambiguated by population firing rates patterns. We used targeted dimensionality reduction to characterize activity of populations of single dACC neurons as humans performed a task that manipulates two forms of conflict. Although conflict enhanced firing rates, this enhancement did not come from a discrete population of domain-general conflict-encoding neurons, nor from a distinct conflict-encoding response axis. Nor was it the epiphenomenal consequence of simultaneous coactivation of action plans. Instead, conflict amplified the task-relevant information encoded across the neuronal population. Effects of conflict were weaker and more heterogeneous in the dorsolateral prefrontal cortex (dlPFC), suggesting that dACCs role in conflict processing may be somewhat specialized. Overall, these results support the theory that conflict biases competition between sensorimotor transformation processes occurring in dACC.

neuroscience↗

Prefrontal cortex as a meta-reinforcement learning system

Over the past twenty years, neuroscience research on reward-based learning has converged on a canonical model, under which the neurotransmitter dopamine stamps in associations between situations, actions and rewards by modulating the strength of synaptic connections between neurons. However, a growing number of recent findings have placed this standard model under strain. In the present work, we draw on recent advances in artificial intelligence to introduce a new theory of reward-based learning. Here, the dopamine system trains another part of the brain, the prefrontal cortex, to operate as its own free-standing learning system. This new perspective accommodates the findings that motivated the standard model, but also deals gracefully with a wider range of observations, providing a fresh foundation for future research.

neuroscience↗

Identifying Model-Based and Model-Free Patterns in Behavior on Multi-Step Tasks

Recent years have seen a surge of research into the neuroscience of planning. Much of this work has taken advantage of a two-step sequential decision task developed by Daw et al. (2011), which gives the ability to diagnose whether or not subjects behavior is the result of planning. Here, we present simulations which suggest that the techniques most commonly used to analyze data from this task may be confounded in important ways. We introduce a new analysis technique, which suffers from fewer of these issues. This technique also presents a richer view of behavior, making it useful for characterizing patterns in behavior in a theory-neutral manner. This allows it to provide an important check on the assumptions of more theory-driven analysis such as agent-based model-fitting.

neuroscience↗