bioRxiv Science⌕ Search

Biology subjects

Latham, P. E.

Publications and source records attributed to Latham, P. E..

9 recordsLinked to original sources

An Efficient Computing Theory of Prefrontal Structured Working Memory Representations

AO_SCPLOWBSTRACTC_SCPLOWThe efficient coding hypothesis presents a compelling success story for theoretical and systems neu-roscience. It marshals a unifying idea, that neural codes can be understood as efficient encodings of natural stimuli, to explain phenomena from across sensory systems, sometimes with exquisite precision. However, similar normative assaults on cognitive representations, such as those in prefrontal or entorhinal cortex, have been less comprehensively successful. We argue that this reflects efficient codings focus on encoded variables, overlooking the computations that neural circuits implement. Here, instead, we develop an efficient computing theory that studies optimal implementations of recurrent cognitive computations. We apply this framework to the prefrontal cortex, in particular, to a rich vein of neural recordings: structured working memory tasks, such as recalling a sequence. Despite using near-identical tasks, the literature has reported two distinct coding schemes: one contextual, with neurons active only in a particular sequence, the other compositional, with neurons tuned to a single sequence element. Just as efficient coding links stimuli statistics to optimal representation, our theory relates task structure and statistics to optimal representation. In so doing, we find that compositional and contextual codes can be understood as two extremes of a spectrum of optimal representations, with the correlations amongst sequence elements determining a tasks position on this spectrum. Our theory highlights previously underappreciated discrepancies between measured representations, explaining them via subtle task differences; and allows us to infer the algorithm underlying otherwise ambiguous neural data. In sum, we demonstrate an efficient computing approach that makes normative statements about cognitive representations, and serves as a tool for understanding a swathe of neural data.

neuroscience↗

Fast and slow synaptic plasticity enables concurrent control and learning

During many tasks the brain receives real-time feedback about performance. What should it do with that information, at the synaptic level, so that tasks can be performed as well as possible? The conventional answer is that it should learn by incrementally adjusting synaptic strengths. We show, however, that learning on its own is severely suboptimal. To maximize performance, synaptic plasticity should also operate on a much faster timescale - essentially, the synaptic weights should act as a control signal. We propose a normative plasticity rule that embodies this principle. In this, fast synaptic weight changes greedily suppress downstream errors, while slow synaptic weight changes implement statistically optimal learning. This enables near-perfect task performance immediately, efficient task execution on longer timescales, and confers robustness to noise and other perturbations. Applied in a cerebellar microcircuit model, the theory explains longstanding experimental observations and makes novel testable predictions.

neuroscience↗

A theory of brain-computer interface learning via low-dimensional control

A remarkable demonstration of the flexibility of mammalian motor systems is primates ability to learn to control brain-computer interfaces (BCIs). This constitutes a completely novel motor behavior, yet primates are capable of learning to control BCIs under a wide range of conditions. BCIs with carefully calibrated decoders, for example, can be learned with only minutes to hours of practice. With a few weeks of practice, even BCIs with randomly constructed decoders can be learned. What are the biological substrates of this learning process? Here, we develop a theory based on a re-aiming strategy, whereby learning operates within a low-dimensional subspace of task-relevant inputs driving the local population of recorded neurons. Through comprehensive numerical and formal analysis, we demonstrate that this theory can provide a unifying explanation for disparate phenomena previously reported in three different BCI learning tasks, and we derive a novel experimental prediction that we verify with previously published data. By explicitly modeling the underlying neural circuitry, the theory reveals an interpretation of these phenomena in terms of biological constraints on neural activity.

neuroscience↗

Brain-wide representations of prior information in mouse decision-making

The neural representations of prior information about the state of the world are poorly understood. To investigate them, we examined brain-wide Neuropixels recordings and widefield calcium imaging collected by the International Brain Laboratory. Mice were trained to indicate the location of a visual grating stimulus, which appeared on the left or right with prior probability alternating between 0.2 and 0.8 in blocks of variable length. We found that mice estimate this prior probability and thereby improve their decision accuracy. Furthermore, we report that this subjective prior is encoded in at least 20% to 30% of brain regions which, remarkably, span all levels of processing, from early sensory areas (LGd, VISp) to motor regions (MOs, MOp, GRN) and high level cortical regions (ACAd, ORBvl). This widespread representation of the prior is consistent with a neural model of Bayesian inference involving loops between areas, as opposed to a model in which the prior is incorporated only in decision-making areas. This study offers the first brain-wide perspective on prior encoding at cellular resolution, underscoring the importance of using large scale recordings on a single standardized task.

neuroscience↗

Sparse connectivity for MAP inference in linear models using sister mitral cells

Sensory processing is hard because the variables of interest are encoded in spike trains in a relatively complex way. A major goal in studies of sensory processing is to understand how the brain extracts those variables. Here we revisit a common encoding model in which variables are encoded linearly. Although there are typically more variables than neurons, this problem is still solvable because only a small number of variables appear at any one time (sparse prior). However, previous solutions require all-to-all connectivity, inconsistent with the sparse connectivity seen in the brain. Here we propose an algorithm that provably reaches the MAP (maximum a posteriori) inference solution, but does so using sparse connectivity. Our algorithm is inspired by the circuit of the mouse olfactory bulb, but our approach is general enough to apply to other modalities. In addition, it should be possible to extend it to nonlinear encoding models. SummarySensory systems must infer latent variables from noisy and ambiguous input. MAP inference - choosing the most likely latent variable given the sensory input - is one of the simplest methods for doing that, but its neural implementation often requires all-to-all connectivity between the neurons involved. In common sensory contexts this can require a single neuron to connect to hundreds of thousands of others, which is biologically implausible. In this work we take inspiration from the sister mitral cells of the olfactory system - groups of neurons associated with the same input channel - to derive a method for performing MAP inference using sparse connectivity. We do so by assigning sister cells to random subsets of the latent variables and using additional cells to ensure that sisters correctly share information. We then derive the circuitry and dynamics required for the sister cells to compute the original MAP inference solution. Our work yields a biologically plausible circuit that provably solves the MAP inference problem and provides experimentally testable predictions. While inspired by the olfactory system, our method is quite general, and is likely to apply to other sensory modalities.

neuroscience↗

Developmental and evolutionary constraints on olfactory circuit selection

Across species, neural circuits show remarkable regularity, suggesting that their structure has been driven by underlying optimality principles. Here, we ask whether we can predict the neural circuitry of diverse species by optimizing the neural architecture to make learning as efficient as possible. We focus on the olfactory system, primarily because it has a relatively simple evolutionarily conserved structure, and because its input and intermediate layer sizes exhibits a tight allometric scaling. In mammals, it has been shown that the number of neurons in layer 2 of piriform cortex scales as the number of glomeruli (the input units) to the 3/2 power; in invertebrates, we show that the number of mushroom body Kenyon cells scales as the number of glomeruli to the 7/2 power. To understand these scaling laws, we model the olfactory system as a three layered nonlinear neural network, and analytically optimize the intermediate layer size for efficient learning from a limited number of samples. We find that the 3/2 scaling observed in mammals emerges naturally, both in full batch optimization and under stochastic gradient learning. We extended the framework to the case where a fraction of the olfactory circuit is genetically specified, not learned. We show numerically that this makes the scaling law steeper when the number of glomeruli is small, and we are able to recover the 7/2 scaling law observed in invertebrates. This study paves the way for a deeper understanding of the organization of brain circuits from an evolutionary perspective.

neuroscience↗

Strong information-limiting correlations in early visual areas

If the brain processes incoming data efficiently, information should degrade little between early and later neural processing stages, and so information in early stages should match behavioral performance. For instance, if there is enough information in a visual cortical area to determine the orientation of a grating to within 1 degree, and the code is simple enough to be read out by downstream circuits, then animals should be able to achieve that performance behaviourally. Despite over 30 years of research, it is still not known how efficient the brain is. For tasks involving a large number of neurons, the amount of information encoded by neural circuits is limited by differential correlations. Therefore, determining how much information is encoded requires quantifying the strength of differential correlations. Detecting them, however, is difficult. We report here a new method, which requires on the order of 100s of neurons and trials. This method relies on computing the alignment of the neural stimulus encoding direction, f', with the eigenvectors of the noise covariance matrix,{Sigma} . In the presence of strong differential correlations, f' must be spanned by a small number of the eigenvectors with largest eigenvalues. Using simulations with a leaky-integrate-and-fire neuron model of the LGN-V1 circuit, we confirmed that this method can indeed detect differential correlations consistent with those that would limit orientation discrimination thresholds to 0.5-3 degrees. We applied this technique to V1 recordings in awake monkeys and found signatures of differential correlations, consistent with a discrimination threshold of 0.47-1.20 degrees, which is not far from typical discrimination thresholds (1-2 deg). These results suggest that, at least in macaque monkeys, V1 contains about as much information as is seen in behaviour, implying that downstream circuits are efficient at extracting the information available in V1.

neuroscience↗

Rapid Bayesian learning in the mammalian olfactory system

Many experimental studies suggest that animals can rapidly learn to identify odors and predict the rewards associated with them. However, the underlying plasticity mechanism remains elusive. In particular, it is not clear how olfactory circuits achieve rapid, data efficient learning with local synaptic plasticity. Here, we formulate olfactory learning as a Bayesian optimization process, then map the learning rules into a computational model of the mammalian olfactory circuit. The model is capable of odor identification from a small number of observations, while reproducing cellular plasticity commonly observed during development. We extend the framework to reward-based learning, and show that the circuit is able to rapidly learn odor-reward association with a plausible neural architecture. These results deepen our theoretical understanding of unsupervised learning in the mammalian brain.

neuroscience↗

The idiosyncratic nature of confidence

Confidence is the feeling of knowing that accompanies decision making and guides processes such as learning, error detection, and inter-personal communication. Bayesian theory proposes that confidence is a function of the probability that a decision is correct given the evidence. Empirical research has shown, however, that humans tend to report confidence in very different ways. This idiosyncratic behaviour suggests that different individuals may perform different computations to estimate confidence from uncertain evidence. We tested this hypothesis by collecting confidence reports from healthy adults making decisions under either visual or numerical uncertainty. We found that for most individuals, confidence did indeed reflect the perceived probability of being correct. However, in approximately half of them, confidence also reflected a different probabilistic quantity: the observed Fisher information. We isolated the influence of each of these two quantities on confidence, and found that this decomposition is stable across weeks, and consistent across tasks involving uncertainty in both perceptual and cognitive domains. Our findings provide, for the first time, a mechanistic interpretation of individual differences in the human sense of confidence.

neuroscience↗