bioRxiv Science⌕ Search

Biology subjects

Pehlevan, C.

Publications and source records attributed to Pehlevan, C..

17 recordsLinked to original sources

A network model of path control

We present a network model that enables a navigating agent to shape the spatial and temporal structure of its paths through its environment. The model is inspired by the insect fan-shaped body. In it, a recurrent neural network receives an input that encodes an agent's velocity vector. Meanwhile, network activity determines the setpoint of a control loop that influences this velocity vector through motor outputs. The network thus guides future movement using memory of past movement. We illustrate how the network's dynamics determine the trajectory features it extracts to produce the setpoint. We then relate the joint dynamics of network activity and the agent's velocity vector to the structure of the resulting paths. This network can produce paths suitable for different forms of exploration. It can also stabilize movements initiated by lower-level systems. Our analyses illustrate how recurrent neural dynamics and memory can shape behavior when embedded in closed loops.

neuroscience↗

Heterogeneous Instructive Signals Enable Ensemble Learning in Cerebellar Cortex

The Marr-Albus framework describes learning in Purkinje cells (PCs) through supervised plasticity associated with complex spikes. However, complex spikes occur with low probability in individual PCs following sensorimotor events, and PCs are organized into "microzones" with shared complex spike tuning and outputs. We unify these observations in a model of associative learning in PC ensembles trained under "heterogeneous plasticity," where each PC randomly receives either depression or potentiation during learning. Heterogeneous plasticity critically aids ensemble performance in a pattern recognition task, allowing memorization capacity to scale with ensemble size. An optimal-decoding theory suggests productive roles for recurrent PC-PC dynamics and nonlinear integration in the cerebellar nuclei. We account for additional experimental observations, including bursting and pausing PCs, a bias toward "upbound" or "downbound" learning mechanisms, and correlations in PC physiology and synaptic weights. Together, our results suggest that microzones perform ensemble learning, enabled by heterogeneous plasticity and nonlinear information processing.

neuroscience↗

Structure, disorder, and dynamics in task-trained recurrent neural circuits

Across many brain areas, neurons produce heterogeneous, seemingly disordered responses. Yet such circuits cannot be purely random, since they must possess some structure to generate the representations and computations underlying behavior. How much structure is present in recurrent connectivity relative to disorder, and how the interaction between the two shapes population dynamics and single-neuron responses, remain incompletely understood. Recurrent neural networks trained to perform tasks have become a leading model of such circuits, but conventional training yields a single point in a vast space of task-compatible solutions, with no systematic way to explore this space and no theory of how internal representations vary within it. Without such a theory, the questions above cannot be addressed, and comparisons between trained networks and neural data are difficult to interpret. Here, we introduce a control parameter that governs the degree to which learning reshapes recurrent connectivity, interpolating between a reservoir regime and one in which recurrent weights are restructured by learning to produce task-relevant internal representations. Varying this parameter generates a family of task-compatible solutions whose internal dynamics differ in a controlled and interpretable way. We derive a dynamical mean-field theory showing that, while population-level dynamics converge to a deterministic limit, individual neurons are driven by independent samples from a single-neuron input-current distribution. When connectivity is random, this distribution is Gaussian. Recurrent restructuring drives it toward task-dependent, non-Gaussian forms. In linear networks, restructuring amplifies task-relevant frequencies. In nonlinear networks, it drives a phase transition from chaotic, high-dimensional activity to ordered, low-dimensional dynamics that generalize temporally beyond the training period. We apply the theory to a reaching task in which a recurrent network must reproduce macaque muscle activity, and find that optimally matching simultaneous motor-cortex recordings requires only a small degree of restructuring, with learned structure coexisting with random heterogeneity. These results suggest a broader picture in which large recurrent circuits are largely random but contain, to varying degrees, structured recurrent connectivity sufficient for generalizable, task-relevant representations.1

neuroscience↗

Simultaneous detection and estimation in olfactory sensing

The mammalian olfactory system shows an exceptional ability for rapid and accurate decoding of both the identity and concentration of odorants. Previous works have used the theory of compressed sensing to elucidate the algorithmic basis for this capability: decoding odor information from the responses of a restricted repertoire of receptors is possible because only a few relevant odorants are present in any given sensory scene. However, existing circuit models for olfactory decoding still cannot contend with the complexity of naturalistic olfactory scenes; they are limited to detection of a handful of odorants. Here, we propose a model for olfactory compressed sensing inspired by simultaneous localization and mapping algorithms in navigation, in which the set of present odors and their concentrations are inferred separately. We implement this split inference in a biologically-plausible recurrent circuit by introducing separate dynamics matched to the distinct nature of presence and concentration, and drawing on the framework of Mirrored Langevin Dynamics. This model can accurately infer presence and concentration at scale. Moreover, its circuit structure can be mapped onto the primary cell types of the olfactory bulb, giving a possible normative account for functional differences between mitral and tufted cells. Our approach offers a general path towards circuit algorithms for probabilistic inference--in olfactory sensing and beyond--that both perform well in naturalistic environments and make experimentally-testable predictions for neural response dynamics.

neuroscience↗

Neurocomputational underpinnings of suboptimal beliefs in recurrent neural network-based agents

Maladaptive belief updating is a hallmark of psychiatric disorders, yet its underlying neurocomputational mechanisms remain poorly understood. While Bayesian models characterize belief updating in decision-making, they do not explicitly model neural computations or neuro-modulatory influences. To address this, we developed a recurrent neural network-based reinforcement learning framework to investigate decision-making deficits in psychiatric conditions, using schizophrenia as a test case. Agents were trained on a predictive inference task commonly used to assess cognitive deficits found in schizophrenia, including under-updating beliefs in volatile environments and over-updating beliefs in response to uninformative cues. The task thus included two conditions: (1) a change-point condition requiring adaptation in a volatile environment and (2) an oddball condition requiring resistance to outliers. We modeled these deficits by systematically manipulating key hyper-parameters associated with specific neural theories: reward prediction error (RPE) discounting and scaling (reflecting diminished dopamine responses), network dynamics disruption (reflecting impaired working memory), and rollout buffer size reduction (reflecting decreased episodic memory capacity). These manipulations reproduced schizophrenia-like decision-making impairments and revealed that suboptimal agents exhibited fewer unstable fixed points near network activity in the changepoint condition, suggesting reduced computational flexibility. This framework extends computational psychiatry by linking cognitive biases to neural dysfunction and provides a mechanistic approach to studying decision-making impairments in psychiatric disorders.

neuroscience↗

Partial observation can induce mechanistic mismatches in data-constrained models of neural dynamics

One of the central goals of neuroscience is to gain a mechanistic understanding of how the dynamics of neural circuits give rise to their observed function. A popular approach towards this end is to train recurrent neural networks (RNNs) to reproduce experimental recordings of neural activity. These trained RNNs are then treated as surrogate models of biological neural circuits, whose properties can be dissected via dynamical systems analysis. How reliable are the mechanistic insights derived from this procedure? While recent advances in population-level recording technologies have allowed simultaneous recording of up to tens of thousands of neurons, this represents only a tiny fraction of most cortical circuits. Here we show that observing only a subset of neurons in a circuit can create mechanistic mismatches between a simulated teacher network and a data-constrained student, even when the two networks have matching single-unit dynamics. In particular, partial observation of models of low-dimensional cortical dynamics based on functionally feedforward or low-rank connectivity can lead to surrogate models with spurious attractor structure. Our results illustrate the challenges inherent in accurately uncovering neural mechanisms from single-trial data, and suggest the need for new methods of validating data-constrained models for neural dynamics.

neuroscience↗

Neural circuits for fast Poisson compressed sensing in the olfactory bulb

Within a single sniff, the mammalian olfactory system can decode the identity and concentration of odorants wafted on turbulent plumes of air. Yet, it must do so given access only to the noisy, dimensionally-reduced representation of the odor world provided by olfactory receptor neurons. As a result, the olfactory system must solve a compressed sensing problem, relying on the fact that only a handful of the millions of possible odorants are present in a given scene. Inspired by this principle, past works have proposed normative compressed sensing models for olfactory decoding. However, these models have not captured the unique anatomy and physiology of the olfactory bulb, nor have they shown that sensing can be achieved within the 100-millisecond timescale of a single sniff. Here, we propose a rate-based Poisson compressed sensing circuit model for the olfactory bulb. This model maps onto the neuron classes of the olfactory bulb, and recapitulates salient features of their connectivity and physiology. For circuit sizes comparable to the human olfactory bulb, we show that this model can accurately detect tens of odors within the timescale of a single sniff. We also show that this model can perform Bayesian posterior sampling for accurate uncertainty estimation. Fast inference is possible only if the geometry of the neural code is chosen to match receptor properties, yielding a distributed neural code that is not axis-aligned to individual odor identities. Our results illustrate how normative modeling can help us map function onto specific neural circuits to generate new hypotheses.

neuroscience↗

Recall tempo of Hebbian sequences depends on the interplay of Hebbian kernel with tutor signal timing

Understanding how neural circuits generate sequential activity is a longstanding challenge. While foundational theoretical models have shown how sequences can be stored as memories with Hebbian plasticity rules, these models considered only a narrow range of Hebbian rules. Here we introduce a model for arbitrary Hebbian plasticity rules, capturing the diversity of spike-timing-dependent synaptic plasticity seen in experiments, and show how the choice of these rules and of neural activity patterns influences sequence memory formation and retrieval. In particular, we derive a general theory that predicts the speed of sequence replay. This theory lays a foundation for explaining how cortical tutor signals might give rise to motor actions that eventually become "automatic". Our theory also captures the impact of changing the speed of the tutor signal. Beyond shedding light on biological circuits, this theory has relevance in artificial intelligence by laying a foundation for frameworks whereby slow and computationally expensive deliberation can be stored as memories and eventually replaced by inexpensive recall.

neuroscience↗

Population geometry enables fast sampling in spiking neural networks

For animals to navigate an uncertain world, their brains need to estimate uncertainty at the timescales of sensations and actions. Sampling-based algorithms afford a theoretically-grounded framework for probabilistic inference in neural circuits, but it remains unknown how one can implement fast sampling algorithms in biologically-plausible spiking networks. Here, we propose to leverage the population geometry, controlled by the neural code and the neural dynamics, to implement fast samplers in spiking neural networks. We first show that two classes of spiking samplers--efficient balanced spiking networks that simulate Langevin sampling, and networks with probabilistic spike rules that implement Metropolis-Hastings sampling--can be unified within a common framework. We then show that careful choice of population geometry, corresponding to the natural space of parameters, enables rapid inference of parameters drawn from strongly-correlated high-dimensional distributions in both networks. Our results suggest design prin-ciples for algorithms for sampling-based probabilistic inference in spiking neural networks, yielding potential inspiration for neuromorphic computing and testable predictions for neurobiology.

neuroscience↗

Functional imaging and quantification of multi-neuronal olfactory responses in C. elegans

Many animals perceive odorant molecules by collecting information from ensembles of olfactory neurons. Each neuron employs receptors that are tuned to recognize certain odorant molecules by chemical binding affinity. Olfactory systems are able, in principle, to detect and discriminate diverse odorants by using combinatorial coding strategies. Multineuronal imaging with high-throughput stimulus delivery allows comprehensive measurement of ensemble-level sensory representations. We have used microfluidics and multineuronal imaging to study ensemble-level olfactory representations at the sensory periphery of the nematode C. elegans. The collective activity of nematode chemosensory neurons reveals high-dimensional representations of olfactory information across a broad space of odorant molecules. We reveal diverse tuning properties and dose-response curves across chemosensory neurons and across odorants. We describe the unique contribution of each sensory neuron to an ensemble-level code for volatile odorants. We also show how natural stimuli, a set of nematode pheromones, are encoded by the sensory periphery. The integrated activity of the C. elegans chemosensory neurons contains sufficient information to robustly encode the intensity and identity of diverse chemical stimuli.

neuroscience↗

Normative and mechanistic model of an adaptive circuit for efficient encoding and feature extraction

One major question in neuroscience is how to relate connectomes to neural activity, circuit function, and learning. We offer an answer in the peripheral olfactory circuit of the Drosophila larva, composed of olfactory receptor neurons (ORNs) connected through feedback loops with interconnected inhibitory local neurons (LNs). We combine structural and activity data and, using a holistic normative framework based on similarity-matching, we propose a biologically plausible mechanistic model of the circuit. Our model predicts the ORN [->] LN synaptic weights found in the connectome and demonstrate that they reflect correlations in ORN activity patterns. Additionally, our model explains the relation between ORN [->] LN and LN - LN synaptic weight and the arising of different LN types. This global synaptic organization can autonomously arise through Hebbian plasticity, and thus allows the circuit to adapt to different environments in an unsupervised manner. Functionally, we propose LNs extract redundant input correlations and dampen them in ORNs, thus partially whitening and normalizing the stimulus representations in ORNs. Our work proposes a comprehensive framework to combine structure, activity, function, and learning, and uncovers a general and potent circuit motif that can learn and extract significant input features and render stimulus representations more efficient. SignificanceThe brain represents information with patterns of neural activity. At the periphery, due to the properties of the external world and of encoding neurons, these patterns contain correlations, which are detrimental for stimulus discrimination. We study the peripheral olfactory neural circuit of the Drosophila larva, that preprocesses neural representations before relaying them to higher brain areas. A comprehensive understanding of this preprocessing is, however, lacking. Here, we propose a mechanistic and normative framework describing the function of the circuit and predict the circuits synaptic organization based on the circuits input neural activity. We show how the circuit can autonomously adapt to different environments, extracts stimulus features, and decorrelate and normalize input representations, which facilitates odor discrimination downstream.

neuroscience↗

Coordinated drift of receptive fields during noisy representation learning

Long-term memories and learned behavior are conventionally associated with stable neuronal representations. However, recent experiments showed that neural population codes in many brain areas continuously change even when animals have fully learned and stably perform their tasks. This representational "drift" naturally leads to questions about its causes, dynamics, and functions. Here, we explore the hypothesis that neural representations optimize a representational objective with a degenerate solution space, and noisy synaptic updates drive the network to explore this (near-)optimal space causing representational drift. We illustrate this idea in simple, biologically plausible Hebbian/anti-Hebbian network models of representation learning, which optimize similarity matching objectives, and, when neural outputs are constrained to be nonnegative, learn localized receptive fields (RFs) that tile the stimulus manifold. We find that the drifting RFs of individual neurons can be characterized by a coordinated random walk, with the effective diffusion constants depending on various parameters such as learning rate, noise amplitude, and input statistics. Despite such drift, the representational similarity of population codes is stable over time. Our model recapitulates recent experimental observations in hippocampus and posterior parietal cortex, and makes testable predictions that can be probed in future experiments.

neuroscience↗

Population Codes Enable Learning from Few Examples By Shaping Inductive Bias

Learning from a limited number of experiences requires suitable inductive biases. To identify how inductive biases are implemented in and shaped by neural codes, we analyze sample-efficient learning of arbitrary stimulus-response maps from arbitrary neural codes with biologically-plausible readouts. We develop an analytical theory that predicts the generalization error of the readout as a function of the number of observed examples. Our theory illustrates in a mathematically precise way how the structure of population codes shapes inductive bias, and how a match between the code and the task is crucial for sample-efficient learning. We observe that many different codes can support the same inductive bias. By analyzing recordings from the mouse primary visual cortex, we demonstrate that biological codes have lower total activity than other codes with identical bias. Using these mouse primary visual cortex responses, we demonstrate the existence of an efficiency bias towards low frequency orientation discrimination tasks for grating stimuli and low spatial frequency reconstruction tasks for natural images. We reproduce the discrimination bias in a simple model of primary visual cortex, and further show how invariances in the code to certain stimulus variations alter learning performance. We extend our methods to time-dependent neural codes and predict the sample efficiency of readouts from recurrent networks. Finally, we discuss implications of our theory in the context of recent developments in neuroscience and artificial intelligence. Overall, our study provides a concrete method for elucidating inductive biases of the brain and promotes sample-efficient learning as a general normative coding principle.

neuroscience↗

Statistical structure of the trial-to-trial timing variability in synfire chains

Timing and its variability are crucial for behavior. Consequently, neural circuits that take part in the control of timing and in the measurement of temporal intervals have been the subject of much research. Here, we provide an analytical and computational account of the temporal variability in what is perhaps the most basic model of a timing circuit, the synfire chain. First, we study the statistical structure of trial-to-trial timing variability in a reduced but analytically tractable model: a chain of single integrate-and-fire neurons. We show that this circuits variability is well-described by a generative model consisting of local, global, and jitter components. We relate each of these components to distinct neural mechanisms in the model. Next, we establish in simulations that these results carry over to a noisy homogeneous synfire chain. Finally, motivated by the fact that a synfire chain is thought to underlie the circuit that takes part in the control and timing of zebra finch song, we present simulations of a biologically realistic synfire chain model of the zebra finch timekeeping circuit. We find the structure of trial-to-trial timing variability to be consistent with our previous findings, and to agree with experimental observations of the songs temporal variability. Our study therefore provides a possible neuronal account of behavioral variability in zebra finches.

neuroscience↗

Internal state configures olfactory behavior and early sensory processing in Drosophila larva

Animals exhibit different behavioral responses to the same sensory cue depending on their state at a given moment in time. How and where in the brain are sensory inputs combined with internal state information to select an appropriate behavior? Here we investigate how food deprivation affects olfactory behavior in Drosophila larvae. We find that certain odors reliably repel well-fed animals but attract food-deprived animals. We show that feeding state flexibly alters neural processing in the first olfactory center, the antennal lobe. Food deprivation differentially modulates two separate output pathways that are required for opposing behavioral responses. Uniglomerular projection neurons mediate odor attraction and show elevated odor-evoked activity in the food-deprived state. A multiglomerular projection neuron mediates odor aversion and receives odor-evoked inhibition in the food-deprived state. The switch between these two pathways is regulated by the lone serotonergic neuron in the antennal lobe, CSD. Our findings demonstrate how flexible behaviors can arise from state-dependent circuit dynamics in an early sensory processing center.

neuroscience↗

Manifold-tiling Localized Receptive Fields are Optimal in Similarity-preserving Neural Networks

Many neurons in the brain, such as place cells in the rodent hippocampus, have localized receptive fields, i.e., they respond to a small neighborhood of stimulus space. What is the functional significance of such representations and how can they arise? Here, we propose that localized receptive fields emerge in similarity-preserving networks of rectifying neurons that learn low-dimensional manifolds populated by sensory inputs. Numerical simulations of such networks on standard datasets yield manifold-tiling localized receptive fields. More generally, we show analytically that, for data lying on symmetric manifolds, optimal solutions of objectives, from which similarity-preserving networks are derived, have localized receptive fields. Therefore, nonnegative similarity-preserving mapping (NSM) implemented by neural networks can model representations of continuous manifolds in the brain.

neuroscience↗

A clustering neural network model of insect olfaction

A key step in insect olfaction is the transformation of a dense representation of odors in a small population of neurons - projection neurons (PNs) of the antennal lobe - into a sparse representation in a much larger population of neurons - Kenyon cells (KCs) of the mushroom body. What computational purpose does this transformation serve? We propose that the PN-KC network implements an online clustering algorithm which we derive from the k-means cost function. The vector of PN-KC synaptic weights converging onto a given KC represents the corresponding cluster centroid. KC activities represent attribution indices, i.e. the degree to which a given odor presentation is attributed to each cluster. Remarkably, such clustering view of the PN-KC circuit naturally accounts for several of its salient features. First, attribution indices are nonnegative thus rationalizing rectification in KCs. Second, the constraint on the total sum of attribution indices for each presentation is enforced by a Lagrange multiplier identified with the activity of a single inhibitory interneuron reciprocally connected with KCs. Third, the soft-clustering version of our algorithm reproduces observed sparsity and overcompleteness of the KC representation which may optimize supervised classification downstream.

neuroscience↗