bioRxiv Science⌕ Search

Biology subjects

Brody, C. D.

Publications and source records attributed to Brody, C. D..

At least 19 recordsLinked to original sources

Working memory expands shared task representations in cortex

Cognition is thought to emerge from the flexible organization of neural activity, yet how this organization reconfigures across behaviors varying in cognitive load remains unclear. We investigated how the structure of working-memory representations in the cortex compares to task representations that do not involve working memory. We used a task-switching paradigm in virtual reality, where mice alternated between a navigation-based working-memory task and a simpler task with matched sensorimotor demands. During behavior, we simultaneously imaged three cortical areas: higher visual area AM, and two association areas--premotor (M2) and retrosplenial cortex. At the single-neuron level, trial-averaged activity appeared similar across tasks. However, pairwise correlations decreased during the working-memory task, particularly in association areas. In addition, the corresponding linear task subspace explained the variance of both tasks equally well, whereas the simpler task subspace failed to do so, suggesting an asymmetric relationship between them. Nonlinear dimensionality reduction revealed a shared low-dimensional structure across tasks. Yet, the organization of neuronal firing fields along this shared structure accounted for the difference in pairwise correlations: in the working-memory task, firing fields were more disjoint, especially among neurons in association areas that formed sequences along the memory dimension. Moreover, the degree of overlap between these firing fields predicted the mices behavioral reliance on working memory. We conclude that behaviors varying in cognitive demands are supported by a single low-dimensional neural structure, which can expand or contract depending on cognitive load. We thus provide a framework for how task representations across the cortex reconfigure to support cognitive processes.

neuroscience↗

FixGrower: An efficient and robust curriculum for shaping fixation behavior in rodents

Center-port fixation is a common prerequisite for many freely-moving rodent tasks in neuroscience and psychology. However, typical protocols for shaping this behavior are non-standardized and inefficient. Moreover, motor errors in fixation termed violations often account for a significant fraction of experimental trials, leading to notable data loss during experiments. In light of this, we developed FixGrower, a standardized protocol for center-port fixation training. FixGrower (1) requires a longer initial fixation requirement, (2) increases the required fixation duration at session boundaries customized to each animals performance, and (3) delays the introduction of violation penalties until the end of training. We demonstrate FixGrower decreases training time by 61%, yields low violation rates, and generalizes across rodent species and task difficulty. Moreover, the success of this curriculum is well supported by theories of operant conditioning and reinforcement learning. Our findings establish FixGrower as an efficient and broadly applicable curriculum for training fixation behavior in rodents, thereby accelerating training of many tasks in the field.

animal behavior and cognition↗

Coordinated cross-brain activity during accumulation of sensory evidence and decision commitment

Decision-making is thought to involve two phases: first, evidence accumulation, then, decision commitment. Accumulation is represented broadly in the brain, but whether this best matches single versus multiple accumulator models is unknown. Here, analysis of simultaneous, bilateral recordings across sensory, association, and motor regions, in both cortex and subcortical structures, strongly supports a single accumulator, and suggests that accumulated noise (diffusion) originates frontally. Decision commitment can occur internally, without an overt report. Long-standing competing models of covert commitment disagree as to whether it is abrupt or continuous. Temporally aligning data on a single-trial estimator of internal, covert commitment ("nTc") revealed a rapid ([≤]50 ms) drop in the accumulators sensitivity to incoming sensory evidence, favoring abrupt transition models, and indicating a discrete cross-brain state change at nTc that was first detectable in motor regions. These data discriminate between decades-old models of accumulation, and between decades-old models of the transition to commitment.

neuroscience↗

To integrate or not to integrate: Testing degenerate strategies for solving an accumulation of perceptual evidence decision-making task

A common approach in the study of cognition is to train subjects to perform a task that requires a particular cognitive process to solve. Analysis of the subjects response behavior while they perform these tasks can offer valuable insight into the underlying mechanisms that give rise to cognition. However, if subjects are able to accurately perform such a task by using a strategy that doesnt involve the targeted cognitive process, data from those experiments becomes more difficult to interpret. A number of perceptual decision-making tasks have been designed to study the accumulation of evidence, i.e. how noisy information presented over time is used to form a decision. Recent work, however, has highlighted how a variety of non-integration strategies can by some measures yield strikingly near-optimal performance on such tasks, raising the possibility that past conclusions from these experiments may be incorrect. Here we assemble the largest data set of animals performing one such task - the "Poisson Clicks" task - which is optimally solved by the gradual integration of pulsatile auditory noise. To investigate whether rats are in fact using this strategy, we compiled data from 515 rats performing over 35 million trials. We compare performance of 3 degenerate strategies (that circumvent the need to integrate evidence) to the optimal (integration) strategy. We demonstrate that the pulsatile nature of the stimuli used in the Poisson Clicks Task makes it possible to distinguish which strategy subjects use. Overwhelmingly, we find the rats are using an integration strategy when performing the Poisson Clicks Task.

animal behavior and cognition↗

Disentangling the Roles of Distinct Cell Classes with Cell-Type Dynamical Systems

Latent dynamical systems have been widely used to characterize the dynamics of neural population activity in the brain. However, these models typically ignore the fact that the brain contains multiple cell types. This limits their ability to capture the functional roles of distinct cell classes, and to predict the effects of cell-specific perturbations on neural activity or behavior. To overcome these limitations, we introduce the "cell-type dynamical systems" (CTDS) model. This model extends latent linear dynamical systems to contain distinct latent variables for each cell class, with biologically inspired constraints on both dynamics and emissions. To illustrate our approach, we consider neural recordings with distinct excitatory (E) and inhibitory (I) populations. The CTDS model defines separate latents for both cell types, and constrains the dynamics so that E (I) latents have a strictly positive (negative) effects on other latents. We applied CTDS to recordings from rat frontal orienting fields (FOF) and anterior dorsal striatum (ADS) during an auditory decision-making task. The model achieved higher accuracy than a standard linear dynamical system (LDS), and revealed that the animals choice can be decoded from both E and I latents and thus is not restricted to a single cell-class. We also performed in-silico optogenetic perturbation experiments in the FOF and ADS, and found that CTDS was able to replicate the experimentally observed effects of different perturbations on behavior, whereas a standard LDS model--which does not differentiate between cell types--did not. Crucially, our model allowed us to understand the effects of these perturbations by revealing the dynamics of different cell-specific latents. Finally, CTDS can also be used to identify cell types for neurons whose class labels are unknown in electrophysiological recordings. These results illustrate the power of the CTDS model to provide more accurate and more biologically interpretable descriptions of neural population dynamics and their relationship to behavior.

neuroscience↗

A multi-region recurrent circuit for evidence accumulation in rats

Decision-making based on noisy evidence requires accumulating evidence and categorizing it to form a choice. Here we evaluate a proposed feedforward and modular mapping of this process in rats: evidence accumulated in anterodorsal striatum (ADS) is categorized in prefrontal cortex (frontal orienting fields, FOF). Contrary to this, we show that both regions appear to be indistinguishable in their encoding/decoding of accumulator value and communicate this information bidirectionally. Consistent with a role for FOF in accumulation, silencing FOF to ADS projections impacted behavior throughout the accumulation period, even while nonselective FOF silencing did not. We synthesize these findings into a multi-region recurrent neural network trained with a novel approach. In-silico experiments reveal that multiple scales of recurrence in the cortico-striatal circuit rescue computation upon nonselective FOF perturbations. These results suggest that ADS and FOF accumulate evidence in a recurrent and distributed manner, yielding redundant representations and robustness to certain perturbations.

neuroscience↗

A cognitive process model captures near-optimal confidence-guided waiting in rats

Rational decision-makers invest more time pursuing rewards they are more confident they will eventually receive. A series of studies have therefore used willingness to wait for delayed rewards as a proxy for decision confidence. However, interpretation of waiting behavior is limited because it is unclear how environmental statistics influence optimal waiting, and how sources of internal variability influence subjects behavior. We trained rats to perform a confidence-guided waiting task, and derived expressions for optimal waiting that make relevant environmental statistics explicit, including travel time incurred traveling from one reward opportunity to another. We found that rats waited longer than fully optimal agents, but that their behavior was closely matched by optimal agents with travel times constrained to match their own. We developed a process model describing the decision to stop waiting as an accumulation to bound process, which allowed us to compare the effects of multiple sources of internal variability on waiting. Surprisingly, although mean wait times grew with confidence, variability did not, inconsistent with scalar invariant timing, and best explained by variability in the stopping bound. Our results describe a tractable process model that can capture the influence of environmental statistics and internal sources of variability on subjects decision process during confidence-guided waiting.

animal behavior and cognition↗

Dynamic reinforcement learning reveals time-dependent shifts in strategy during reward learning.

Different brain systems have been hypothesized to subserve multiple "experts" that compete to generate behavior. In reinforcement learning, two general processes, one model-free (MF) and one model-based (MB), are often modeled as a mixture of agents (MoA) and hypothesized to capture differences between automaticity vs. deliberation. However, shifts in strategy cannot be captured by a static MoA. To investigate such dynamics, we present the mixture-of-agents hidden Markov model (MoA-HMM), which simultaneously learns inferred action values from a set of agents and the temporal dynamics of underlying "hidden" states that capture shifts in agent contributions over time. Applying this model to a multi-step, reward-guided task in rats reveals a progression of within-session strategies: a shift from initial MB exploration to MB exploitation, and finally to reduced engagement. The inferred states predict changes in both response time and OFC neural encoding during the task, suggesting that these states are capturing real shifts in dynamics.

neuroscience↗

Flow-field inference from neural data using deep recurrent networks

Computations involved in processes such as decision-making, working memory, and motor control are thought to emerge from the dynamics governing the collective activity of neurons in large populations. But the estimation of these dynamics remains a significant challenge. Here we introduce Flow-field Inference from Neural Data using deep Recurrent networks (FINDR), an unsupervised deep learning method that can infer low-dimensional nonlinear stochastic dynamics underlying neural population activity. Using population spike train data from frontal brain regions of rats performing an auditory decision-making task, we demonstrate that FINDR outperforms existing methods in capturing the heterogeneous responses of individual neurons. We further show that FINDR can discover interpretable low-dimensional dynamics when it is trained to disentangle task-relevant and irrelevant components of the neural population activity. Importantly, the low-dimensional nature of the learned dynamics allows for explicit visualization of flow fields and attractor structures. We suggest FINDR as a powerful method for revealing the low-dimensional task-relevant dynamics of neural populations and their associated computations.

neuroscience↗

A new theoretical framework jointly explains behavioral and neural variability across subjects performing flexible decision-making

The ability to flexibly switch our response to external stimuli according to contextual information is critical for successful interactions with a complex world. Context-dependent computations are necessary across many domains1-3, yet their neural implementations remain poorly understood. Here we developed a novel behavioral task in rats to study context-dependent selection and accumulation of evidence for decision-making4-6. Under assumptions supported by both monkey and rat data, we first show mathematically that a network can solve this problem through a combination of three defined components. These components can be identified and tested directly with experimental data. We further show that existing electrophysiological and modeling data are compatible with the full variety of possible combinations of these components, suggesting that different individuals could use different component combinations. To study variability across individual subjects, we developed automated, high-throughput methods to train rats on our task, and we trained many subjects on it. Consistent with theoretical predictions, neural and behavioral analyses revealed substantial heterogeneity across rats, despite uniformly good task performance. Our theory further predicts a specific link between behavioral and neural signatures, which was robustly supported in the data. In summary, our results provide a new experimentally-supported theoretical framework to analyze individual variability in biological and artificial systems performing flexible decision-making tasks, they open the door to cellular-resolution studies of individual variability in higher cognition, and they provide insights into neural mechanisms of context-dependent computation more generally.

neuroscience↗

Limitations of a proposed correction for slow drifts in decision criterion

Trial history biases in decision-making tasks are thought to reflect systematic updates of decision variables, therefore their precise nature informs conclusions about underlying heuristic strategies and learning processes. However, random drifts in decision variables can corrupt this inference by mimicking the signatures of systematic updates. Hence, identifying the trial-by-trial evolution of decision variables requires methods that can robustly account for such drifts. Recent studies (Lak20, Mendonca 20) have made important advances in this direction, by proposing a convenient method to correct for the influence of slow drifts in decision criterion, a key decision variable. Here we apply this correction to a variety of updating scenarios, and evaluate its performance. We show that the correction fails for a wide range of commonly assumed systematic updating strategies, distorting ones inference away from the veridical strategies towards a narrow subset. To address these limitations, we propose a model-based approach for disambiguating systematic updates from random drifts, and demonstrate its success on real and synthetic datasets. We show that this approach accurately recovers the latent trajectory of drifts in decision criterion as well as the generative systematic updates from simulated data. Our results offer recommendations for methods to account for the interactions between history biases and slow drifts, and highlight the advantages of incorporating assumptions about the generative process directly into models of decision-making.

neuroscience↗

Subpopulations of neurons in lOFC encode previous and current rewards at time of choice

1Studies of neural dynamics in lateral orbitofrontal cortex (lOFC) have shown that subsets of neurons that encode distinct aspects of behavior, such as value, may project to common downstream targets. However, it is unclear whether reward history, which may subserve lOFCs well-documented role in learning, is represented by functional subpopulations in lOFC. Previously, we analyzed neural recordings from rats performing a value-based decision-making task, and we documented trial-by-trial learning that required lOFC (Constantinople et al., 2019). Here we characterize functional subpopulations of lOFC neurons during behavior, including their encoding of task variables. We found five distinct clusters of lOFC neurons, either based on clustering of their trial-averaged peristimulus time histograms (PSTHs), or a feature space defined by their average conditional firing rates aligned to different task variables. We observed weak encoding of reward attributes, but stronger encoding of reward history, the animals left or right choice, and reward receipt across all clusters. Only one cluster, however, encoded the animals reward history at the time shortly preceding the choice, suggesting a possible role in integrating previous and current trial outcomes at the time of choice. This cluster also exhibits qualitatively similar responses to identified corticostriatal projection neurons in a recent study (Hirokawa et al., 2019), and suggests a possible role for subpopulations of lOFC neurons in mediating trial-by-trial learning.

neuroscience↗

Amplitude modulations of sensory responses, and deviations from Weber's Law in pulsatile evidence accumulation

How do animals make behavioral decisions based on noisy sensory signals, which are moreover a tiny fraction of ongoing activity in the brain? Some theories suggest that sensory responses should be accumulated through time to reduce noise. Others suggest that feedback-based gain control of sensory responses allow small signals to be selectively amplified to drive behavior. We recorded from neuronal populations across posterior cortex as mice performed a decision-making task based on accumulating randomly timed pulses of visual evidence. Here we focus on a subset of neurons, with putative sensory responses that were time-locked to each pulse. These neurons exhibited a variety of amplitude (gain-like) modulations, notably by choice and accumulated evidence. These neural data inspired a hypothetical accumulation circuit with a multiplicative feedback-loop architecture, which parsimoniously explains deviations in perceptual discrimination from Weber-Fechner Law. Our neural observations thus led to a model that synthesizes both accumulation and feedback hypotheses.

neuroscience↗

Extracting the Dynamics of Behavior in Decision-Making Experiments

Understanding how animals update their decision-making behavior over time is an important problem in neuroscience. Decision-making strategies evolve over the course of learning, and continue to vary even in well-trained animals. However, the standard suite of behavioral analysis tools is ill-equipped to capture the dynamics of these strategies. Here, we present a flexible method for characterizing time-varying behavior during decision-making experiments. We show that it successfully captures trial-to-trial changes in an animals sensitivity to not only task-relevant stimuli, but also task-irrelevant covariates such as choice, reward, and stimulus history. We use this method to derive insights from training data collected in mice, rats, and human subjects performing auditory discrimination and visual detection tasks. With this approach, we uncover the detailed evolution of an animals strategy during learning, including adaptation to time-varying task statistics, suppression of sub-optimal strategies, and shared behavioral dynamics between subjects within an experimental population.

neuroscience↗

An approach for long-term, multi-probe Neuropixels recordings in unrestrained rats

The use of Neuropixels probes for chronic neural recordings is in its infancy and initial studies leave questions about long-term stability and probe reusability unaddressed. Here we demonstrate a new approach for chronic Neuropixels recordings over a period of months in freely moving rats. Our approach allows multiple probes per rat and multiple cycles of probe reuse. We found that hundreds of units could be recorded for multiple months, but that yields depended systematically on anatomical position. Explanted probes displayed a small increase in noise compared to unimplanted probes, but this was insufficient to impair future single-unit recordings. We conclude that cost-effective, multi-region, and multi-probe Neuropixels recordings can be carried out with high yields over multiple months in rats or other similarly sized animals. Our methods and observations may facilitate the standardization of chronic recording from Neuropixels probes in freely moving animals.

neuroscience↗

Interrogating theoretical models of neural computation with deep inference

1A cornerstone of theoretical neuroscience is the circuit model: a system of equations that captures a hypothesized neural mechanism. Such models are valuable when they give rise to an experimentally observed phenomenon - whether behavioral or a pattern of neural activity - and thus can offer insights into neural computation. The operation of these circuits, like all models, critically depends on the choice of model parameters. A key step is then to identify the model parameters consistent with observed phenomena: to solve the inverse problem. In this work, we present a novel technique, emergent property inference (EPI), that brings the modern probabilistic modeling toolkit to theoretical neuroscience. When theorizing circuit models, theoreticians predominantly focus on reproducing computational properties rather than a particular dataset. Our method uses deep neural networks to learn parameter distributions with these computational properties. This methodology is introduced through a motivational example inferring conductance parameters in a circuit model of the stomatogastric ganglion. Then, with recurrent neural networks of increasing size, we show that EPI allows precise control over the behavior of inferred parameters, and that EPI scales better in parameter dimension than alternative techniques. In the remainder of this work, we present novel theoretical findings gained through the examination of complex parametric structure captured by EPI. In a model of primary visual cortex, we discovered how connectivity with multiple inhibitory subtypes shapes variability in the excitatory population. Finally, in a model of superior colliculus, we identified and characterized two distinct regimes of connectivity that facilitate switching between opposite tasks amidst interleaved trials, characterized each regime via insights afforded by EPI, and found conditions where these circuit models reproduce results from optogenetic silencing experiments. Beyond its scientific contribution, this work illustrates the variety of analyses possible once deep learning is harnessed towards solving theoretical inverse problems.

neuroscience↗

Orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases

Individual choices are not made in isolation but are embedded in a series of past experiences, decisions, and outcomes. The effects of past experiences on choices, often called sequential biases, are ubiquitous in perceptual and value-based decision-making, but their neural substrates are unclear. We trained rats to choose between explicitly cued guaranteed and probabilistic rewards in a task in which outcomes on each trial were independent. Behavioral variability often reflected the effects of previous trials, including increased willingness to take risks following risky wins, and spatial \"win-stay/lose-shift\" biases. Electrophysiological recordings from lateral orbitofrontal cortex (lOFC) revealed strong encoding of reward history and receipt, and optogenetic inhibition of lOFC during choice reporting eliminated rats increased preference for risk on subsequent trials following risky wins, but spared other sequential effects. Our data show that different sequential biases are neurally dissociable, and that the lOFCs role in adaptive behavior promotes learning of more abstract, task-specific biases (here, biases for the risky option), but not spatial ones. These data are consistent with proposals that the OFC represents the animals location in an abstract representation of task states, and highlight the lOFCs role in learning.

neuroscience↗

From predictive models to cognitive models: An analysis of rat behavior in the two-armed bandit task

Cognitive models are a fundamental tool in computational neuroscience, embodying in software precise hypotheses about the algorithms by which the brain gives rise to behavior. The development of such models is often a hypothesis-first process, drawing on inspiration from the literature and the creativity of the individual researcher to construct a model, and afterwards testing the model against experimental data. Here, we adopt a complementary approach, in which richly characterizing and summarizing the patterns present in a dataset reveals an appropriate cognitive model, without recourse to an a priori hypothesis. We apply this approach to a large behavioral dataset from rats performing a dynamic reward learning task. The revealed model suggests that behavior in this task can be understood as a mixture of three components with different timescales: a quick-learning reward-seeking component, a slower-learning perseverative component, and a very slow "gamblers fallacy" component.

animal behavior and cognition↗