bioRxiv Science⌕ Search

Biology subjects

Miller, K. D.

Publications and source records attributed to Miller, K. D..

26 records · Page 2Linked to original sources

Stabilized Supralinear Network: Model of Layer 2/3 of the Primary Visual Cortex

Electrophysiological recording in the primary visual cortex (V1) of mammals have revealed a number of complex interactions between the center and surround. Understanding the underlying circuit mechanisms is crucial to understanding fundamental brain computations. In this paper we address the following phenomena that have been observed in V1 of animals with orientation maps: 1) surround suppression that is accompanied by a decrease in the excitatory and inhibitory currents that the cell receives as the stimulus size increases beyond the cells summation field; 2) surround tuning to the center orientation, in which the strongest suppression arises when the surround orientation matches that of the center stimulus; and 3) feature-specific suppression, in which a surround stimulus of a given orientation specifically suppresses that orientations component of the response to a center plaid stimulus. We show that a stabilized supralinear network that has biologically plausible connectivity and synaptic efficacies that depend on cortical distance and orientation difference between neurons can consistently reproduce all the above phenomena. We explain the mechanism behind each result, and argue that feature-specific suppression and surround tuning to the center orientation are independent phenomena. Specifically, if we remove some aspects of the connectivity from the model it will still produce feature-specific suppression but not surround tuning to the center orientation. We also show that in the model the activity decay time constant is similar to the cortical activity decay time constant reported in mouse V1. Our model indicates that if the surround activates neurons that fall within the reach of the horizontal projections in V1, the above mentioned phenomena can be generated by V1 alone without the need of cortico-cortical feedback. Finally, we show that these results hold both in networks with rate-based units and with conductance-based spiking units. This demonstrates that the stabilized supra-linear network mechanism can be achieved in the more biological context of spiking networks.

neuroscience↗

Generalized paradoxical effects in excitatory/inhibitory networks

An inhibition-stabilized network (ISN) is a network of excitatory and inhibitory cells at a stable fixed point of firing rates for a given input, for which the excitatory subnetwork would be unstable if inhibitory rates were frozen at their fixed point values. It has been shown that in a low-dimensional model (one unit per neuronal subtype) of an ISN with a single excitatory and single inhibitory cell type, the inhibitory unit shows a "paradoxical" response, lowering (raising) its steady-state firing rate in response to addition to it of excitatory (inhibitory) input. This has been generalized to an ISN with multiple inhibitory cell types: if input is given only to inhibitory cells, the steady-state inhibition received by excitatory cells changes paradoxically, that is, it decreases (increases) if the steady-state excitatory firing rates decrease (increase). We generalize these analyses of paradoxical effects to low-dimensional networks with multiple cell types of both excitatory and inhibitory neurons. The analysis depends on the connectivity matrix of the network linearized about a given fixed point, and its eigenvectors or "modes". We show the following: (1) A given cell type shows a paradoxical change in steady-state rate in response to input it receives, if and only if the network with that cell type omitted has an odd number of unstable modes. Excitatory neurons can show paradoxical responses when there are two or more inhibitory subtypes. (2) More generally, if the cell types are divided into two nonoverlapping subsets A and B, then subset B has an odd (even) number of modes that show paradoxical response if and only if subset A has an odd (even) number of unstable modes. (3) The net steady-state inhibition received by any unstable mode of the excitatory subnetwork will change paradoxically, i.e. in the same direction as the change in amplitude of that mode. In particular, this means that a sufficient condition to determine that a network is an ISN is if, in response to an input only to inhibitory cells, the firing rates of and inhibition received by all excitatory cell types all change in the same direction. This in turn will be true if all E cells and all inhibitory cell types that connect to E cells change their firing rates in the same direction.

neuroscience↗

A Disinhibitory Circuit for Contextual Modulation in Primary Visual Cortex

Context guides perception by influencing the saliency of sensory stimuli. Accordingly, in visual cortex, responses to a stimulus are modulated by context, the visual scene surrounding the stimulus. Responses are suppressed when stimulus and surround are similar but not when they differ. The mechanisms that remove suppression when stimulus and surround differ remain unclear. Here we use optical recordings, manipulations, and computational modelling to show that a disinhibitory circuit consisting of vasoactive-intestinal-peptide-expressing (VIP) and somatostatin-expressing (SOM) inhibitory neurons modulates responses in mouse visual cortex depending on the similarity between stimulus and surround. When the stimulus and the surround are similar, VIP neurons are inactive and SOM neurons suppress excitatory neurons. However, when the stimulus and the surround differ, VIP neurons are active, thereby inhibiting SOM neurons and relieving excitatory neurons from suppression. We have identified a canonical cortical disinhibitory circuit which contributes to contextual modulation and may regulate perceptual saliency.

neuroscience↗

A simple circuit model of visual cortex explains neural and behavioral aspects of attention

Selective visual attention modulates neural activity in the visual system in complex ways and leads to enhanced performance on difficult visual tasks. Here, we show that a simple circuit model, the stabilized supralinear network, gives a unified account of a wide variety of effects of attention on neural responses. We replicate results from studies of both feature and spatial attention, addressing findings in a variety of experimental paradigms on changes both in firing rates and in correlated neural variability. Finally, we expand this circuit model into an architecture that can perform visual tasks--a convolutional neural network--in order to show that these neural effects can enhance detection performance. This work provides the first unified mechanistic account of the effects of attention on neural and behavioral responses.

neuroscience↗

Interrogating theoretical models of neural computation with deep inference

1A cornerstone of theoretical neuroscience is the circuit model: a system of equations that captures a hypothesized neural mechanism. Such models are valuable when they give rise to an experimentally observed phenomenon - whether behavioral or a pattern of neural activity - and thus can offer insights into neural computation. The operation of these circuits, like all models, critically depends on the choice of model parameters. A key step is then to identify the model parameters consistent with observed phenomena: to solve the inverse problem. In this work, we present a novel technique, emergent property inference (EPI), that brings the modern probabilistic modeling toolkit to theoretical neuroscience. When theorizing circuit models, theoreticians predominantly focus on reproducing computational properties rather than a particular dataset. Our method uses deep neural networks to learn parameter distributions with these computational properties. This methodology is introduced through a motivational example inferring conductance parameters in a circuit model of the stomatogastric ganglion. Then, with recurrent neural networks of increasing size, we show that EPI allows precise control over the behavior of inferred parameters, and that EPI scales better in parameter dimension than alternative techniques. In the remainder of this work, we present novel theoretical findings gained through the examination of complex parametric structure captured by EPI. In a model of primary visual cortex, we discovered how connectivity with multiple inhibitory subtypes shapes variability in the excitatory population. Finally, in a model of superior colliculus, we identified and characterized two distinct regimes of connectivity that facilitate switching between opposite tasks amidst interleaved trials, characterized each regime via insights afforded by EPI, and found conditions where these circuit models reproduce results from optogenetic silencing experiments. Beyond its scientific contribution, this work illustrates the variety of analyses possible once deep learning is harnessed towards solving theoretical inverse problems.

neuroscience↗

Understanding Biological Visual Attention Using Convolutional Neural Networks

How does attentional modulation of neural activity enhance performance? Here we use a deep convolutional neural network as a large-scale model of the visual system to address this question. We model the feature similarity gain model of attention, in which attentional modulation is applied according to neural stimulus tuning. Using a variety of visual tasks, we show that neural modulations of the kind and magnitude observed experimentally lead to performance changes of the kind and magnitude observed experimentally. We find that, at earlier layers, attention applied according to tuning does not successfully propagate through the network, and has a weaker impact on performance than attention applied according to values computed for optimally modulating higher areas. This raises the question of whether biological attention might be applied at least in part to optimize function rather than strictly according to tuning. We suggest a simple experiment to distinguish these alternatives.

neuroscience↗

A unifying motif for spatial and directional surround suppression

In the visual system, the response to a stimulus in a neurons receptive field can be modulated by stimulus context, and the strength of these contextual influences vary with stimulus intensity. Recent work has shown how a theoretical model, the stabilized supralinear network (SSN), can account for such modulatory influences, using a small set of computational mechanisms. While the predictions of the SSN have been confirmed in primary visual cortex (V1), its computational principles apply with equal validity to any cortical structure. We have therefore tested the generality of the SSN by examining modulatory influences in the middle temporal area (MT) of the macaque visual cortex, using electrophysiological recordings and pharmacological manipulations. We developed a novel stimulus that can be adjusted parametrically to be larger or smaller in the space of all possible motion directions. We found, as predicted by the SSN, that MT neurons integrate across motion directions for low-contrast stimuli, but that they exhibit suppression by the same stimuli when they are high in contrast. These results are analogous to those found in visual cortex when stimulus size is varied in the space domain. We further tested the mechanisms of inhibition using pharmacologically manipulations of inhibitory efficacy. As predicted by the SSN, local manipulation of inhibitory strength altered firing rates, but did not change the strength of surround suppression. These results are consistent with the idea that the SSN can account for modulatory influences along different stimulus dimensions and in different cortical areas.\n\nSignificance StatementVisual neurons are selective for specific stimulus features in a region of visual space known as the receptive field, but can be modulated by stimuli outside of the receptive field. The SSN model has been proposed to account for these and other modulatory influences, and tested in V1. As this model is not specific to any particular stimulus feature or brain region, we wondered whether similar modulatory influences might be observed for other stimulus dimensions and other regions. We tested for specific patterns of modulatory influences in the domain of motion direction, using electrophysiological recordings from MT. Our data confirm the predictions of the SSN in MT, suggesting that the SSN computations might be a generic feature of sensory cortex.

neuroscience↗

Stabilized supralinear network dynamics account for stimulus-induced changes of noise variability in the cortex

Variability and correlations in cortical activity are ubiquitously modulated by stimuli. Correlated variability is quenched following stimulus onset across multiple cortical areas, suppressing low-frequency components of the LFP and of Vm-LFP coherence. Modulation of Fano factors and correlations in area MT is tuned for stimulus direction. What circuit mechanisms underly these behaviors? We show that a simple model circuit, the stochastic Stabilized Supralinear Network (SSN), robustly explains these results. Stimuli modulate variability by modifying two forms of effective connectivity between activity patterns that characterize excitatory-inhibitory (E/I) circuits. Increases in the strength with which activity patterns inhibit themselves reduce correlated variability, while increases in feedforward connections between patterns (transforming E/I imbalance into balanced fluctuations) increase variability. These results suggest an operating regime of cortical dynamics that involves fast fluctuations and fast responses to stimulus changes, unlike previous models of variability suppression through suppression of chaos or networks with multiple attractors.

neuroscience↗