bioRxiv Science⌕ Search

Biology subjects

Brackbill, N.

Publications and source records attributed to Brackbill, N..

13 recordsLinked to original sources

Cell-type specific repertoire of responses to natural scenes in primate retinal ganglion cells

At least 20 distinct retinal ganglion cells (RGC) types have been identified morphologically in the primate retina, but our understanding of the distinctive visual messages they send to various targets in the brain remains limited. Here, we use large-scale multi-electrode array recordings to examine how multiple functionally-distinct RGC types in the macaque retina respond to flashed natural images. Responses to white noise visual stimulation were used to functionally identify 936 RGCs of 12 types in three recordings. Each cell type was confirmed by the mosaic organization of receptive fields, and 7 cell types were cross-identified between recordings. The average kinetics of light response in each RGC type as well as the repertoire of distinct firing patterns that each type produces were examined across thousands of natural images. The kinetics of the average response across images were highly stereotyped among cells of each cell type and distinct for cells of different types. Moreover, the full repertoires of firing patterns produced by different cell types, assessed by their latency and duration, were generally quite distinct with only a few exceptions. Together these data provide an overview of the range of responses to natural images transmitted from the primate retina to the brain.

neuroscience↗

Functional diversity in the output of the primate retina

The visual image transmitted by the retina to the brain has long been understood in terms of spatial filtering by the center-surround receptive fields of retinal ganglion cells (RGCs). Recently, this textbook view has been challenged by the stunning functional diversity and specificity observed in [~]40 distinct RGC types in the mouse retina. However, it is unclear whether the [~]20 morphologically and molecularly identified RGC types in primates exhibit similar functional diversity, or instead exhibit center-surround organization at different spatial scales. Here, we reveal striking and surprising functional diversity in macaque and human RGC types using large-scale multi-electrode recordings from isolated macaque and human retinas. In addition to the five well-known primate RGC types, 18-27 types were distinguished by their functional properties, likely revealing several previously unknown types. Surprisingly, many of these cell types exhibited striking non-classical receptive field structure, including irregular spatial and chromatic properties not previously reported in any species. Qualitatively similar results were observed in recordings from the human retina. The receptive fields of less-understood RGC types formed uniform mosaics covering visual space, confirming their classification, and the morphological counterparts of two types were established using single-cell recording. The striking receptive field diversity was paralleled by distinctive responses to natural movies and complexity of visual computation. These findings suggest that diverse RGC types, rather than merely filtering the scene at different spatial scales, instead play specialized roles in human vision.

neuroscience↗

Decomposition of retinal ganglion cell electrical images for cell type and functional inference

ObjectiveIdentifying neuronal cell types and their biophysical properties based on their extracellular electrical features is a major challenge for experimental neuroscience and for the development of high-resolution brain-machine interfaces. One example is identification of retinal ganglion cell (RGC) types and their visual response properties, which is fundamental for developing future electronic implants that can restore vision. ApproachThe electrical image (EI) of a RGC, or the mean spatio-temporal voltage footprint of its recorded spikes on a high-density electrode array, contains substantial information about its anatomical, morphological, and functional properties. However, the analysis of these properties is complex because of the high-dimensional nature of the EI. We present a novel optimization-based algorithm to decompose electrical image into a low-dimensional, biophysically-based representation: the temporally-shifted superposition of three learned basis waveforms corresponding to spike waveforms produced in the somatic, dendritic and axonal cellular compartments. ResultsThe decomposition was evaluated using large-scale multi-electrode recordings from the macaque retina. The decomposition accurately localized the somatic and dendritic compartments of the cell. The imputed dendritic fields of RGCs correctly predicted the location and shape of their visual receptive fields. The inferred waveform amplitudes and shapes accurately identified the four major primate RGC types (ON and OFF midget and parasol cells) substantially more accurately than previous approaches. SignificanceThese findings contribute to more accurate inference of RGC types and their original light responses based purely on their electrical features, with potential implications for vision restoration technology.

neuroscience↗

Fixational Eye Movements Enhance the Precision of Visual Information Transmitted by the Primate Retina

Fixational eye movements alter the number and timing of spikes transmitted from the retina to the brain, but whether these changes enhance or degrade the retinal signal is unclear. To quantify this, we developed a Bayesian method for reconstructing natural images from the recorded spikes of hundreds of retinal ganglion cells (RGCs) in the macaque retina (male), combining a likelihood model for RGC light responses with the natural image prior implicitly embedded in an artificial neural network optimized for denoising. The method matched or surpassed the performance of previous reconstruction algorithms, and provides an interpretable framework for characterizing the retinal signal. Reconstructions were improved with artificial stimulus jitter that emulated fixational eye movements, even when the eye movement trajectory was assumed to be unknown and had to be inferred from retinal spikes. Reconstructions were degraded by small artificial perturbations of spike times, revealing more precise temporal encoding than suggested by previous studies. Finally, reconstructions were substantially degraded when derived from a model that ignored cell-to-cell interactions, indicating the importance of stimulusevoked correlations. Thus, fixational eye movements enhance the precision of the retinal representation.

neuroscience↗

Inferring light responses of primate retinal ganglion cells using intrinsic electrical signatures

Reproducing high-acuity vision with an epiretinal implant will likely require inferring the natural light responses of diverse RGC types in the implanted retina, without measuring them directly. Here we demonstrate an approach that exploits intrinsic electrical features of primate RGCs. First, ON-parasol and OFF-parasol RGCs were identified with 95% accuracy using electrical features. Then, the somatic electrical footprint, predicted cell type, and average linear-nonlinear-Poisson model parameters of each cell type were used to infer a light response model for each cell. Across five retinas, these models achieved an average correlation with measured firing rates of 0.49 for white noise visual stimuli and 0.50 for natural scenes stimuli, compared to 0.65 and 0.58 respectively for models fitted to recorded light responses, an upper bound. This finding, and linear decoding of images from predicted RGC activity, suggested that the inference approach may be useful for high-fidelity sight restoration.

neuroscience↗

Individual variability of neural computations in the primate retina

Variation in the neural code contributes to making each individual unique. We probed neural code variation using [~]100 neural population recordings from major ganglion cell types in the macaque retina, combined with an interpretable computational representation of individual variability using machine learning. This representation captured individual variation and covariation in properties such as nonlinearity, temporal dynamics, and spatial receptive field size, while preserving invariances, such as asymmetries between ON and OFF cells. The covariation of response properties in different cell types was associated with the proximity of lamination of their synaptic inputs. Surprisingly, male retinas exhibited higher firing rates and faster temporal integration than female retinas. Exploiting data from previously recorded macaque retinas enabled efficient characterization of a new macaque retina, and of a human retina. Simulations indicated that combining a vast dataset of healthy macaque recordings with behavioral feedback could be used to identify the neural code and thus improve retinal implants for vision restoration.

neuroscience↗

Nonlinear decoding of natural images from large-scale primate retinal ganglion recordings

Decoding sensory stimuli from neural activity can provide insight into how the nervous system might interpret the physical environment, and facilitates the development of brain-machine interfaces. Nevertheless, the neural decoding problem remains a significant open challenge. Here, we present an efficient nonlinear decoding approach for inferring natural scene stimuli from the spiking activities of retinal ganglion cells (RGCs). Our approach uses neural networks to improve upon existing decoders in both accuracy and scalability. Trained and validated on real retinal spike data from > 1000 simultaneously recorded macaque RGC units, the decoder demonstrates the necessity of nonlinear computations for accurate decoding of the fine structures of visual stimuli. Specifically, high-pass spatial features of natural images can only be decoded using nonlinear techniques, while low-pass features can be extracted equally well by linear and nonlinear methods. Together, these results advance the state of the art in decoding natural stimuli from large populations of neurons. Author summaryNeural decoding is a fundamental problem in computational and statistical neuroscience. There is an enormous literature on this problem, applied to a wide variety of brain areas and nervous systems. Here we focus on the problem of decoding visual information from the retina. The bulk of previous work here has focused on simple linear decoders, applied to modest numbers of simultaneously recorded cells, to decode artificial stimuli. In contrast, here we develop a scalable nonlinear decoding method to decode natural images from the responses of over a thousand simultaneously recorded units, and show that this decoder significantly improves on the state of the art.

neuroscience↗

Functional Organization of Midget and Parasol Ganglion Cells in the Human Retina

The functional organization of diverse retinal ganglion cell (RGC) types, which shapes the visual signal transmitted to the brain, has been examined in many species. The unique spatial, temporal, and chromatic properties of the numerically dominant RGC types in macaque monkey retina are presumed to most accurately model human vision. However, the functional similarity between RGCs in macaques and humans has only begun to be tested, and recent work suggests possible differences. Here, the properties of the numerically dominant human RGC types were examined using large-scale multi-electrode recordings with fine-grained visual stimulation in isolated retina, and compared to results from dozens of recordings from macaque retina using the same experimental methods and conditions. The properties of four major human RGC types -- ON-parasol, OFF-parasol, ON-midget, and OFF-midget -- closely paralleled those of the same macaque RGC types, including the spatial and temporal light sensitivity, precisely coordinated mosaic organization of receptive fields, ON-OFF asymmetries, spatial response nonlinearity, and sampling of photoreceptor inputs over space. Putative smooth monostratified cells and polyaxonal amacrine cells were also identified based on similarities to cell types previously identified in macaque retina. The results suggest that recently proposed differences between human and macaque RGCs probably reflect experimental differences, and that the macaque model provides an accurate picture of human RGC function.

neuroscience↗

Reconstruction of natural images from responses of primate retinal ganglion cells

The visual message conveyed by a retinal ganglion cell (RGC) is often summarized by its spatial receptive field, but in principle also depends on the responses of other RGCs and natural image statistics. This possibility was explored by linear reconstruction of natural images from responses of the four numerically-dominant macaque RGC types. Reconstructions were highly consistent across retinas. The optimal reconstruction filter for each RGC - its visual message - reflected natural image statistics, and resembled the receptive field only when nearby, same-type cells were included. ON and OFF cells conveyed largely independent, complementary representations, and parasol and midget cells conveyed distinct and expected features. Correlated activity and nonlinearities had statistically significant but minor effects on reconstruction. Simulated reconstructions, using linear-nonlinear cascade models of RGC light responses that incorporated measured spatial properties and nonlinearities, produced similar results. Spatiotemporal reconstructions exhibited similar spatial properties, suggesting that the results are relevant for natural vision.

neuroscience↗

YASS: Yet Another Spike Sorter applied to large-scale multi-electrode array recordings in primate retina

Spike sorting is a critical first step in extracting neural signals from large-scale multi-electrode array (MEA) data. This manuscript presents several new techniques that make MEA spike sorting more robust and accurate. Our pipeline is based on an efficient multi-stage "triage-then-cluster-then-pursuit" approach that initially extracts only clean, high-quality waveforms from the electrophysiological time series by temporarily skipping noisy or "collided" events (representing two neurons firing synchronously). This is accomplished by developing a neural network detection and denoising method followed by efficient outlier triaging. The denoised spike waveforms are then used to infer the set of spike templates through nonparametric Bayesian clustering. We use a divide-and-conquer strategy to parallelize this clustering step. Finally, we recover collided waveforms with matching-pursuit deconvolution techniques, and perform further split-and-merge steps to estimate additional templates from the pool of recovered waveforms. We apply the new pipeline to data recorded in the primate retina, where high firing rates and highly-overlapping axonal units provide a challenging testbed for the deconvolution approach; in addition, the well-defined mosaic structure of receptive fields in this preparation provides a useful quality check on any spike sorting pipeline. We show that our pipeline improves on the state-of-the-art in spike sorting (and outperforms manual sorting) on both real and semi-simulated MEA data with > 500 electrodes; open source code can be found at https://github.com/paninski-lab/yass.

neuroscience↗

Massively Parallel Microwire Arrays Integrated with CMOS chips for Neural Recording

Multi-channel electrical recordings of neural activity in the brain is an increasingly powerful method revealing new aspects of neural communication, computation, and prosthetics. However, while planar silicon-based CMOS devices in conventional electronics scale rapidly, neural interface devices have not kept pace. Here, we present a new strategy to interface silicon-based chips with three-dimensional microwire arrays, providing the link between rapidly-developing electronics and high density neural interfaces. The system consists of a bundle of microwires mated to large-scale microelectrode arrays, such as camera chips. This system has excellent recording performance, demonstrated via single unit and local-field potential recordings in isolated retina and in the motor cortex or striatum of awake moving mice. The modular design enables a variety of microwire types and sizes to be integrated with different types of pixel arrays, connecting the rapid progress of commercial multiplexing, digitisation and data acquisition hardware together with a three-dimensional neural interface.

neuroscience↗

Unusual physiological properties of two ganglion cell types in primate retina

The visual functions of the diverse retinal ganglion cell types in the primate retina, and the parallel visual pathways they initiate, remain poorly understood. Here, the unusual physiological and computational properties of the ON and OFF smooth monostratified (SM) ganglion cells are explored. Large-scale multi-electrode recordings from 48 macaque retinas revealed that these cells exhibited strikingly irregular receptive field structure composed of spatially segregated hotspots, quite different from the receptive fields of previously described retinal ganglion cell types. The ON and OFF SM cells are paired cell types, but OFF SM cells exhibited stronger hotspot structure than ON cells. Targeted visual stimulation and computational inference demonstrate strong nonlinear subunit properties of each hotspot that contributed to the signaling properties of SM cells. Analysis of shared inputs to neighboring SM cells indicated that each hotspot could not be explained by an individual presynaptic input. Surprisingly, visual stimulation of different hotspots produced subtly different spatiotemporal spike waveforms in the same SM cell, consistent with a dendritic contribution to hotspot structure. These findings point to a previously unreported nonlinear mechanism in the output of the primate retina that contributes to signaling spatial information.

neuroscience↗

Inference of Nonlinear Spatial Subunits by Spike-Triggered Clustering in Primate Retina

Integration of rectified synaptic inputs is a widespread nonlinear motif in sensory neuroscience. We present a novel method for maximum likelihood estimation of nonlinear subunits by soft-clustering spike-triggered stimuli. Subunits estimated from parasol ganglion cells recorded in macaque retina partitioned the receptive field into compact regions, likely representing bipolar cell inputs. Joint clustering with multiple RGCs revealed shared subunits in neighboring cells, producing a parsimonious population model. Closed-loop subunit validation was then performed by projecting white noise into the null space of the linear receptive field. Responses to these null stimuli were more accurately explained by a model with multiple subunits, and were stronger in OFF cells than ON cells. Presentation of natural stimuli containing jittering edges and textures also revealed greater response prediction accuracy with the subunit model. Finally, the generality of the approach was demonstrated by application to V1 data.

neuroscience↗