bioRxiv Science⌕ Search

Biology subjects

Cox, D. D.

Publications and source records attributed to Cox, D. D..

6 recordsLinked to original sources

Neural correlates of visual object recognition in rats

Invariant object recognition--the ability to recognize objects across size, rotation, or context--is fundamental for making sense of a dynamic visual world. Although initially believed to be unique to primates due to its complexity, emerging evidence suggests rodents, too, can recognize objects across a range of identity-preserving transformations. Here, we describe a comprehensive pipeline for investigating visual behavior in rats, from high-throughput training to cellular resolution imaging in awake, head-fixed animals. Using this suite of tools, we demonstrate that rats excel in visual object recognition and explore potential neural pathways which may support this capacity. We leverage our optical approach to systematically profile multiple visual areas with responses to a range of stimulus types recorded in the same neurons. Primary and higher-order areas of rat visual cortex exhibit a hierarchical organization consistent with a role in visual object recognition. However, marked deviations from the functional organization of primate visual cortex suggest species-specific differences in the neural circuits underlying visual object recognition. This work reinforces the notion that rats possess sophisticated visual abilities and offers the technical foundation for their use as a powerful model to link neuronal responses to perception and behavior.

neuroscience↗

Aligning Model and Macaque Inferior Temporal Cortex Representations Improves Model-to-Human Behavioral Alignment and Adversarial Robustness

While some state-of-the-art artificial neural network systems in computer vision are strikingly accurate models of the corresponding primate visual processing, there are still many discrepancies between these models and the behavior of primates on object recognition tasks. Many current models suffer from extreme sensitivity to adversarial attacks and often do not align well with the image-by-image behavioral error patterns observed in humans. Previous research has provided strong evidence that primate object recognition behavior can be very accurately predicted by neural population activity in the inferior temporal (IT) cortex, a brain area in the late stages of the visual processing hierarchy. Therefore, here we directly test whether making the late stage representations of models more similar to that of macaque IT produces new models that exhibit more robust, primate-like behavior. We conducted chronic, large-scale multi-electrode recordings across the IT cortex in six non-human primates (rhesus macaques). We then use these data to fine-tune (end-to-end) the model "IT" representations such that they are more aligned with the biological IT representations, while preserving accuracy on object recognition tasks. We generate a cohort of models with a range of IT similarity scores validated on held-out animals across two image sets with distinct statistics. Across a battery of optimization conditions, we observed a strong correlation between the models IT-likeness and alignment with human behavior, as well as an increase in its adversarial robustness. We further assessed the limitations of this approach and find that the improvements in behavioral alignment and adversarial robustness generalize across different image statistics, but not to object categories outside of those covered in our IT training set. Taken together, our results demonstrate that building models that are more aligned with the primate brain leads to more robust and human-like behavior, and call for larger neural data-sets to further augment these gains.

neuroscience↗

Rats strategically manage learning during perceptual decision making

Balancing the speed and accuracy of decisions is crucial for survival, but how organisms manage this trade-off during learning is largely unknown. Here, we track this trade-off during perceptual learning in rats and simulated agents. At the start of learning, rats chose long reaction times that did not optimize instantaneous reward rate, but by the end of learning chose near-optimal reaction times. To understand this behavior, we analyzed learning dynamics in a recurrent neural network model of the task. The model reveals a fundamental trade-off between instantaneous reward rate and perceptual learning speed, putting the goals of learning quickly and accruing immediate reward in tension. We find that the rats strategy of long initial responses can dramatically expedite learning, yielding higher total reward over task engagement. Our results demonstrate that prioritizing learning can be advantageous from a total reward perspective, and suggest that rats engage in cognitive control of learning.

neuroscience↗

Simulating a Primary Visual Cortex at the Front of CNNs Improves Robustness to Image Perturbations

Current state-of-the-art object recognition models are largely based on convolutional neural network (CNN) architectures, which are loosely inspired by the primate visual system. However, these CNNs can be fooled by imperceptibly small, explicitly crafted perturbations, and struggle to recognize objects in corrupted images that are easily recognized by humans. Here, by making comparisons with primate neural data, we first observed that CNN models with a neural hidden layer that better matches primate primary visual cortex (V1) are also more robust to adversarial attacks. Inspired by this observation, we developed VOneNets, a new class of hybrid CNN vision models. Each VOneNet contains a fixed weight neural network front-end that simulates primate V1, called the VOneBlock, followed by a neural network back-end adapted from current CNN vision models. The VOneBlock is based on a classical neuroscientific model of V1: the linear-nonlinear-Poisson model, consisting of a biologically-constrained Gabor filter bank, simple and complex cell nonlinearities, and a V1 neuronal stochasticity generator. After training, VOneNets retain high ImageNet performance, but each is substantially more robust, outperforming the base CNNs and state-of-the-art methods by 18% and 3%, respectively, on a conglomerate benchmark of perturbations comprised of white box adversarial attacks and common image corruptions. Finally, we show that all components of the VOneBlock work in synergy to improve robustness. While current CNN architectures are arguably brain-inspired, the results presented here demonstrate that more precisely mimicking just one stage of the primate visual system leads to new gains in ImageNet-level computer vision applications.

neuroscience↗

64-Channel Carbon Fiber Electrode Arrays for Chronic Electrophysiology

A chief goal in neuroscience is to understand how neuronal activity relates to behavior, perception, and cognition. However, monitoring neuronal activity over long periods of time is technically challenging, and limited, in part, by the invasive nature of recording tools. While electrodes allow for recording in freely-behaving animals, they tend to be bulky and stiff, causing damage to the tissue they are implanted in. One solution to this invasiveness problem may be probes that are small enough to fly under the immune systems radar. Carbon fiber (CF) electrodes are thinner and more flexible than typical metal or silicon electrodes, but the arrays described in previous reports had low channel counts and required time-consuming manual assembly. Here we report the design of an expanded-channel-count carbon fiber electrode array (CFEA) as well as a method for fast preparation of the recording sites using acid etching and electroplating with PEDOT-TFB, and demonstrate the ability of the 64-channel CFEA to record from rat visual cortex. We include designs for interfacing the system with micro-drives or flex-PCB cables for recording from multiple brain regions, as well as a facilitated method for coating CFs with the insulator Parylene-C. High-channel-count CFEAs may thus be an alternative to traditional microwire-based electrodes and a practical tool for exploring the neural code.

neuroscience↗

Wide-area all-optical neurophysiology in acute brain slices

Optical tools for simultaneous perturbation and measurement of neural activity open the possibility of mapping neural function over wide areas of brain tissue. However, spectral overlap of actuators and reporters presents a challenge for their simultaneous use, and optical scattering and out-of-focus fluorescence in tissue degrade resolution. To minimize optical crosstalk, we combined an optimized variant (eTsChR) of the most blue-shifted channelrhodopsin reported to-date with a nuclear-localized red-shifted Ca2+ indicator, H2B-jRGECO1a. To perform wide-area optically sectioned imaging in tissue, we designed a structured illumination technique that uses Hadamard matrices to encode spatial information. By combining these molecular and optical approaches we made wide-area maps, spanning cortex and striatum, of the effects of antiepileptic drugs on neural excitability and on the effects of AMPA and NMDA receptor blockers on functional connectivity. Together, these tools provide a powerful capability for wide-area mapping of neuronal excitability and functional connectivity in acute brain slices.

neuroscience↗