bioRxiv Science⌕ Search

Biology subjects

Melander, J. B.

Publications and source records attributed to Melander, J. B..

5 recordsLinked to original sources

Parallel construction of object motion from retina to cortex

Detecting a moving object against a moving background is fundamental to survival. The retina is known to perform this computation, extracting object motion from global motion before signals reach the brain. Under the prevailing hierarchical view of vision, downstream areas should inherit and elaborate this retinal computation rather than rebuild it. Using multielectrode recordings of matched stimuli in mouse retina and cortex along with computational modeling, we show instead that post-retinal processing recomputes rather than inherits object motion sensitivity. Retinal and cortical object-motion sensitivities have distinct tuning: the retina prefers fine jitter, whereas cortex prefers coarse drift, revealing a division of labor in which the retina detects moving objects, whereas the cortex conveys information about object pattern. Vision synthesizes object motion through parallel specialization, not hierarchical refinement.

neuroscience↗

Single-camera, calibration-free gaze estimation using corneal reflections

BackgroundMice make substantial eye movements during head-fixed visual stimulation, and uncorrected gaze shifts corrupt receptive field measurements and confound stimulus-response relationships. Corneal-reflection video oculography in rodents has provided the methodological foundation for calibrated angular gaze tracking since Stahl (2004) but the calibration procedures used by existing methods -- physical camera rotation, motorized stages, behavioral tasks, or precisely co-aligned dual cameras -- have limited their adoption in many mouse neuroscience laboratories. Most studies instead use uncalibrated pupil tracking, deep learning pose estimation that returns pixel coordinates without angular calibration, or learned shifter networks that lack independent validation. New methodWe present an open-source corneal-reflection eye tracking system for head-fixed mice with two methodological contributions. First, a geometric model recovers gaze in calibrated angular units from the pixel displacements of the pupil and corneal reflections, using the known 3D positions of multiple fiducial LEDs as the source of angular scale. The model requires no estimate of Rp, the per-animal eye-geometry parameter that earlier corneal-reflection methods determine through physical calibration. Second, a self-calibration procedure exploits the redundancy of multiple stationary fiducial LEDs: each LED produces an independent gaze estimate from the same geometric model, and a single residual calibration parameter is determined by minimizing the disagreement between per-LED estimates. This replaces the physical camera-rotation calibrations of earlier video oculography (Sakatani and Isa, 2004, 2007; van Alphen et al., 2013; Kretschmer et al., 2017), the motorized stages of Zoccolan et al. (2010), and the precision dual-camera alignment of Payne and Raymond (2017) with a software operation that requires no moving parts, no behavioral task, and no per-animal procedure. The system provides three interactive GUI stages: (1) pupil and LED detection via Difference-of-Gaussians filtering, (2) 3D geometry definition, and (3) gaze angle computation with blink detection, fiducial correction, and manual curation. ResultsValidation against a rotary-encoder-controlled artificial eye demonstrated mean absolute errors below 1{degrees} across all four fiducial LEDs over the {+/-}20{degrees} working range of mouse eye movements, with Pearson correlations exceeding 0.998 between our methods estimation and encoder ground truth. The self-calibration reduced inter-LED disagreement by a factor of 4-6 in mouse recordings. Gaze-corrected stimulus reconstruction applied to Neuropixels recordings from mouse V1 produced qualitatively sharper receptive field estimates with improved signal-to-noise ratios. Comparison with existing methodsOur method is the first multi-LED, single-camera, fully software-calibrated corneal-reflection eye tracker for mice and includes an integrated open-source pipeline for detection, calibration, blink handling, and artifact correction. The multi-LED redundancy doubles as an internal consistency check -- if two LEDs disagree on gaze direction, the calibration is wrong -- providing a guarantee that learned approaches relying on neural-data-derived correction cannot offer. ConclusionsOur method makes calibrated corneal-reflection eye tracking accessible to non-specialist mouse laboratories using consumer-grade hardware ([~] $2,000-2,700 USD), eliminates the per-animal calibration procedures of earlier methods, and is validated by two independent ground truths at both the absolute angular (artificial eye) and functional (V1 receptive fields) levels. HighlightsO_LIOpen-source corneal-reflection eye tracking for head-fixed mice using a single camera and multiple stationary fiducial LEDs. C_LIO_LIGeometric gaze model derives angular scale from LED positions, eliminating per-animal eye-geometry calibration. C_LIO_LISelf-calibration via multi-LED redundancy replaces physical camera rotation, motorized stages, and dual-camera precision alignment. C_LIO_LIValidated to sub-degree accuracy against a rotary-encoder ground truth across the {+/-} 20{degrees} range of mouse eye movements. C_LIO_LIGaze correction produces sharper V1 receptive field estimates in Neuropixels recordings. C_LI

neuroscience↗

Adaptation of retinal discriminability to natural scenes

Sensory systems discriminate between stimuli to direct behavioral choices, a process governed by two distinct properties - neural sensitivity to specific stimuli, and neural variability that importantly includes correlations between neurons. Two questions that have received extensive investigation and debate are whether visual systems are optimized for natural scenes, and whether correlated neural variability contributes to this optimization. However, the lack of sufficient computational models has made these questions inaccessible in the context of the normal function of the visual system, which is to discriminate between natural stimuli. Here we take a direct approach to analyze discriminability under natural scenes for a population of salamander retinal ganglion cells using a model of the retinal neural code that captures both sensitivity and variability. Using methods of information geometry and generative machine learning, we analyzed the manifolds of natural stimuli and neural responses, finding that discriminability in the ganglion cell population adapts to enhance information transmission about natural scenes, in particular about localized motion. Contrary to previous proposals, correlated noise reduces information transmission and arises simply as a natural consequence of the shared circuitry that generates changing spatiotemporal visual sensitivity. These results address a long-standing debate as to the role of retinal correlations in the encoding of natural stimuli and reveal how the highly nonlinear receptive fields of the retina adapt dynamically to increase information transmission under natural scenes by performing the important ethological function of local motion discrimination.

neuroscience↗

Information Geometry of the Retinal Representation Manifold

The ability for the brain to discriminate among visual stimuli is constrained by their retinal representations. Previous studies of visual discriminability have been limited to either low-dimensional artificial stimuli or pure theoretical considerations without a realistic encoding model. Here we propose a novel framework for understanding stimulus discriminability achieved by retinal representations of naturalistic stimuli with the method of information geometry. To model the joint probability distribution of neural responses conditioned on the stimulus, we created a stochastic encoding model of a population of salamander retinal ganglion cells based on a three-layer convolutional neural network model. This model not only accurately captured the mean response to natural scenes but also a variety of second-order statistics. With the model and the proposed theory, we computed the Fisher information metric over stimuli to study the most discriminable stimulus directions. We found that the most discriminable stimulus varied substantially across stimuli, allowing an examination of the relationship between the most discriminable stimulus and the current stimulus. By examining responses generated by the most discriminable stimuli we further found that the most discriminative response mode is often aligned with the most stochastic mode. This finding carries the important implication that under natural scenes, retinal noise correlations are information-limiting rather than increasing information transmission as has been previously speculated. We additionally observed that sensitivity saturates less in the population than for single cells and that as a function of firing rate, Fisher information varies less than sensitivity. We conclude that under natural scenes, population coding benefits from complementary coding and helps to equalize the information carried by different firing rates, which may facilitate decoding of the stimulus under principles of information maximization.

neuroscience↗

Distinct in vivo dynamics of excitatory synapses onto cortical pyramidal neurons and inhibitory interneurons

Cortical function relies on the balanced activation of excitatory and inhibitory neurons. However, little is known about the organization and dynamics of shaft excitatory synapses onto cortical inhibitory interneurons, which cannot be easily identified morphologically. Here, we fluorescently visualize the excitatory postsynaptic marker PSD-95 at endogenous levels as a proxy for excitatory synapses onto layer 2/3 pyramidal neurons and parvalbumin-positive (PV+) inhibitory interneurons in the mouse barrel cortex. Longitudinal in vivo imaging reveals that, while synaptic weights in both neuronal types are log-normally distributed, synapses onto PV+ neurons are less heterogeneous and more stable. Markov-model analyses suggest that the synaptic weight distribution is set intrinsically by ongoing cell type-specific dynamics, and substantial changes are due to accumulated gradual changes. Synaptic weight dynamics are multiplicative, i.e., changes scale with weights, though PV+ synapses also exhibit an additive component. These results reveal that cell type-specific processes govern cortical synaptic strengths and dynamics.

neuroscience↗