bioRxiv Science⌕ Search

Biology subjects

Sinz, F.

Publications and source records attributed to Sinz, F..

6 recordsLinked to original sources

The functional organization of retinal input to the mouse superior colliculus

The superior colliculus integrates retinal input to drive rapid, adaptive visual behavior, yet how the functional diversity of retinal ganglion cell types is represented in superior colliculus remains poorly understood. Using chronic two-photon calcium imaging of retinal ganglion cell axonal boutons in awake mice, we recorded over 200,000 boutons across superficial superior colliculus layers -- a scale that enabled systematic comparison with large-scale ex vivo retinal datasets. This revealed that the superior colliculus receives a near-complete sampling of retinal ganglion cell functional diversity. Functionally distinct response types were organized in systematic laminar gradients: not only response properties such as direction selectivity and contrast suppression, but retinal response types themselves varied systematically with depth. To probe how this organized input encodes natural scenes, we trained a "digital twin" deep network model on natural movie responses and validated its generalization to parametric stimuli, including cell type identification. Leveraging this model to generate predicted responses to looming stimuli, we identify a discrete subset of retinal response types tuned for collision detection at low angular thresholds -- a specialization embedded within a broader, non-specialized retinal population. The digital twin is made publicly available as a community resource. Together, these findings provide a comprehensive functional map of retinal drive to the superior colliculus and an in silico platform for linking retinal cell types to behaviorally relevant superior colliculus computations.

neuroscience↗

Cell-type-specific inhibitory circuitry from a connectomic census of mouse visual cortex

Mammalian cortex features a vast diversity of neuronal cell types, each with characteristic anatomical, molecular and functional properties. Synaptic connectivity powerfully shapes how each cell type participates in the cortical circuit, but mapping connectivity rules at the resolution of distinct cell types remains difficult. Here, we used millimeter-scale volumetric electron microscopy1 to investigate the connectivity of all inhibitory neurons across a densely-segmented neuronal population of 1352 cells spanning all layers of mouse visual cortex, producing a wiring diagram of inhibitory connections with more than 70,000 synapses. Taking a data-driven approach inspired by classical neuroanatomy, we classified inhibitory neurons based on the relative targeting of dendritic compartments and other inhibitory cells and developed a novel classification of excitatory neurons based on the morphological and synaptic input properties. The synaptic connectivity between inhibitory cells revealed a novel class of disinhibitory specialist targeting basket cells, in addition to familiar subclasses. Analysis of the inhibitory connectivity onto excitatory neurons found widespread specificity, with many interneurons exhibiting differential targeting of certain subpopulations spatially intermingled with other potential targets. Inhibitory targeting was organized into "motif groups," diverse sets of cells that collectively target both perisomatic and dendritic compartments of the same excitatory targets. Collectively, our analysis identified new organizing principles for cortical inhibition and will serve as a foundation for linking modern multimodal neuronal atlases with the cortical wiring diagram.

neuroscience↗

Using UAV-Imagery for Leaf Segmentation in Diseased Plants via Mask-Based Data Augmentation and Extension of Leaf-based Phenotyping Parameters

AO_SCPLOWBSTRACTC_SCPLOWIn crop production plant diseases cause significant yield losses. Therefore, the detection and scoring of disease occurrence is of high importance. The quantification of plant diseases requires the identification of leaves as individual scoring units. Diseased leaves are very dynamic and complex biological object which constantly change in form and color after interaction with plant pathogens. To address the task of identifying and segmenting individual leaves in agricultural fields, this work uses unmanned aerial vehicle (UAV), multispectral imagery of sugar beet fields and deep instance segmentation networks (Mask R-CNN). Based on standard and copy-paste image augmentation techniques, we tested and compare five strategies for achieving robustness of the network while keeping the number of labeled images within reasonable bounds. Additionally, we quantified the influence of environmental conditions on the network performance. Metrics of performance show that multispectral UAV images recorded under sunny conditions lead to a drop of up to 7% of average precision (AP) in comparison with images under cloudy, diffuse illumination conditions. The lowest performance in leaf detection was found on images with severe disease damage and sunny weather conditions. Subsequently, we used Mask R-CNN models in an image-processing pipeline for the calculation of leaf-based parameters such as leaf area, leaf slope, disease incidence, disease severity, number of clusters, and mean cluster area. To describe epidemiological development, we applied this pipeline in time-series in an experimental trial with five varieties and two fungicide strategies. Disease severity of the model with the highest AP results shows the highest correlation with the same parameter assessed by experts. Time-series development of disease severity and disease incidence demonstrates the advantages of multispectral UAV-imagery for contrasting varieties for resistance, and the limits for disease control measurements. With this work we highlight key components to consider for automatic leaf segmentation of diseased plants using UAV imagery, such as illumination and disease condition. Moreover, we offer a tool for delivering leaf-based parameters relevant to optimize crop production thought automated disease quantification imaging tools.

plant biology↗

Behavioral state tunes mouse vision to ethological features through pupil dilation

Sensory processing changes with behavioral context to increase computational flexibility. In the visual system, active behavioral states enhance sensory responses but typically leave the preferred stimuli of neurons unchanged. Here we find that behavioral state does modulate stimulus selectivity in mouse visual cortex in the context of colored natural scenes. Using population imaging, behavior, pharmacology, and deep neural networks, we identified a shift of color selectivity towards ultraviolet stimuli exclusively caused by pupil dilation, resulting in a dynamic switch from rod to cone photoreceptors, extending their role beyond night and day vision. This facilitated the detection of ethological stimuli, such as aerial predators against the twilight sky. In contrast to previous studies that have used pupil dilation as an indirect measure of brain state, our results suggest that the brain uses pupil dilation itself to differentially recruit rods and cones on short timescales to tune visual representations to behavioral demands.

neuroscience↗

Generalization in data-driven models of primary visual cortex

AO_SCPLOWBSTRACTC_SCPLOWDeep neural networks (DNN) have set new standards at predicting responses of neural populations to visual input. Most such DNNs consist of a convolutional network (core) shared across all neurons which learns a representation of neural computation in visual cortex and a neuron-specific readout that linearly combines the relevant features in this representation. The goal of this paper is to test whether such a representation is indeed generally characteristic for visual cortex, i.e. gener-alizes between animals of a species, and what factors contribute to obtaining such a generalizing core. To push all non-linear computations into the core where the generalizing cortical features should be learned, we devise a novel readout that reduces the number of parameters per neuron in the readout by up to two orders of magnitude compared to the previous state-of-the-art. It does so by taking advantage of retinotopy and learns a Gaussian distribution over the neurons receptive field po-sition. With this new readout we train our network on neural responses from mouse primary visual cortex (V1) and obtain a gain in performance of 7% compared to the previous state-of-the-art network. We then investigate whether the convolutional core indeed captures general cortical features by using the core in transfer learning to a different animal. When transferring a core trained on thousands of neurons from various animals and scans we exceed the performance of training directly on that animal by 12%, and outperform a commonly used VGG16 core pre-trained on imagenet by 33%. In addition, transfer learning with our data-driven core is more data-efficient than direct training, achieving the same performance with only 40% of the data. Our model with its novel readout thus sets a new state-of-the-art for neural response prediction in mouse visual cortex from natural images, generalizes between animals, and captures better characteristic cortical features than current task-driven pre-training approaches such as VGG16.

neuroscience↗

Tracking activity patterns of a multispecies community of gymnotiform weakly electric fish in their neotropical habitat

Field studies on freely behaving animals commonly require tagging and often are focused on single species. Weakly electric fish generate a species- and individual-specific electric organ discharge (EOD) and therefore provide a unique opportunity for individual tracking without tagging. We here present and test tracking algorithms based on recordings with submerged electrode arrays. Harmonic structures extracted from power spectra provide fish identity. Localization of fish based on weighted averages of their EOD amplitudes is found to be more robust than fitting a dipole model. We apply these techniques to monitor a community of three species, Apteronotus rostratus, Eigenmannia humboldtii, and Sternopygus dariensis, in their natural habitat in Darien, Panama. We found consistent upstream movements after sunset followed by downstream movements in the second half of the night. Extrapolations of these movements and estimates of fish density obtained from additional transect data suggest that some fish cover at least several hundreds of meters of the stream per night. Most fish, including Eigenmannia, were traversing the electrode array solitarily. From in-situ measurements of the decay of the EOD amplitude with distance of individual animals we estimated that fish can detect conspecifics at distances of up to 2 m. Our recordings also emphasize the complexity of natural electrosensory scenes resulting from the interactions of the EODs of different species. Electrode arrays thus provide an unprecedented window into the so-far hidden nocturnal activities of multispecies communities of weakly electric fish at an unmatched level of detail. Summary statementDetailed movement patterns and complex electrosensory scenes of three species of weakly electric fish were tracked without tagging using a submerged electrode array in a small Neotropical stream.

animal behavior and cognition↗