bioRxiv Science⌕ Search

Biology subjects

Dragotti, P. L.

Publications and source records attributed to Dragotti, P. L..

8 recordsLinked to original sources

Light-field deep learning enables high-throughput, scattering-mitigated calcium imaging

Light field microscopy (LFM) enables volumetric, high throughput functional imaging. However, the computational burden and vulnerability to scattering limit LFMs application to neuroscience. We present a light-field strategy for volumetric, scattering-mitigated neural circuit activity monitoring. A physics-based deep neural network, LNet, is trained with two-photon volumes and one-photon light fields. A processing pipeline uses LNet to extract calcium activity from light-field videos of jGCaMP8f-expressing neurons in acute cortical slices. The extracted time series have high signal-to-noise ratios and reduced optical crosstalk compared to conventional volume reconstruction methods. Imaging 100 volumes per second, we observe putative spikes fired at up to 10 Hz and the spatial intermingling of putative ensembles throughout 530 x 530 x 100-micron volumes. Compared to iterative algorithms, LNet workflows reduce light-field video processing times by 2- to 12-fold, advancing the goal of real-time, scattering-robust volumetric neural circuit imaging for closed-loop and adaptive experimental paradigms.

bioengineering↗

Physics-based Deep Learning for Imaging Neuronal Activity via Two-photon and Light Field Microscopy

Light Field Microscopy (LFM) is an imaging technique that offers the opportunity to study fast dynamics in biological systems due to its rapid 3D imaging rate. In particular, it is attractive to analyze neuronal activity in the brain. Unlike scanning-based imaging methods, LFM simultaneously encodes the spatial and angular information of light in a single snapshot. However, LFM is limited by a trade-off between spatial and angular resolution and is affected by scattering at deep layers in the brain tissue. In contrast, two-photon (2P) microscopy is a point-scanning 3D imaging technique that achieves higher spatial resolution, deeper tissue penetration, and reduced scattering effects. However, point-scanning acquisition limits the imaging speed in 2P microscopy and cannot be used to simultaneously monitor the activity of a large population of neurons. This work introduces a physics-driven deep neural network to image neuronal activity in scattering volume tissues using LFM. The architecture of the network is obtained by unfolding the ISTA algorithm and is based on the observation that the neurons in the tissue are sparse. The deep-network architecture is also based on a novel imaging system modeling that uses a linear convolutional neural network and fits the physics of the acquisition process. To achieve the high-quality reconstruction of neuronal activity in 3D brain tissues from temporal sequences of light field (LF) images, we train the network in a semi-supervised manner using generative adversarial networks (GANs). We use the TdTomato indicator to obtain static structural information of the tissue with the microscope operating in 2P scanning modality, representing the target reconstruction quality. We also use additional functional data in LF modality with GCaMP indicators to train the network. Our approach is tested under adverse conditions: limited training data, background noise, and scattering samples. We experimentally show that our method performs better than model-based reconstruction strategies and typical artificial neural networks for imaging neuronal activity in mammalian brain tissue, considering reconstruction quality, generalization to functional imaging, and reconstruction speed.

neuroscience↗

Neural heterogeneity promotes robust learning

The brain has a hugely diverse, heterogeneous structure. Whether or not heterogeneity at the neural level plays a functional role remains unclear, and has been relatively little explored in models which are often highly homogeneous. We compared the performance of spiking neural networks trained to carry out tasks of real-world difficulty, with varying degrees of heterogeneity, and found that it substantially improved task performance. Learning was more stable and robust, particularly for tasks with a rich temporal structure. In addition, the distribution of neuronal parameters in the trained networks closely matches those observed experimentally. We suggest that the heterogeneity observed in the brain may be more than just the byproduct of noisy processes, but rather may serve an active and important role in allowing animals to learn in changing environments. SummaryNeural heterogeneity is metabolically efficient for learning, and optimal parameter distribution matches experimental data.

neuroscience↗

Comparing volumetric reconstruction algorithms for light field imaging of high signal-to-noise ratio neuronal calcium transients

SignificanceLight-field microscopy (LFM) enables fast, light-efficient, volumetric imaging of neuronal activity with calcium indicators. Calcium transients differ in temporal signal-to-noise ratio (tSNR) and spatial confinement when extracted from volumes reconstructed by different algorithms. AimWe evaluated the capabilities and limitations of two light-field reconstruction algorithms for calcium fluorescence imaging. ApproachWe acquired light-field image series from neurons either bulk-labeled or filled intracellularly with the red-emitting calcium dye CaSiR-1 in acute mouse brain slices. We compared the tSNR and spatial confinement of calcium signals extracted from volumes reconstructed with synthetic refocusing and Richardson-Lucy 3D deconvolution with and without total variation regularization. ResultsBoth synthetic refocusing and Richardson-Lucy deconvolution resolved calcium signals from single cells and neuronal dendrites in three dimensions. Increasing deconvolution iteration number improved spatial confinement but reduced tSNR compared to synthetic refocusing. Volumetric light-field imaging did not decrease calcium signal tSNR compared to interleaved, widefield image series acquired in matched planes. ConclusionsLFM enables high-volume rate, volumetric imaging of calcium transients in single cells (bulk-labeled), somata and dendrites (intracellular loaded). The trade-offs identified for tSNR, spatial confinement, and computational cost indicate which of synthetic refocusing or deconvolution can better realize the scientific requirements of future LFM calcium imaging applications.

bioengineering↗

Subcellular resolution 3D light field imaging with genetically encoded voltage indicators

Light field microscopy (LFM) enables high signal-to-noise ratio (SNR), light efficient volume imaging at fast frame rates, and has been successfully applied to single-cell resolution functional neuronal calcium imaging. Voltage imaging with genetically encoded voltage indicators (GEVIs) stands to particularly benefit from light field microscopys volumetric imaging capability due to high required sampling rates, and limited probe brightness and functional sensitivity. Previous LFM studies have imaged GEVIs to track population-level interactions only in invertebrate preparations and without single cell resolution. Here we demonstrate sub-cellular resolution GEVI light field imaging in acute mouse brain slices resolving dendritic voltage signals localized in three dimensions. We characterize the effects of different light field reconstruction techniques on the SNR and signal localization and compare the SNR to fluorescence transients imaged in wide field. Our results demonstrate the potential of light field voltage imaging for studying dendritic integration and action potential propagation and backpropagation in 3 spatial dimensions.

neuroscience↗

CosMIC: A Consistent Metric for Spike Inference from Calcium Imaging

In recent years, the development of algorithms to detect neuronal spiking activity from two-photon calcium imaging data has received much attention. Meanwhile, few researchers have examined the metrics used to assess the similarity of detected spike trains with the ground truth. We highlight the limitations of the two most commonly used metrics, the spike train correlation and success rate, and propose an alternative, which we refer to as CosMIC. Rather than operating on the true and estimated spike trains directly, the proposed metric assesses the similarity of the pulse trains obtained from convolution of the spike trains with a smoothing pulse. The pulse width, which is derived from the statistics of the imaging data, reflects the temporal tolerance of the metric. The final metric score is the size of the commonalities of the pulse trains as a fraction of their average size. Viewed through the lens of set theory, CosMIC resembles a continuous Sorensen-Dice coefficient -- an index commonly used to assess the similarity of discrete, presence/absence data. We demonstrate the ability of the proposed metric to discriminate the precision and recall of spike train estimates. Unlike the spike train correlation, which appears to reward overestimation, the proposed metric score is maximised when the correct number of spikes have been detected. Furthermore, we show that CosMIC is more sensitive to the temporal precision of estimates than the success rate.

neuroscience↗

Multiphoton minimal inertia scanning for fast acquisition of neural activity signals

Multi-photon laser scanning microscopy provides a powerful tool for monitoring the spatiotemporal dynamics of neural circuit activity. It is, however, intrinsically a point scanning technique. Standard raster scanning enables imaging at subcellular resolution; however, acquisition rates are limited by the size of the field of view to be scanned. Recently developed scanning strategies such as Travelling Salesman Scanning (TSS) have been developed to maximize cellular sampling rate by scanning only regions of interest in the field of view corresponding to locations of interest such as somata. However, such strategies are not optimized for the mechanical properties of galvanometric scanners. We describe here the Adaptive Spiral Scanning (SSA) algorithm, which fits a set of near-circular trajectories to the cellular distribution to avoid inertial drifts of galvanometer position. We compare its performance to raster scanning and TSS in terms of cellular sampling frequency and signal-to-noise ratio (SNR). Using surrogate neuron spatial position data, we show that SSA acquisition rates are an order of magnitude higher than those for raster scanning and generally exceed those achieved by TSS for neural densities comparable with those found in the cortex. We show that this result also holds true for in vitro hippocampal mouse brain slices bath loaded with the synthetic calcium dye Cal-520 AM. The ability of TSS to \"park\" the laser on each neuron along the scanning trajectory, however, enables higher SNR than SSA when all targets are precisely scanned. Raster scanning has the highest SNR but at a substantial cost in number of cells scanned. To understand the impact of sampling rate and SNR on functional calcium imaging, we used the Cramer-Rao Bound on evoked calcium traces recorded simultaneously with electrophysiology traces to calculate the lower bound estimate of the spike timing occurrence. The results show that TSS and SSA achieve comparable accuracy in spike time estimates compared to raster scanning despite their lower SNR. SSA is an easily implementable way for standard multi-photon laser scanning systems to gain temporal precision in the detection of action potentials while scanning hundreds of active cells.

neuroscience↗

ABLE: an Activity-Based Level Set Segmentation Algorithm for Two-Photon Calcium Imaging Data

We present an algorithm for detecting the location of cells from two-photon calcium imaging data. In our framework, multiple coupled active contours evolve, guided by a model-based cost function, to identify cell boundaries. An active contour seeks to partition a local region into two subregions, a cell interior and ex-terior, in which all pixels have maximally similar time courses. This simple, local model allows contours to be evolved predominantly independently. When contours are sufficiently close, their evolution is coupled, in a manner that permits overlap. We illustrate the ability of the proposed method to demix overlapping cells on real data. The proposed framework is flexible, incorporating no prior information regarding a cells morphology or stereotypical temporal activity, which enables the detection of cells with diverse properties. We demonstrate algorithm performance on a challenging mouse in vitro dataset, containing synchronously spiking cells, and a manually labelled mouse in vivo dataset, on which ABLE achieves a 67.5% success rate.\n\nSignificance statementTwo-photon calcium imaging enables the study of brain activity during learning and behaviour at single-cell resolution. To decode neuronal spiking activity from the data, algorithms are first required to detect the location of cells in the video. It is still common for scientists to perform this task manually, as the heterogeneity in cell shape and frequency of cellular overlap impede automatic segmentation algorithms. We developed a versatile algorithm based on a popular image segmentation approach (the Level Set Method) and demonstrated its capability to overcome these challenges. We include no assumptions on cell shape or stereotypical temporal activity. This lends our framework the flexibility to be applied to new datasets with minimal adjustment.

neuroscience↗