bioRxiv Science⌕ Search

Biology subjects

Yu, S. X.

Publications and source records attributed to Yu, S. X..

2 recordsLinked to original sources

Adaptive optical correction in in vivo two-photon fluorescence microscopy with neural fields

Adaptive optics (AO) restore ideal imaging performance in complex samples by measuring and correcting optical aberrations, but often require custom-built microscopes with carefully aligned wavefront sensing/shaping devices and can be susceptible to sample motion. Here we describe NeAT, a computational framework using neural fields for AO two-photon fluorescence microscopy. NeAT estimates wavefront aberration and recovers sample structure from a 3D image stack without requiring external datasets for training. Incorporating motion correction in learning and correcting conjugation errors commonly found in commercial microscopes, NeAT is designed for deployment in biological laboratories for in vivo imaging. We validate NeATs performance using a custom-built microscope with a wavefront sensor under varying signal-to-noise ratios, aberration, and motion conditions. With a commercial microscope, we demonstrate real-time aberration correction for in vivo morphological and functional imaging in the living mouse brain, with NeAT improving signal and accuracy of glutamate and calcium imaging of synapses and neurons.

neuroscience↗

A comparison of visual features used by humans and machines to classify wildlife

In our quest to develop more intelligent machines, knowledge of the visual features used by machines to classify objects shall be helpful. The current state of the art in training machines to classify wildlife species from camera-trap data is to employ convolutional neural networks (CNN) encoded within deep learning algorithms. Here we report on results obtained in training a CNN to classify 20 African wildlife species with an overall accuracy of 87.5% from a dataset containing 111,467 images. We then used a gradient-weighted class-activation-mapping (Grad-CAM) procedure to extract the most salient pixels in the final convolution layer. We show that these pixels highlight features in particular images that are in most, but not all, cases similar to those used to train humans to identify these species. Further, we used mutual information methods to identify the neurons in the final convolution layer that consistently respond most strongly across a set of images of one particular species, and we then interpret the features in the image where the strongest responses occur. We also used hierarchical clustering of feature vectors (i.e., the state of the final fully-connected layer in the CNN) associated with each image to produce a visual similarity dendrogram of identified species. Finally, we evaluated how images that were not part of the training set fell within our dendrogram when these images were one of the 20 species \"known\" to our CNN in contrast to where they fell when these images were \"unknown\" to our CNN.

ecology↗