bioRxiv Science⌕ Search

Biology subjects

Horstmeyer, R.

Publications and source records attributed to Horstmeyer, R..

7 recordsLinked to original sources

Foundation cell segmentation models performance on live microscopy and spatial-omics data

Accurate cell segmentation is an essential step for quantitative analysis of biological imaging data. Recent advances in deep learning have led to the development of generalist segmentation models that perform robustly across multiple imaging modalities, including label-free phase contrast, fluorescence cell culture, and multiplexed fluorescence tissue imaging. However, systematic comparisons of these models at the level of downstream biological analysis remain limited. To address this gap, we evaluated several recent segmentation models, including Cellpose cyto3, Cellpose-SAM, {micro}SAM, and CellSAM, on phase contrast and fluorescence cell culture images. In addition, Mesmer and InstanSeg were included for benchmarking on multiplexed fluorescence tissue images generated using CO-Detection by IndEXing (CODEX). We found that Cellpose-SAM achieved strong performance on phase contrast images, while SAM-based models consistently performed well on fluorescence cell culture data. In contrast, no single model consistently outperformed others on CODEX datasets. Instead, each model exhibited distinct strengths and limitations, which led to differences in downstream analyses, including clustering and cell type identification. Together, our study emphasizes the importance of selecting segmentation models based on dataset characteristics and analytical goals, rather than relying on a single universal approach.

bioinformatics↗

Cortex-Wide Cellular Imaging in Freely Locomoting Mice Using Cortex Camera Array Microscope (CortexCAM)

Understanding single-cell neuronal activity across multiple brain regions in the context of ethologically relevant behaviors is a major goal in systems neuroscience. We have engineered the Cortex Camera Array Microscope (CortexCAM), integrating four miniaturized fluorescence imaging microscopes to simultaneously capture cellular activity from contiguous fields of view spanning over 48 mm2 of the dorsal cortex. The CortexCAM is capable of imaging > 9000 individual neurons across much of the primary and secondary motor, somatosensory, visual, retrosplenial, and association cortices across both hemispheres of the dorsal cortex. The compact nature of the CortexCAM allows integration into a passive mechanical gantry system to form the mobile CortexCAM. The mobile CortexCAM allows volitional control of the animals translational motion (x, y) and rotational motion (yaw) in physical behavior arenas. We then use the mobile CortexCAM to perform cortex-wide cellular resolution imaging in freely locomoting mice performing alternating choice tasks, as well as during social interactions. Thus the CortexCAM allows studying cortex-wide cellular dynamics in behaviors that cannot be achieved in headfixed settings.

neuroscience↗

Parallelized Brightfield and Fluorescence Imaging of Organoids Using a Scalable Multi-Camera Platform

Organoid viability, maturation, and growth is commonly assayed through brightfield and fluorescence microscopy using a single objective lens. However, standard microscopic imaging systems pose significant limitations for high-throughput applications, particularly in large-scale experiments where simultaneous imaging of multiple organoids requires increased throughput. There is a strong need for systems that can capture organoid growth rapidly and consistently while minimizing disturbances to culture conditions. Here, we present a novel multi-camera array scanner (MCAS) that parallelizes imaging through the simultaneous use of 48 objective lenses and sensors, resulting in a 95% reduction in acquisition times compared to commercial high-content imagers. We demonstrate and validate this system in multiple well plate formats, in both 2D and 3D neural cell cultures, and in brightfield and fluorescence. The MCAS improves efficiency for measuring organoid growth rates, assessing responses to morphogens and drugs, and measuring viral transduction efficiency. Together, these findings establish the MCAS as a scalable and versatile imaging platform for rapid phenotyping in organoid research.

neuroscience↗

High-throughput multi-camera array microscope platform for automated 3D behavioral analysis of freely swimming zebrafish larvae

Understanding the behavioral and morphological dynamics of moving model organisms like the zebrafish larvae requires accurate, high-throughput 3D analysis. However, traditional single-view 2D video tracking fails to capture the full scope of natural 3D movements and postural dynamics. Here, we present a novel high-throughput 24-camera array microscope with a co-designed "mirrored well plate" that allows for snapshot imaging of up to 48 wells over a 118 mm x 82 mm field of view from two orthogonal directions (i.e., a top-view and side-view). Accurate 3D position estimation and tracking is achieved with an efficient machine learning algorithm that scales well to high-throughput measurements. The proposed approach automates parallelized 3D model organism behavioral analysis, providing 3D skeletal tracking, swim bladder morphological dynamics, and kinematics of up to 48 swimming zebrafish larvae at up to several hundred frames per second. The result is an efficient and scalable solution for high-throughput 3D behavioral studies with broad compatibility with standard workflows across laboratories and procedures working with pharmacology, toxicology, and neuroscience.

animal behavior and cognition↗

Chromatix: a differentiable, GPU-accelerated wave-optics library

Modern microscopy methods incorporate computational modeling as an integral part of the imaging process, either to solve inverse problems or optimize the optical system design itself. These methods often depend on differentiable optics simulations, yet no standardized framework exists--forcing computational optics researchers to repeatedly and independently implement simulations with limited reusability and performance. These common problems limit the potential impact of computational optics as a field. Here we present Chromatix: an open-source, GPU-accelerated, differentiable wave optics simulation library. Chromatix builds on JAX to democratize fast, parallelized simulation of diverse optical systems and expand the design space in computational optics. Chromatix standardizes a growing collection of optical elements and propagation methods allowing a broad range of applications, which we demonstrate here for snapshot microscopy, holography, and phase retrieval. We demonstrate speed improvements of 2-6x on a single GPU and up to 22x on 8 GPUs.

bioinformatics↗

High-speed 4D fluorescence light field tomography of whole freely moving organisms

Volumetric fluorescence imaging techniques, such as confocal, multiphoton, light sheet, and light field microscopy, have become indispensable tools across a wide range of cellular, developmental, and neurobiological applications. However, it is difficult to scale such techniques to the large 3D fields of view (FOV), volume rates, and synchronicity requirements for high-resolution 4D imaging of freely behaving organisms. Here, we present reflective Fourier light field computed tomography (ReFLeCT), a new high-speed volumetric fluorescence computational imaging technique. ReFLeCT synchronously captures entire tomograms of multiple unrestrained, unanesthetized model organisms over multi-millimeter 3D FOVs at 120 volumes per second. In particular, we applied ReFLeCT to reconstruct 4D videos of fluorescently labeled zebrafish and Drosophila larvae, enabling us to study their heartbeat, fin and tail motion, gaze, jaw motion, and muscle contractions with nearly isotropic 3D resolution while they are freely moving. As a novel approach for snapshot tomographic capture, ReFLeCT is a major advance towards bridging the gap between current volumetric fluorescence microscopy techniques and macroscopic behavioral imaging.

animal behavior and cognition↗

Pan-cortical cellular imaging in freely behaving mice using a miniaturized micro-camera array microscope (mini-MCAM)

Understanding how circuits in the brain simultaneously coordinate their activity to mediate complex ethnologically relevant behaviors requires recording neural activities from distributed populations of neurons in freely behaving animals. Current miniaturized imaging microscopes are typically limited to imaging a relatively small field of view, precluding the measurement of neural activities across multiple brain regions. Here we present a miniaturized micro-camera array microscope (mini-MCAM) that consists of four fluorescence imaging micro-cameras, each capable of capturing neural activity across a 4.5 mm x 2.55 mm field of view (FOV). Cumulatively, the mini-MCAM images over 30 mm2 area of sparsely expressed GCaMP6s neurons distributed throughout the dorsal cortex, in regions including the primary and secondary motor, somatosensory, visual, retrosplenial, and association cortices across both hemispheres. We demonstrate cortex-wide cellular resolution in vivo Calcium (Ca2+) imaging using the mini-MCAM in both head-fixed and freely behaving mice.

neuroscience↗