LiveLattice: Real-time visualization of tilted light-sheet microscopy data using a memory-efficient transformation algorithm

Abstract

Light-sheet fluorescence microscopy (LSFM), a prominent fluorescence microscopy technique, offers enhanced temporal resolution for imaging biological samples in four dimensions (4D; x, y, z, time). Some of the most recent implementations, including inverted selective plane illumination microscopy (iSPIM) and lattice light-sheet microscopy (LLSM), rely on a tilting of the sample plane with respect to the light sheet of 30-45 degrees to ease sample preparation. Data from such tilted-sample-plane LSFMs require subsequent deskewing and rotation for proper visualization and analysis. Such transformations currently demand substantial memory allocation. This poses computational challenges, especially with large datasets. The consequence is long processing times compared to data acquisition times, which currently limits the ability for live-viewing the data as it is being captured by the microscope. To enable the fast preprocessing of large light-sheet microscopy datasets without significant hardware demand, we have developed WH-Transform, a novel GPU-accelerated memory-efficient algorithm that integrates deskewing and rotation into a single transformation, significantly reducing memory requirements and reducing the preprocessing run time by at least 10-fold for large image stacks. Benchmarked against conventional methods and existing software, our approach demonstrates linear scalability. Processing large 3D stacks of up to 15 GB is now possible within one minute using a single GPU with 24 GB of memory. Applied to 4D LLSM datasets of human hepatocytes, human lung organoid tissue, and human brain organoid tissue, our method outperforms alternatives, providing rapid, accurate preprocessing within seconds. Importantly, such processing speeds now allow visualization of the raw microscope data stream in real time, significantly improving the usability of LLSM in biology. In summary, this advancement holds transformative potential for light-sheet microscopy, enabling real-time, on-the-fly data processing, visualization, and analysis on standard workstations, thereby revolutionizing biological imaging applications for LLSM, SPIM and similar light microscopes.