bioRxiv · 10.1101/2025.01.08.632030
RETINA: Reconstruction-based Pre-Trained Enhanced TransUNet for Electron Microscopy Segmentation on the CEM500K Dataset
Abstract
Electron microscopy (EM) has revolutionized our understanding of cellular structures at the nanoscale. Accurate image segmentation is required for analyzing EM images. While manual segmentation is reliable, it is labor-intensive, incentivizing the development of automated segmentation methods. Although deep learning-based segmentation has shown promise, its accuracy to automatically segment cellular structures in EM data remains insufficient compared to expert manual results. Current approaches usually use either convolutional or transformer-based neural networks for image feature extraction. We developed the RETINA method, which combines pre-training on the large, unlabeled CEM500K EM image dataset with a hybrid neural-network model architecture that integrates both local (convolutional layer) and global (transformer layer) image processing to learn from manual image annotations. RETINA outperformed existing models on cellular structure segmentation on five public EM datasets. This improvement works toward automated cellular structure segmentation for the EM community. Data and code are available at Zenodo and GitHub.
Source connections
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Xing, C., Xie, R., Bader, G.. 2025-01-13. RETINA: Reconstruction-based Pre-Trained Enhanced TransUNet for Electron Microscopy Segmentation on the CEM500K Dataset. https://doi.org/10.1101/2025.01.08.632030
Cite the original work for its findings. Save a collection to share your selection of sources.