bioRxiv · 10.1101/2024.04.06.587952
Transformers do not outperform Cellpose
Abstract
In a recent publication, Ma et al [1] claim that a transformer-based cellular segmentation method called Mediar [2] -- which won a Neurips challenge -- outperforms Cellpose [3] (0.897 vs 0.543 median F1 score). Here we show that this result was obtained by disadvantaging Cellpose in multiple ways. When we removed these impairments, Cellpose outperformed Mediar (0.861 vs 0.826 median F1 score on the updated test set). To further investigate the performance of transformers for cellular segmentation, we replaced the Cellpose backbone with a transformer. The transformer-Cellpose model also did not outperform the standard Cellpose (0.848 median F1 test score). Our results suggest that transformers do not advance the state-of-the-art in cellular segmentation.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Stringer, C., Pachitariu, M.. 2024-04-07. Transformers do not outperform Cellpose. https://doi.org/10.1101/2024.04.06.587952
Cite the original work for its findings. Save a collection to share your selection of sources.