bioRxiv · 10.1101/2025.10.16.679418
LabOS: The AI Co-Scientist That Sees and Works With Humans
Abstract
Modern science advances fastest when thought meets action. LabOS represents the first AI co-scientist that unites computational reasoning with physical experimentation through multimodal perception, self-evolving agents, and XR-enabled, embodied human-AI collaboration. To empower agentic AI with embodied intelligence, we built LabSuperVision, the first vision-language-model (VLM) benchmark spanning biomedical and materials science laboratories, designed to evaluate scientific perception and reasoning. This endowed LabOS with visual reasoning capabilities that surpass those of general-purpose models on laboratory-specific tasks. By connecting multi-model AI agents, smart glasses, and human-AI-robot collaboration, LabOS allows AI to see what scientists see, understand experimental context, and participate in real-time execution through immersive XR interaction and robotic autonomation. Across applications-from cancer immunotherapy target discovery to cell engineering-LabOS shows that AI can move beyond computational design to participation, turning the laboratory into an intelligent, collaborative environment where human and machine discovery evolve together.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Cong, L., Zhang, Z., Wang, X., Di, Y., Jin, R., Gerasimiuk, M., Wang, Y., Dinesh, R. K., Smerkous, D., Smerkous, A., Wu, X., Liu, S., Li, P., Zhu, Y., Serrao, S., Zhao, N., Mohammad, I. A., Sunwoo, J. B., Wu, J. C., Wang, M.. 2025-10-19. LabOS: The AI Co-Scientist That Sees and Works With Humans. https://doi.org/10.1101/2025.10.16.679418
Cite the original work for its findings. Save a collection to share your selection of sources.