bioRxiv · 10.1101/2023.12.18.572218
A long-context language model for the generation of bacteriophage genomes
Abstract
AbstractInspired by the success of large language models, we develop a long-context generative model for genomes. Our multiscale transformer model was pre-trained on unannotated bacteriophage genomes with byte-level tokenization. We demonstrate the foundational capabilities of our model including the prediction of essential genes, genetic variant effects, regulatory element activity and taxonomy of unannotated sequences. Furthermore, it generates de novo sequences up to 96K base pairs, which contain functional regulatory elements and novel proteins with phage-related functions.
Source connections
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Shao, B.. 2023-12-19. A long-context language model for the generation of bacteriophage genomes. https://doi.org/10.1101/2023.12.18.572218
Cite the original work for its findings. Save a collection to share your selection of sources.