bioRxiv Science⌕ Search

bioRxiv · 10.1101/301903

Identification of Significant Computational Building Blocks through Comprehensive Deep Dive of NGS Secondary Analysis Methods

Abstract

Rapid advancements in next generation sequencing technologies have greatly improved the throughput of sequencing and reduced the cost to under $1000 per genome propelling ambitious projects across the globe that are pursuing sequencing million or more genomes. In addition, the sequencing throughput is increasing and the cost is decreasing at a rate much faster than the Moores law. This necessitates equivalent rate of acceleration of NGS secondary analysis that assembles the reads into full genomes and identifies variants between genomes. Conventional improvement in hardware can at best help accelerate this according to the Moores law if the corresponding software is able to use the hardware efficiently. This is currently not the case for majority of the dozens of software tools used for NGS secondary analysis. Thus, to keep pace with the rate of advancement of sequencers, we need - 1) hardware that is designed taking into account the computational requirements of NGS secondary analysis and 2) software tools that use the hardware efficiently.\n\nIn this work, we take the first step towards that goal by identifying the computational requirements of NGS secondary analysis. We surveyed dozens of software tools from all the three major problems in secondary analysis - sequence mapping, de novo assembly, and variant calling - to select seven popular tools and a workflow for an in depth analysis. We performed runtime profiling of the tools using multiple real datasets to find that the majority of the runtime is dominated by just four building blocks - Smith Waterman alignment, FM-index based sequence search, Debruijn graph construction and traversal and pairwise hidden markov model algorithm. Together, these building blocks cover 80.5%-98.2% of the runtime for sequence mapping, 63.9%-99.4% of the runtime for De novo assembly, and 72%-93% of the runtime for variant calling. The beauty of this result is that by just tailoring our software and hardware for these building blocks, we can get a major performance improvement of NGS secondary analysis.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Vasimuddin, M., Misra, S., Aluru, S.. 2018-04-16. Identification of Significant Computational Building Blocks through Comprehensive Deep Dive of NGS Secondary Analysis Methods. https://doi.org/10.1101/301903

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Recurrent mitotic error and purifying selection shape chromosomal mosaicism across human tissues

Mosaic chromosomal alterations (mCAs) have been extensively studied in cancer and clonal hematopoiesis but less so in healthy solid tissues. Here, we characterized mCAs in 19 tissues across 25 donors (aged 42-89+ years) by analyzing >200x whole-genome sequencing data generated by the Somatic Mosaicism across Human Tissues (SMaHT) Network. Across 722 tissue samples, we identified 1,008 autosomal mCAs >1 Mb in length and ubiquitous losses of sex chromosomes. Surprisingly, the highest levels of Y chromosome loss in males (5-10% cell fraction in elderly donors) were observed in the lung, adrenal gland, and heart. These tissues also tended to experience more X loss in females, revealing a gradient of mitotic error burden across human tissues. Autosomal aneuploidies displayed distinct tissue-specific patterns indicative of negative selection against most events, except in the adrenal gland, in which low-level aneuploidy was pervasive. In contrast to the adrenal gland, testis rarely harbored aneuploidies but frequently experienced low-level copy-neutral loss of heterozygosity (CN-LOH), suggesting increased mitotic recombination in spermatogonial stem cells. Recurrent X chromosome losses within tissues of female donors exhibited allelic skews explained by a combination of genetic and epigenetic effects. Together, these results show that the chromosomal landscape of aging human tissues is shaped by genetics and recurrent mutations, most but not all of which are held in check by purifying selection.

genomics↗

Multi-modal in situ profiling of human cells using the AVITI24 platform characterizes single-cell responses to acute stress

Cells begin to respond to stress within minutes, but how this early response depends on cell type, neighboring cells, or cell cycle phase has been difficult to determine, because bulk assays average across cells and synchronization can induce stress. We measured 338 transcripts, 48 proteins and phosphoproteins, and six cell paint stains in situ in 1.18 million single cells from four human cell lines exposed to H2O2, alone and in co-culture, and in A549 cells exposed to TNF-, cadmium, dithiothreitol or lipopolysaccharide. In A549 cells, five distinct stressors changed the same targets in the same direction within 15 min, differing mainly in magnitude, and modestly increased JNK phosphorylation. By 30 min of H2O2 treatment, immediate-early genes (FOS, JUN, DDIT3, DUSP1, NR4A1) were induced most strongly in HCT116 and A549 cells. These changes occurred across the whole cell population rather than in a responsive subset. Cell line-specific differences persisted in co-culture, and the response of MCF7 cells did not increase with the number of adjacent, strongly-responding A549 cells. Ordering cells along the cell cycle from the same measurements identified 106 cycle-associated transcripts, and the response varied more between cell lines than among cell cycle phases. Overall, the measured regulators respond to stress within 30 minutes through a largely shared program whose magnitude depends more on cell identity than on cell cycle state or neighboring cell type.

genomics↗

A Chromosome Scale Genome Assembly for the Australian blue mussel Mytilus planulatus

Mussels belonging to the genus Mytilus are among the world's most ecologically and economically important bivalve molluscs. Although the genus most likely originated in the Northern Hemisphere, the evolutionary history of Southern Hemisphere lineages, including the timing and number of colonisation events leading to the extant Australian populations, remains debated. Limited genomic resources have hindered the reconstruction of these evolutionary histories. In Australia, distinguishing native Mytilus planulatus from invasive Mytilus galloprovincialis is critical for biosecurity and conservation, but previous molecular approaches lacked sufficient resolution to resolve species boundaries and hybridisation patterns. Here, we present the first chromosome-scale reference genome for M. planulatus. The assembly consists of 14 chromosomes and over 51,000 annotated protein-coding genes per haplotype. Comparative analysis revealed extensive structural variation and widespread hemizygosity despite a largely conserved chromosomal organisation relative to M. galloprovincialis. Population analyses using SNPs and gene presence-absence variation in resequenced individuals confirmed previously inferred patterns of population structure and establish this reference genome as a valuable resource for future studies of genome evolution, adaptation and population genomics in Mytilus.

genomics↗