bioRxiv Science⌕ Search
Home/Archive/bioRxiv

bioRxiv · 10.1101/190926

Efficient management and analysis of large-scale genome-wide data with two R packages: bigstatsr and bigsnpr

Prive, F.·Aschard, H.·Blum, M. G. B.
View original source ↗Export metadata ↓

Abstract

MotivationGenome-wide datasets produced for association studies have dramatically increased in size over the past few years, with modern datasets commonly including millions of variants measured in dozens of thousands of individuals. This increase in data size is a major challenge severely slowing down genomic analyses. Specialized software for every part of the analysis pipeline have been developed to handle large genomic data. However, combining all these software into a single data analysis pipeline might be technically difficult.\n\nResultsHere we present two R packages, bigstatsr and bigsnpr, allowing for management and analysis of large scale genomic data to be performed within a single comprehensive framework. To address large data size, the packages use memory-mapping for accessing data matrices stored on disk instead of in RAM. To perform data pre-processing and data analysis, the packages integrate most of the tools that are commonly used, either through transparent system calls to existing software, or through updated or improved implementation of existing methods. In particular, the packages implement a fast derivation of Principal Component Analysis, functions to remove SNPs in Linkage Disequilibrium, and algorithms to learn Polygenic Risk Scores on millions of SNPs. We illustrate applications of the two R packages by analysing a case-control genomic dataset for the celiac disease, performing an association study and computing Polygenic Risk Scores. Finally, we demonstrate the scalability of the R packages by analyzing a simulated genome-wide dataset including 500,000 individuals and 1 million markers on a single desktop computer.\n\nAvailabilityhttps://privefl.github.io/bigstatsr/ & https://privefl.github.io/bigsnpr/\n\nContactflorian.prive@univ-grenoble-alpes.fr & michael.blum@univ-grenoble-alpes.fr\n\nSupplementary informationSupplementary data are available at Bioinformatics online.

Source connections

Explore related subjects

bioinformaticsPreprint

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Prive, F., Aschard, H., Blum, M. G. B.. 2017-09-19. Efficient management and analysis of large-scale genome-wide data with two R packages: bigstatsr and bigsnpr. https://doi.org/10.1101/190926

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

scRM: A single-cell foundation model trained on scRNA-seq reads

To our knowledge, scRM is the first single-cell foundation model trained on sequencing reads, demonstrating that raw data pretraining is not only feasible but competitive at a fraction of the computational cost. We anticipate that scaling this framework and exploring alternative architectures will unlock biological information inaccessible to count models and extend the dataset-specific pretraining it already makes possible. The source code is available at https://github.com/altos-labs/scRM.

bioinformatics↗
bioRxiv2026

Local fractal dimension as an indicator of functional reorganization in molecular interaction networks

Changes in protein abundance incompletely describe how molecular perturbations reshape cellular organization. Here we introduce DIFFRACT, a framework that integrates quantitative proteomics with protein-protein interaction networks to identify reorganization through changes in local fractal dimension. Molecular associations define effective distances between connected proteins, allowing the geometry of their surrounding network neighborhoods to be compared across conditions. Analyses across four organisms (E. coli, A. thaliana, C. elegans, and H. sapiens) and three interaction resources (STRING, BioGRID, and IntAct) establish heterogeneous local scaling, while controlled perturbations demonstrate sensitivity to regional changes and invariance to uniform distance rescaling. Applied to RAVER1-deficient A549 cells, DIFFRACT identifies components associated with established RNA-regulatory functions and candidate roles in tRNA biology, mitochondrial organization and ciliogenesis. Selected RNA-regulatory and ciliary themes are not significantly enriched by abundance-ranked gene set analysis, supporting complementary information from network geometry. Selected functional annotations also recur in HEK293T cells. Guided by the ciliary predictions, we show that RAVER1 depletion increases the proportion of ciliated A549 cells 2.57-fold and increases cilium length. DIFFRACT thus connects changes in molecular network geometry to experimentally testable biological responses, extending the interpretation of proteomic perturbations beyond differential abundance.

bioinformatics↗
bioRxiv2026

Peripheral Exercise Transcriptomes Do Not Converge on Glutamatergic or Neuroinflammatory Signatures: A Cross-Platform Meta-Analysis

Executive dysfunction following physical overtraining has been linked to glutamatergic dysregulation in the lateral prefrontal cortex (LPFC), but whether this central mechanism is reflected in peripheral gene expression is unknown. This study tested whether peripheral transcriptomic responses to exercise converge on the glutamatergic or neuroinflammatory pathways implicated in LPFC dysfunction. Three publicly available GEO datasets spanning skeletal muscle, whole blood, and circulating neutrophils were analyzed across four exercise groups using limma, with a discovery threshold of nominal p < 0.05 and absolute log2 fold change above 0.5. Differential expression analysis identified 7,311 unique differentially expressed genes (DEGs) across the four contrasts, but overlap between datasets was limited: 7 genes were shared between skeletal muscle and blood, 38 between skeletal muscle and the GSE43856 contrasts, and 90 between blood and the GSE43856 contrasts, with none significant across all three studies. Gene Ontology and KEGG enrichment of the DEG union identified ribonucleoprotein complex biogenesis, ribosome biogenesis, protein folding, and T cell activation as the dominant biological processes; no glutamatergic or neuroinflammatory terms reached significance. Cross-tissue concordance between skeletal muscle and blood was absent (r = 0). Effect sizes among the genes driving the top enriched pathways were dominated by ribosomal proteins, heat shock proteins, and translation initiation factors rather than glutamate receptors or transporters. These findings indicate that peripheral transcriptomic responses to exercise are tissue-specific and dominated by proteostasis, translational, and immune programs rather than glutamatergic signaling. Direct assessment of central nervous system tissue or fluid-based glutamatergic biomarkers may be required to link overtraining-induced fatigue to LPFC dysfunction.

bioinformatics↗