bioRxiv Science⌕ Search

Biology subjects

Mancarci, B. O.

Publications and source records attributed to Mancarci, B. O..

5 recordsLinked to original sources

Detailed curation of biological samples and experimental designs for genomics using LLM-supported agentic workflows

We describe an automated software tool to accomplish data curation tasks previously performed by humans for the Gemma genomics data re-analysis resource. Gemma is a hand-curated database of reprocessed transcriptomic studies, currently covering over 23,000 human, mouse and rat data sets largely drawn from the Gene Expression Omnibus (GEO). We developed a pipeline that uses both traditional (mechanical) and large-language models to produce detailed ontology-anchored, sample- and experiment-level annotations in accordance with our established curation guidelines. In this report, we describe benchmarking the pipeline and investigations aimed at evaluating readiness of the v1.1 Gemma curation agent for production use. Overall, performance is near that of human curators, at approximately 1/20th the cost and at least 100 times the speed. We also present preliminary exploration of triage methods for identifying agent curations that are more likely to contain errors, and thus can be forwarded for human review. We discuss the potential place of such curation approaches in bioinformatics ecosystems. Besides the software, our deliverables include the benchmark set of 500 studies and an evaluation framework that can be used to further develop the pipeline or compare to other approaches.

bioinformatics↗

Application of large language models to the annotation of cell lines and mouse strains in genomics data

Accurate, consistent and comprehensive metadata are essential for the reuse of functional genomics data deposited in repositories such as the Gene Expression Omnibus (GEO), however, achieving this often requires careful manual curation that is time-consuming, costly and prone to errors. In this paper, we evaluate the performance of Large Language Models (LLMs), specifically OpenAIs GPT-4o, as an assistive tool for entity-to-ontology annotation of two commonly encountered descriptors in transcriptomic experiments - mouse strains and cell lines. Using over 9,000 manually curated experiments from the Gemma database and over 5,000 associated journal articles, we assess the models ability to identify relevant free-text entries and map them to appropriate ontology terms. Using zero-shot prompting and retrieval-augmented generation (RAG) to incorporate domain-specific ontology knowledge, GPT-4o correctly annotated 77% of mouse strain and 59% of cell line experiments, and uncovered manual curation errors in Gemma for over 200 experiments. GPT-4o substantially outperformed a regular expression-based string-matching method, which correctly annotated only 6% of mouse strain experiments due to low precision. Model errors often arose from typographical mistakes or inconsistent naming in the GEO record or publication, and resembled those made by human curators. Along with annotations, our approach requests that the model output supporting context and quotes from the sources. These were typically accurate and enabled rapid curator verification. These findings suggest that LLMs are not ready to fully replace manual curators, but can already effectively support them. A human-in-the-loop workflow, in which LLMs annotations are provided to human curators for validation, may improve the efficiency and quality of large-scale biomedical metadata curation.

bioinformatics↗

Curation of over 10,000 transcriptomic studies to enable data reuse

Vast amounts of transcriptomic data reside in public repositories, but effective reuse remains challenging. Issues include unstructured dataset metadata, inconsistent data processing and quality control, and inconsistent probe-gene mappings across microarray technologies. Thus, extensive curation and data reprocessing is necessary prior to any reuse. The Gemma bioinformatics system was created to help address these issues. Gemma consists of a database of curated transcriptomic datasets, analytical software, a web interface, and web services. Here we present an update on Gemmas holdings, data processing and analysis pipelines, our curation guidelines, and software features. As of June 2020, Gemma contains 10,811 manually curated datasets (primarily human, mouse, and rat), over 395,000 samples and hundreds of curated transcriptomic platforms (both microarray and RNA-sequencing). Dataset topics were represented with 10,215 distinct terms from 12 ontologies, for a total of 54,316 topic annotations (mean topics/dataset = 5.2). While Gemma has broad coverage of conditions and tissues, it captures a large majority of available brain-related datasets, accounting for 34% of its holdings. Users can access the curated data and differential expression analyses through the Gemma website, RESTful service, and an R package. Database URL: https://gemma.msl.ubc.ca/home.html

bioinformatics↗

Transcriptomic Correlates Of Neuron Electrophysiological Diversity

How neuronal diversity emerges from complex patterns of gene expression remains poorly understood. Here we present an approach to understand electrophysiological diversity through gene expression by integrating transcriptomics with intracellular electrophysiology. Using a brain-wide dataset of 34 neuron types, we identified 420 genes whose expression levels significantly correlated with variability in one or more of 11 electrophysiological parameters. The majority of these correlations were consistent in an independent sample of 12 visual cortex cell types. Many associations reported here have the potential to provide new insights into how neurons generate functional diversity, and correlations of ion channel genes like Gabrd and Scn1a (Nav1.1) with resting potential and spiking frequency are consistent with known causal mechanisms. These results suggest that despite the complexity linking gene expression to electrophysiology, there are likely some general principles that govern how individual genes establish phenotypic diversity across very different cell types.

neuroscience↗

NeuroExpresso: A cross-laboratory database of brain cell-type expression profiles with applications to marker gene identification and bulk brain tissue transcriptome interpretation

The identification of cell type marker genes, genes highly enriched in specific cell types, plays an important role in the study of the nervous system. In particular, marker genes can be used to identify cell types to enable studies of their properties. Marker genes can also aid the interpretation of bulk tissue expression profiles by revealing cell type specific changes.\n\nWe assembled a database, NeuroExpresso, of publicly available mouse brain cell type-specific gene expression datasets. We then used stringent criteria to select marker genes highly expressed in individual cell types. We found a substantial number of novel markers previously unknown in the literature and validated a subset of them using in silico analyses and in situ hybridization. We next demonstrate the use of marker genes in analysis of whole tissue data by summarizing their expression into \"cell type profiles\" that can be thought of as surrogates for the relative abundance of the cell types across the samples studied.\n\nFurther analysis of our cell type-specific expression database confirms some recent findings about brain cell types along with revealing novel properties, such as Ddc expression in oligodendrocytes. To facilitate further use of this expanding database, we provide a user-friendly web interface for the visualization of expression data.\n\nSignificance StatementCell type markers are powerful tools in the study of the nervous system that help reveal properties of cell types and acquire additional information from large scale expression experiments. Despite their usefulness in the field, known marker genes for brain cell types are few in number. We present NeuroExpresso, a database of brain cell type specific gene expression profiles, and demonstrate the use of marker genes for acquiring cell type specific information from whole tissue expression. The database will prove itself as a useful resource for researchers aiming to reveal novel properties of the cell types and aid both laboratory and computational scientists to unravel the cell type specific components of brain disorders.

neuroscience↗