bioRxiv Science⌕ Search

Biology subjects

Quaglia, F.

Publications and source records attributed to Quaglia, F..

7 recordsLinked to original sources

On the state of protein function prediction: a report on the fourth CAFA challenge

BackgroundThe Critical Assessment of Functional Annotation (CAFA) is a community effort held to understand the field of computational protein function prediction. Every three years, since 2010, the organizers initiate an experiment to collect function predictions on a large set of proteins and then evaluate the performance of predicting methods on a subset of proteins that have accumulated experimental annotations between the submission deadline and the evaluation time. CAFA provides an independent and rigorous assessment of the current state of the art, thus leveling the playing field, highlighting successes, revealing bottlenecks, and offering a forum for the exchange of ideas in protein science. Here, we report the results of the fourth CAFA experiment (CAFA4). ResultsCAFA4 featured the participation of 148 methods from 70 research groups on a total of 46,205 unique proteins over a 5-year annotation accumulation phase, the longest in any CAFA. In a comparison across CAFA2-CAFA4 methods, the prediction of Gene Ontology (GO) terms has clearly improved across all three GO aspects and traditional evaluation settings. While not achieving the first rank, several CAFA2 and CAFA3 methods featured in the top ten methods in many evaluations, suggesting that earlier methods still hold relevance. The performance is weaker in the newly introduced "partial knowledge" evaluation category (proteins with experimental annotations before submission deadline that gained additional annotations in the same GO aspect during the annotation accumulation phase), highlighting the need for a new class of methods. The rankings of the methods were stable over the years in traditional evaluation settings, but less so in the new partial knowledge evaluation. Overall, the field continues to progress with some influx of new participants. Sustained efforts will be necessary to substantially advance it.

bioinformatics↗

MIADE metadata guidelines: Minimum Information About a Disorder Experiment

An unambiguous description of an experimental setup and analysis, and the subsequent biological observation is vital for accurate data interpretation and reproducible results. Consequently, experimental analyses should be described in a concise, unequivocal, and digestible manner. The aim of minimum information guidelines is to define the fundamental complement of data that can support an unambiguous conclusion on experimental observations. In this document, we present the Minimum Information About Disorder Experiments (MIADE) guidelines to define the minimal fundamental parameters required for non-experts to understand the key findings of an experiment studying intrinsically disordered proteins (IDPs) or intrinsically disordered protein regions (IDRs). MIADE guidelines provide recommendations for data producers to describe the results of their experiments at source, for curators to annotate experimental data to community resources and for database developers maintaining community resources to disseminate the data. We give examples of the application of these guidelines in common use cases and describe the implementation of an update to the DisProt IDP database to allow MIADE-compliant annotation. The MIADE guidelines will improve the interpretability of experimental results for data consumers, facilitate direct data submission, simplify data curation, improve data exchange among repositories and standardise the dissemination of the key metadata on an IDP experiment by IDP data sources.

scientific communication and education↗

APICURON: a database to credit and acknowledge the work of biocurators

APICURON is an open and freely accessible resource that tracks and credits the work of biocurators across multiple participating knowledgebases. Biocuration is essential to extract knowledge from research data and make it available in a structured and standardized way to the scientific community. However, processing biological data - mainly from literature - requires a huge effort which is difficult to quantify and acknowledge. APICURON collects biocuration events from third party resources and aggregates this information, spotlighting biocurator contributions. APICURON promotes biocurator engagement implementing gamification concepts like badges, medals and leaderboards and at the same time provides a monitoring service for registered resources and for biocurators themselves. APICURON adopts a data model that is flexible enough to represent and track the majority of biocuration activities. Biocurators are identified through their ORCID. The definition of curation events, scoring systems and rules for assigning badges and medals are resource-specific and easily customizable. Registered resources can transfer curation activities on the fly through a secure and robust Application Programming Interface (API). Here we show how simple and effective it is to connect a resource to APICURON describing the DisProt database of intrinsically disordered proteins as a use case. We believe APICURON will provide biological knowledgebases with a service to recognize and credit the effort of their biocurators, monitor their activity and promote curators engagement. Database URL: https://apicuron.org

bioinformatics↗

Experimentally determined long intrinsically disordered protein regions are now abundant in the Protein Data Bank

Intrinsically disordered protein regions are commonly defined from missing electron density in X-ray structures. Experimental evidence for long disorder regions (LDRs) of at least 30 residues was so far limited to a less than a thousand manually curated proteins. Here, we describe a comprehensive and large-scale analysis of experimental LDRs for 3,133 unique proteins, demonstrating an increasing coverage of intrinsic disorder in the Protein Data Bank (PDB) in the last decade. The results suggest that long missing residue regions are a good quality source to annotate intrinsically disordered regions and perform functional analysis in large data sets. The consensus approach used to define LDRs allows to evaluate context dependent disorder and provide a common definition at the protein level.

bioinformatics↗

Assessing predictors for new post translational modification sites: a case study on hydroxylation

Post-translational modification (PTM) sites have become popular for predictor development. However, with the exception of phosphorylation and a handful of other examples, PTMs suffer from a limited number of available training examples and their sparsity in protein sequences. Here, proline hydroxylation is taken as an example to compare different methods and evaluate their performance on new experimentally determined sites. As a proxy for an effective experimental design, predictors require both high specificity and sensitivity. However, the self-reported performance is often not indicative of prediction quality and detection of new sites is not guaranteed. We have benchmarked seven published hydroxylation site predictors on two newly constructed independent datasets. The self-reported performance widely overestimates the real accuracy measured on independent datasets. No predictor performs better than random on new examples, indicating the refined models are not sufficiently general to detect new sites. The number of false positives is high and precision low, in particular for non-collagen proteins whose motifs are not conserved. In short, existing predictors for hydroxylation sites do not appear to generalize to new data. Caution is advised when dealing with PTM predictors in the absence of independent evaluations, in particular for unique specific sites such as those involved in signalling. Author SummaryMachine learning methods are extensively used by biologists to design and interpret experiments. Predictors which take the only sequence as input are of particular interest due to the large amount of sequence data available and self-reported performance is often very high. In this work, we evaluated post-translational modification (PTM) predictors for hydroxylation sites and found that they perform no better than random, in strong contrast to performances reported in the original publications. PTMs are chemical amino acids alterations providing the cell with conditional mechanisms to fine tune protein function, thereby regulating complex biological processes such as signalling and cell cycle. Hydroxylation sites are a good PTM test case due to the availability of a range of predictors and an abundance of newly experimentally detected modification sites. Poor performances in our results highlight the overlooked problem of predicting PTMs when best practices are not followed and training data are likely incomplete. Experimentalists should be careful when using PTM predictors blindly and more independent assessments are needed to separate the wheat from the chaff in the field.

bioinformatics↗

Insights into the molecular features of the von Hippel-Lindau like protein

We present an in silico characterization of the von Hippel-Lindau like protein (VLP), the only known human paralogue of the von Hippel-Lindau tumor suppressor protein (pVHL). Phylogenetic investigation showed VLP to be mostly conserved in upper mammals and specifically expressed in brain and testis. Structural analysis and molecular dynamics simulation show VLP to be very similar to pVHL three-dimensional organization and binding dynamics. In particular, conservation of elements at the protein interfaces suggests VLP to be a functional pVHL homolog potentially possessing multiple functions beyond HIF-1-dependent binding activity. Our findings show that VLP may share at least seven interactors with pVHL, suggesting novel functional roles for this under-studied human protein. These may occur at precise hypoxia levels where functional overlap with pVHL may permit a finer modulation of pVHL functions.

cancer biology↗

Genotype-Phenotype Relations of the von Hippel-Lindau Tumor Suppressor Inferred from a Large-Scale Analysis of Disease Mutations and Interactors

Familiar cancers represent a privileged point of view for studying the complex cellular events inducing tumor transformation. Von Hippel-Lindau syndrome, a familiar predisposition to develop cancer is a clear example. Here, we present our efforts to decipher the role of von Hippel-Lindau tumor suppressor protein (pVHL) in cancer insurgence. We collected high quality information about both pVHL mutations and interactors to investigate the association between patient phenotypes, mutated protein surface and impaired interactions. Our data suggest that different phenotypes correlate with localized perturbations of the pVHL structure, with specific cell functions associated to different protein surfaces. We propose five different pVHL interfaces to be selectively involved in modulating proteins regulating gene expression, protein homeostasis as well as to address extracellular matrix (ECM) and ciliogenesis associated functions. These data were used to drive molecular docking of pVHL with its interactors and guide Petri net simulations of the most promising alterations. We predict that disruption of pVHL association with certain interactors can trigger tumor transformation, inducing metabolism imbalance and ECM remodeling. Collectively taken, our findings provide novel insights into VHL-associated tumorigenesis. This highly integrated in silico approach may help elucidate novel treatment paradigms for VHL disease.\n\nAuthor summaryCancer is generally caused by a series of mutations accumulating over time in a healthy tissue, which becomes re-programmed to proliferate at the expense of the hosting organism. This process is difficult to follow and understand as events in a multitude of different genes can lead to similar outcomes without apparent cause. The von Hippel-Lindau (VHL) tumor suppressor is one of the few genes harboring a familiar cancer syndrome, i.e. VHL mutations are known to cause a predictable series of events leading cancer in the kidneys and a few selected other tissues. This article describes a large-scale analysis to relate known VHL mutations to specific cancer pathways by looking at the molecular interactions. Different cancer types appear to be caused by mutations changing the surface of specific parts of the VHL protein. By looking at the VHL interactors involved, it is therefore possible to identify other candidate genes for mutations leading to very similar cancer types.

cancer biology↗