bioRxiv Science⌕ Search

Biology subjects

Greenblatt, M. S.

Publications and source records attributed to Greenblatt, M. S..

4 recordsLinked to original sources

Calibration of additional computational tools expands ClinGen recommendation options for variant classification with PP3/BP4 criteria

PurposeWe previously developed an approach to calibrate computational tools for clinical variant classification, updating recommendations for the reliable use of variant impact predictors to provide evidence strength up to Strong. A new generation of tools using distinctive approaches have since been released, and these methods must be independently calibrated for clinical application. MethodUsing our local posterior probability-based calibration and our established data set of ClinVar pathogenic and benign variants, we determined the strength of evidence provided by three new tools (AlphaMissense, ESM1b, VARITY) and calibrated scores meeting each evidence strength. Results All three tools reached the Strong level of evidence for variant pathogenicity and Moderate for benignity, though sometimes for few variants. Compared to previously recommended tools, these yielded at best only modest improvements in the tradeoffs of evidence strength and false positive predictions. ConclusionAt calibrated thresholds, three new computational predictors provided evidence for variant pathogenicity at similar strength to the four previously recommended predictors (and comparable with functional assays for some variants). This calibration broadens the scope of computational tools for application in clinical variant classification. Their new approaches offer promise for future advancement of the field.

bioinformatics↗

Evidence-based calibration of computational tools for missense variant pathogenicity classification and ClinGen recommendations for clinical use of PP3/BP4 criteria

Recommendations from the American College of Medical Genetics and Genomics and the Association for Molecular Pathology (ACMG/AMP) for interpreting sequence variants specify the use of computational predictors as Supporting level of evidence for pathogenicity or benignity using criteria PP3 and BP4, respectively. However, score intervals defined by tool developers, and ACMG/AMP recommendations that require the consensus of multiple predictors, lack quantitative support. Previously, we described a probabilistic framework that quantified the strengths of evidence (Supporting, Moderate, Strong, Very Strong) within ACMG/AMP recommendations. We have extended this framework to computational predictors and introduce a new standard that converts a tools scores to PP3 and BP4 evidence strengths. Our approach is based on estimating the local positive predictive value and can calibrate any computational tool or other continuous-scale evidence on any variant type. We estimate thresholds (score intervals) corresponding to each strength of evidence for pathogenicity and benignity for thirteen missense variant interpretation tools, using carefully assembled independent data sets. Most tools achieved Supporting evidence level for both pathogenic and benign classification using newly established thresholds. Multiple tools reached score thresholds justifying Moderate and several reached Strong evidence levels. One tool reached Very Strong evidence level for benign classification on some variants. Based on these findings, we provide recommendations for evidence-based revisions of the PP3 and BP4 ACMG/AMP criteria using individual tools and future assessment of computational methods for clinical interpretation.

bioinformatics↗

Curated Multiple Sequence Alignment for the Adenomatous Polyposis Coli (APC) Gene and Accuracy of In Silico Pathogenicity Predictions

Computational algorithms are often used to assess pathogenicity of Variants of Uncertain Significance (VUS) that are found in disease-associated genes. Most computational methods include analysis of protein multiple sequence alignments (PMSA), assessing interspecies variation. Careful validation of PMSA-based methods has been done for relatively few genes, partially because creation of curated PMSAs is labor-intensive. We assessed how PMSA-based computational tools predict the effects of the missense changes in the APC gene, in which pathogenic variants cause Familial Adenomatous Polyposis. Most Pathogenic or Likely Pathogenic APC variants are protein-truncating changes. However, public databases now contain thousands of variants reported as missense. We created a curated APC PMSA that contained >3 substitutions/site, which is large enough for statistically robust in silico analysis. The creation of the PMSA was not easily automated, requiring significant querying and computational analysis of protein and genome sequences. Of 1924 missense APC variants in the NCBI ClinVar database, 1800 (93.5%) are reported as VUS. All but two missense variants listed as P/LP occur at canonical splice or Exonic Splice Enhancer sites. Pathogenicity predictions by five computational tools (Align-GVGD, SIFT, PolyPhen2, MAPP, REVEL) differed widely in their predictions of Pathogenic/Likely Pathogenic (range 17.5-75.0%) and Benign/Likely Benign (range 25.0-82.5%) for APC missense variants in ClinVar. When applied to 21 missense variants reported in ClinVar as Benign, the five methods ranged in accuracy from 76.2-100%. Computational PMSA-based methods can be an excellent classifier for variants of some hereditary cancer genes. However, there may be characteristics of the APC gene and protein that confound the results of in silico algorithms. A systematic study of these features could greatly improve the automation of alignment-based techniques and the use of predictive algorithms in hereditary cancer genes.\n\nAuthor SummaryA critical problem in clinical genetics today is interpreting whether a genetic variant is benign or causes disease (pathogenic). Some of the hardest variants to interpret are those that change one amino acid for another in a protein sequence (a \"missense variant\"). Various computer programs are often used to predict whether mutations in disease-associated genes likely cause disease. Most computer programs involve studying how the gene has changed during evolution, comparing the protein sequences of different species by aligning them with each other. Variants in amino acids that have not tolerated mutation during evolution are usually predicted to be pathogenic, and variants in amino acids that have tolerated variation are usually predicted to be benign. High quality alignments are necessary to make accurate predictions. However, creating high quality alignments is difficult, not easily automated, and requires significant manual curation. Results from computer-generated predictions are used in current published guidelines as one tool for evaluating whether variants will disrupt the protein function and cause disease. These guidelines may be applied to genes in which single amino acid substitutions do not commonly cause disease. One such example is the APC gene, which is responsible for Familial Adenomatous Polyposis (FAP). Missense APC changes are not a common cause of FAP. Our analysis of APC demonstrated the difficulty of generating an accurate protein sequence alignment and the tendency of computer tools to overestimate the damaging effects of amino acid substitutions. Our results suggest that the rules for using computer-based tools to predict whether a variant causes disease should be modified when applied to genes in which missense variants rarely cause disease.

genetics↗

Recommendations for application of the functional evidence PS3/BS3 criterion using the ACMG/AMP sequence variant interpretation framework

BackgroundThe American College of Medical Genetics and Genomics (ACMG)/Association for Molecular Pathology (AMP) clinical variant interpretation guidelines established criteria (PS3/BS3) for functional assays that specified a \"strong\" level of evidence. However, they did not provide detailed guidance on how functional evidence should be evaluated, and differences in the application of the PS3/BS3 codes is a contributor to variant interpretation discordance between laboratories. This recommendation seeks to provide a more structured approach to the assessment of functional assays for variant interpretation and guidance on the use of various levels of strength based on assay validation.\n\nMethodsThe Clinical Genome Resource (ClinGen) Sequence Variant Interpretation (SVI) Working Group used curated functional evidence from ClinGen Variant Curation Expert Panel-developed rule specifications and expert opinions to refine the PS3/BS3 criteria over multiple in-person and virtual meetings. We estimated odds of pathogenicity for assays using various numbers of variant controls to determine the minimum controls required to reach moderate level evidence. Feedback from the ClinGen Steering Committee and outside experts were incorporated into the recommendations at multiple stages of development.\n\nResultsThe SVI Working Group developed recommendations for evaluators regarding the assessment of the clinical validity of functional data and a four-step provisional framework to determine the appropriate strength of evidence that can be applied in clinical variant interpretation. These steps are: 1. Define the disease mechanism; 2. Evaluate applicability of general classes of assays used in the field; 3. Evaluate validity of specific instances of assays; 4. Apply evidence to individual variant interpretation. We found that a minimum of eleven total pathogenic and benign variant controls are required to reach moderate-level evidence in the absence of rigorous statistical analysis.\n\nConclusionsThe recommendations and approach to functional evidence evaluation described here should help clarify the clinical variant interpretation process for functional assays. Further, we hope that these recommendations will help develop productive partnerships with basic scientists who have developed functional assays that are useful for interrogating the function of a variety of genes.

genetics↗