bioRxiv Science⌕ Search

Biology subjects

Rocklin, G. J.

Publications and source records attributed to Rocklin, G. J..

9 recordsLinked to original sources

Accurate protein stability prediction for small domains using mega-scale experiments

Predicting absolute protein folding stability is a long-standing challenge in biophysics, with broad applications in protein design and in understanding genetic variation and evolution. Physics-based simulations have shown limited success at predicting stability and are often computationally intractable, and machine learning methods have been constrained by the lack of sufficiently large experimental datasets. We recently introduced cDNA display proteolysis, a cell-free approach that can measure folding stability for nearly one million protein domains in parallel. Here, we applied this method to measure stability for 1.8 million diverse protein domains 60-80 amino acids in length primarily taken from the MGnify metagenomic database and spanning over 200,000 sequence families. Using this new "MGnify Stability dataset", we developed the predictive models SaProt{Delta}G and ESM3{Delta}G, which accurately predict absolute folding stability for small domains with root mean squared error of 0.8 kcal/mol over a 6 kcal/mol range (Spearman rank correlation of 0.88). These predictors show high accuracy at predicting effects of substitutions, insertions, and deletions, successfully identify global trends toward higher stability in thermophilic organisms, and improve discrimination of stable and unstable computationally designed proteins. Our results illustrate how megascale biophysical measurements can complement existing evolutionary and structural data to enable accurate absolute stability prediction for small domains.

biophysics↗

Using experimental results of protein design to guide biomolecular energy-function development

Computational models of macromolecules have many applications in biochemistry, but physical inaccuracies limit their utility. One class of models uses energy functions rooted in classical mechanics. The standard datasets used to train these models are limited in diversity, pointing to a need for new training data. Here, we sought to explore a new paradigm for training an energy function, where the Rosetta energy function was used to design de novo proteins. Experimental results on these designs were then used to identify failure modes of design, which were subsequently used as a "guiding principle" to retrain the energy function. Specifically, we examined a diverse set of de novo protein designs experimentally tested for their ability to stably fold, identifying unstable designs that were predicted to be stable by the Rosetta energy function. Using deep mutational scanning, we identified single amino-acid mutations that rescued the stability of these designs, providing insight into common failure modes of the energy function. We identified one key failure mode, involving steric clashing in protein cores. We identified similar overpacking when using Rosetta to refine high-resolution protein crystal structures, quantified the degree of overpacking, and refit a small set of energy-function parameters to better recapitulate native-like packing. Following fitting, we largely eliminated the failure mode in the refinement task, while retaining performance on other benchmarks, resulting in an updated version of the Rosetta energy function. This work shows how learning from protein designs can guide energy-function development. Author summaryComputational models of macromolecules have many applications, such as predicting structures, predicting mutational effects, or designing new proteins. One type of model uses an energy function to explicitly model the physical forces at play. These models are trained using experimental data. However, available training data are limited in number and diversity, prompting a need for new sources of training data. In this paper, we explore a new paradigm for training an energy function, which involves using the energy function to design de novo proteins and then learning from which designs succeed and which fail when experimentally tested in the lab. We used experimental data to learn common failure modes in design, identified examples of a failure mode in a high-quality benchmark, and then used this benchmark to retrain the energy function. Using this strategy, we identified and largely resolved a bias in the Rosetta energy function that involved energetically unfavorable steric clashes in protein cores. Overall, this work helps establish a framework for how learning from design can be used to guide the development of macromolecular models.

biochemistry↗

Global Analysis of Aggregation Determinants in Small Protein Domains

Protein aggregation is an obstacle for engineering effective recombinant proteins for biotechnology and therapeutic applications. Predicting protein aggregation propensity remains challenging due to the complex interplay of sequence, structure, environmental factors, and external stress conditions, particularly for globular proteins. To understand the determinants of aggregation and improve its prediction, we quantified insoluble aggregation following high temperature and acidic stress in custom libraries of small protein domains (40-72 amino acids) using a high-throughput, in vitro, mass spectrometry-based method. In total, we quantified aggregation for 18,987 small protein domains, revealing diverse stress-dependent aggregation phenotypes that were consistent in different library contexts. We also found that aggregation measurements on individually purified proteins strongly correlated with high-throughput mixed-pool data (Pearsons r = 0.65-0.79), supporting the use of multiplexed approaches to study aggregation. Using machine learning, we identified sequence and structural features that correlate with aggregation and fine-tuned the protein language model SaProt, which explained 43-55% of the observed variation in a held-out test set of unrelated protein domains. Our model shows promising utility for engineering aggregation-resistant proteins, and our dataset serves as an important resource for developing improved models of protein aggregation.

biophysics↗

Evaluating zero-shot prediction of protein design success by AlphaFold, ESMFold, and ProteinMPNN

De novo protein design has enabled the creation of proteins with diverse functionalities that are not found in nature. Despite recent advances, experimental success rates remain inconsistent and context-dependent, posing a bottleneck for broader applications of de novo design. To overcome this, structure and sequence prediction models have been applied to assess design quality prior to experimental testing to save time and resources. In this study, we aimed to determine the extent to which AlphaFold2, Protein MPNN, and ESMFold can discriminate between experimentally successful and unsuccessful designs. For this, we curated a benchmark dataset of 614 experimentally characterized de novo designed monomers from 11 different design studies between 2012 and 2021. All predictive models demonstrated moderate ability to discriminate experimental successes (expressed, soluble, monomeric, and fold into the intended design structure) from failures, with many failed designs having better confidence metrics than successful designs. Among all computational models evaluated, ESMFold average pLDDT yielded the best individual performance at distinguishing between successful and unsuccessful designs. A logistic regression model combining all confidence metrics provided only modest improvement over ESMFold pLDDT alone. Overall, these results show that these models can serve as an initial filtering strategy prior to experimental validation; however, their utility at accurately predicting experimental successful designs remains limited without task-specific training.

bioinformatics↗

Large-scale discovery, analysis, and design of protein energy landscapes

All folded proteins continuously fluctuate between their low-energy native structures and higher energy conformations that can be partially or fully unfolded. These rare states influence protein function, interactions, aggregation, and immunogenicity, yet they remain far less understood than protein native states. Although native protein structures are now often predictable with impressive accuracy, conformational fluctuations and their energies remain largely invisible and unpredictable, and experimental challenges have prevented large-scale measurements that could improve machine learning and physics-based modeling. Here, we introduce a multiplexed experimental approach to analyze the energies of conformational fluctuations for hundreds of protein domains in parallel using intact protein hydrogen-deuterium exchange mass spectrometry. We analyzed 5,778 domains 28-64 amino acids in length, revealing hidden variation in conformational fluctuations even between sequences sharing the same fold and global folding stability. Site-resolved hydrogen exchange NMR analysis of 13 domains showed that these fluctuations often involve entire secondary structural elements with lower stability than the overall fold. Computational modeling of our domains identified structural features that correlated with the experimentally observed fluctuations, enabling us to design mutations that stabilized low-stability structural segments. Our dataset enables new machine learning-based analysis of protein energy landscapes, and our experimental approach promises to reveal these landscapes at unprecedented scale.

biophysics↗

Structural and energetic analysis of stabilizing indel mutations

Amino acid insertions and deletions (indels) are among the most common protein mutations and necessitate changes to a proteins backbone geometry. Examining how indels affect protein folding stability (and especially how indels can increase stability) can help reveal the role of backbone energetics on stability and introduce new protein engineering strategies. Tsuboyama et al. measured folding stability for 57,698 single amino acid insertion or deletion mutants in 405 small domains, and this analysis identified 103 stabilizing mutants ({Delta}{Delta}Gunfolding > 1 kcal/mol). Here, we use computational modeling to analyze structural and energetic changes for these stabilizing indel mutants. We find that stabilizing indel mutations tend to have local structural effects and that stabilizing deletions (but less so insertions) are often found in regions of high backbone strain. We also find that stabilizing indels are typically correctly classified as stabilizing by the Rosetta energy function (which explicitly models backbone energetics), but not by an inverse folding (ESM-IF)-based analysis (Cagiada et al. 2024) which predicts absolute stability ({Delta}Gunfolding).

biophysics↗

Mega-scale experimental analysis of protein folding stability in biology and protein design

Advances in DNA sequencing and machine learning are illuminating protein sequences and structures on an enormous scale. However, the energetics driving folding are invisible in these structures and remain largely unknown. The hidden thermodynamics of folding can drive disease, shape protein evolution, and guide protein engineering, and new approaches are needed to reveal these thermodynamics for every sequence and structure. We present cDNA display proteolysis, a new method for measuring thermodynamic folding stability for up to 900,000 protein domains in a one-week experiment. From 1.8 million measurements in total, we curated a set of ~850,000 high-quality folding stabilities covering all single amino acid variants and selected double mutants of 354 natural and 188 de novo designed protein domains 40-72 amino acids in length. Using this immense dataset, we quantified (1) environmental factors influencing amino acid fitness, (2) thermodynamic couplings (including unexpected interactions) between protein sites, and (3) the global divergence between evolutionary amino acid usage and protein folding stability. We also examined how our approach could identify stability determinants in designed proteins and evaluate design methods. The cDNA display proteolysis method is fast, accurate, and uniquely scalable, and promises to reveal the quantitative rules for how amino acid sequences encode folding stability. One-Sentence SummaryMassively parallel measurement of protein folding stability by cDNA display proteolysis

biophysics↗

Dissecting the stability determinants of a challenging de novo protein fold using massively parallel design and experimentation

Designing entirely new protein structures remains challenging because we do not fully understand the biophysical determinants of folding stability. Yet some protein folds are easier to design than others. Previous work identified the 43-residue {square}{beta}{beta}{square} fold as especially challenging: the best designs had only a 2% success rate, compared to 39-87% success for other simple folds (1). This suggested the {square}{beta}{beta}{square} fold would be a useful model system for gaining a deeper understanding of folding stability determinants and for testing new protein design methods. Here, we designed over ten thousand new {square}{beta}{beta}{square} proteins and found over three thousand of them to fold into stable structures using a high-throughput protease-based assay. Nuclear magnetic resonance, hydrogen-deuterium exchange, circular dichroism, deep mutational scanning, and scrambled sequence control experiments indicated that our stable designs fold into their designed {square}{beta}{beta}{square} structures with exceptional stability for their small size. Our large dataset enabled us to quantify the influence of universal stability determinants including nonpolar burial, helix capping, and buried unsatisfied polar atoms, as well as stability determinants unique to the {square}{beta}{beta}{square} topology. Our work demonstrates how large-scale design and test cycles can solve challenging design problems while illuminating the biophysical determinants of folding. SignificanceMost computationally designed proteins fail to fold into their designed structures. This low success rate is a major obstacle to expanding the applications of protein design. In previous work, we discovered a small protein fold that was paradoxically challenging to design (only a 2% success rate) even though the fold itself is very simple. Here, we used a recently developed high-throughput approach to comprehensively examine the design rules for this simple fold. By designing over ten thousand proteins and experimentally measuring their folding stability, we discovered the key biophysical properties that determine the stability of these designs. Our results illustrate general lessons for protein design and also demonstrate how high-throughput stability studies can quantify the importance of different biophysical forces.

synthetic biology↗

Large-scale design and refinement of stable proteins using sequence-only models

Engineered proteins generally must possess a stable structure in order to achieve their designed function. Stable designs, however, are astronomically rare within the space of all possible amino acid sequences. As a consequence, many designs must be tested computationally and experimentally in order to find stable ones, which is expensive in terms of time and resources. Here we report a neural network model that predicts protein stability based only on sequences of amino acids, and demonstrate its performance by evaluating the stability of almost 200,000 novel proteins. These include a wide range of sequence perturbations, providing a baseline for future work in the field. We also report a second neural network model that is able to generate novel stable proteins. Finally, we show that the predictive model can be used to substantially increase the stability of both expert-designed and model-generated proteins.

biophysics↗