Benchmarking Inverse Folding Models for Antibody CDR Sequence Design
Antibody-based therapies are at the forefront of modern medicine, addressing diverse challenges across oncology, autoimmune diseases, infectious diseases, and beyond. The ability to design antibodies with enhanced functionality and specificity is critical for advancing next-generation therapeutics. Recent advances in artificial intelligence (AI) have propelled the field of antibody engineering, particularly through inverse folding models for Complementarity-Determining Region (CDR) sequence design. These models aim to generate novel antibody sequences that fold into desired structures with high antigen-binding affinity. However, current evaluation metrics, such as amino acid recovery rates, are limited in their ability to assess the structural and functional accuracy of designed sequences. This study benchmarks state-of-the-art inverse folding models--ProteinMPNN, ESM-IF, LM-Design, and AntiFold--using comprehensive datasets and alternative evaluation metrics like sequence similarity. By systematically analyzing recovery rates, mutation prediction capabilities, and amino acid composition biases, we identify strengths and limitations across models. AntiFold exhibits superior performance in Fab antibody design, particularly in variable regions like CDRH3, whereas LM-Design demonstrates adaptability across diverse antibody types, including VHH antibodies. In contrast, models trained on general protein datasets (e.g., ProteinMPNN and ESM-IF) struggle with antibody-specific nuances. Key insights include the models varying reliance on antigen structure and their distinct capabilities in capturing critical residues for antigen binding. Our findings highlight the need for enhanced training datasets, integration of functional data, and refined evaluation metrics to advance antibody design tools. By addressing these challenges, future models can unlock the full potential of AI-driven antibody engineering, paving the way for innovative therapeutic applications. Author SummaryAntibodies play a vital role in modern medicine, offering targeted therapies for diseases ranging from cancer to infectious diseases. Designing new antibodies with specific and enhanced functionalities remains a key challenge in advancing therapeutic applications. In this study, we benchmarked cutting-edge artificial intelligence models for antibody sequence design, focusing on their ability to generate sequences for the critical antigen-binding regions of antibodies, known as Complementarity-Determining Regions (CDRs). Our findings reveal that specialized models like AntiFold excel in designing human antibody fragments, particularly in complex regions, while other models such as LM-Design demonstrate versatility across different antibody types. Importantly, we identified the limitations of models trained on general protein datasets, highlighting the need for antibody-specific training data to capture the unique features critical for therapeutic effectiveness. By evaluating these models against robust datasets and diverse metrics, our work underscores the importance of improving training data and evaluation methods to advance AI-driven antibody design. These insights pave the way for more accurate and effective tools, ultimately supporting the development of next-generation antibody-based therapeutics.