Hossein Khalaj, B. | bioRxiv Science

bioRxiv2024

Modeling Primer-Template Interactions using BERT Tokenizer to Predict PCR Amplification with Attention-BiLSTM

Polymerase Chain Reaction (PCR) is a widely used molecular biology technique to amplify DNA sequences. PCR amplification is affected by factors such as binding dynamics and primer-template interactions. This study aims to reduce the time and cost of the experiment by predicting PCR outcomes based on these factors. To achieve this, we first identify the most stable binding sites for each primer-template pair by calculating the Gibbs free energy. Then, we propose a unique labelling strategy that captures primer-template interactions in the binding sites by analyzing match and mismatch positions. We categorize a set of English words into two semantically distinct groups: one for match positions and another for mismatch positions. Words within each group have a higher cosine similarity to one another than to words in the opposing group. We assign the corresponding word to each base pair based on whether it is a match or a mismatch. The labelled sequence is then tokenized with BERT, serving as input to an CNN-BiLSTM model. Achieving 84.8% accuracy, this approach outperforms prior methods and pioneers BERT-based analysis in primer-template bindings. Crucially, the model also demonstrates significantly better sensitivity, specificity, and Area Under the ROC Curve (AUC) compared to prior work, indicating a more robust capability to correctly distinguish both successful and failed PCR outcomes, which is vital for reliable experimental prediction. HighlightsO_LISelecting the most important features for PCR amplification using Random Forest Classifier C_LIO_LIProposing a new labelling approach to represent the matches and mismatches between PCR primers and templates C_LIO_LIUsing BERT tokenizer to tokenize the corresponding representation of matches and mis-matches C_LIO_LIAugmenting the data based on the semantic similarities of the words in the BERT tokenizer C_LIO_LIUsing CNN-BiLSTM to predict PCR amplification results C_LI

bioinformatics↗

bioRxiv2018

Enhanced Waddington Landscape Model with Cell-CellCommunication Can Explain Molecular Mechanisms ofSelf-Organization

The molecular mechanisms of self-organization that orchestrate embryonic cells to create astonishing patterns have been among major questions of developmental biology. It is recently shown that embryonic stem cells (ESCs), when cultured on particular micropatterns, can self-organize and mimic early steps of pre-implantation embryogenesis. A systems-biology model to address this observation from a dynamical systems perspective is essential. Here, we propose a multicellular mathematical model for pattern formation during in vitro gastrulation of human ESCs. This model enhances the basic principles of Waddington epigenetic landscape with cell-cell communication, in order to enable pattern and tissue formation. To prevent overfitting of the model, there is a minimal number of parameters in the model, which are sufficient to address different experimental observations such as the formation of three germ layers and trophectoderm, responses to altered culture conditions and micropattern diameters, and unexpected spotted forms of the germ layers under certain conditions. This model provides a basis for in-silico modeling of self-organization.

systems biology↗