EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Determining epitope specificity of T-cell receptors with transformers

Abdul Rehman Khan, Marcel J T Reinders iD, Indu Khatri iD

Bioinformatics · 2023

DOI: 10.1093/bioinformatics/btad632 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Bioinformatics, 2023. Verfasst von Abdul Rehman Khan und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Intelligent Systems, Delft University of Technology, Delft 2600 GA, The Netherlands. Hauptthemen laut MEDLINE: Epitopes, T-Lymphocyte, Receptors, Antigen, T-Cell. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Summary T-cell receptors (TCRs) on T cells recognize and bind to epitopes presented by the major histocompatibility complex in case of an infection or cancer. However, the high diversity of TCRs, as well as their unique and complex binding mechanisms underlying epitope recognition, make it difficult to predict the binding between TCRs and epitopes. Here, we present the utility of transformers, a deep learning strategy that incorporates an attention mechanism that learns the informative features, and show that these models pre-trained on a large set of protein sequences outperform current strategies. We compared three pre-trained auto-encoder transformer models (ProtBERT, ProtAlbert, and ProtElectra) and one pre-trained auto-regressive transformer model (ProtXLNet) to predict the binding specificity of TCRs to 25 epitopes from the VDJdb database (human and murine). Two additional modifications were performed to incorporate gene usage of the TCRs in the four transformer models. Of all 12 transformer implementations (four models with three different modifications), a modified version of the ProtXLNet model could predict TCR–epitope pairs with the highest accuracy (weighted F1 score 0.55 simultaneously considering all 25 epitopes). The modification included additional features representing the gene names for the TCRs. We also showed that the basic implementation of transformers outperformed the previously available methods, i.e. TCRGP, TCRdist, and DeepTCR, developed for the same biological problem, especially for the hard-to-classify labels. We show that the proficiency of transformers in attention learning can be made operational in a complex biological setting like TCR binding prediction. Further ingenuity in utilizing the full potential of transformers, either through attention head visualization or introducing additional features, can extend T-cell research avenues. Availability and implementation Data and code are available on https://github.com/InduKhatri/tcrformer.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Epitopes, T-LymphocyteReceptors, Antigen, T-CellHumansAnimalsMiceT-LymphocytesAmino Acid SequenceMajor Histocompatibility Complex

Substanzen

Epitopes, T-LymphocyteReceptors, Antigen, T-Cell

Autor:innen und Institutionen

  • Department of Intelligent Systems, Delft University of Technology, Delft 2600 GA, The Netherlands.
  • Leiden Computational Biology Center, Department of Molecular Epidemiology, Leiden University Medical Center, Leiden 2333 ZA, The Netherlands.
  • Department of Immunology, Leiden University Medical Center, Leiden 2333 ZA, The Netherlands.

ORCID-Profile: Marcel J T Reinders, Indu Khatri

Zitieren

APA

Khan, A. R., Reinders, M. J. T., & Khatri, I. (2023). Determining epitope specificity of T-cell receptors with transformers. Bioinformatics. https://doi.org/10.1093/bioinformatics/btad632

Vancouver

Khan AR, Reinders MJT, Khatri I. Determining epitope specificity of T-cell receptors with transformers. Bioinformatics. 2023. doi:10.1093/bioinformatics/btad632

BibTeX
@article{Khan2023,
  author = {Khan, Abdul Rehman and Reinders, Marcel J T and Khatri, Indu},
  title = {Determining epitope specificity of T-cell receptors with transformers},
  journal = {Bioinformatics},
  year = {2023},
  doi = {10.1093/bioinformatics/btad632}
}
Kostenlos starten →