EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Systematic Profiling of Encoder Architectures and Multimodal Embeddings in Protein Foundation Models Reveals Data Set-Driven Separability Regimes in Prediction of Allosteric and Orthosteric Binding Sites

Alina Bazarova iD, Gennady M Verkhivker iD

Journal of Chemical Information and Modeling · 09.11.2026 · 66 (21) · 13913-13937

DOI: 10.1021/acs.jcim.6c03114 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Chemical Information and Modeling, online erschienen am 26.10.2026. Verfasst von Alina Bazarova und 1 weiteren Autor:innen. Beteiligte Einrichtung: Jülich Supercomputing Centre, Forschungszentrum Jülich, Wilhelm-Johnen-Strasse, Jülich52428, Germany. Hauptthemen laut MEDLINE: Proteins, Models, Molecular, Computational Biology. Die Arbeit nennt 76 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Institute of Allergy and Infectious Diseases, Helmholtz Association, NIAID NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Allosteric regulation represents a fundamental mechanism of protein function, yet distinguishing allosteric from orthosteric protein-binding sites remains a persistent computational challenge. While multimodal protein foundation models offer the potential to integrate complementary biological signals, including sequence, structure, functional annotations, and conformational dynamics, their performance determinants in allosteric binding site detection remain poorly understood. We introduce a unified computational framework for profiling multimodal protein foundation models across distinct binding site separability regimes. Rather than evaluating models solely by predictive accuracy, the framework combines systematic modality embedding ablations, encoder architecture comparisons, and variance decomposition to characterize how evolutionary, structural, functional, and dynamical information contributes to allosteric site discrimination. Using the OneProt multimodal model, we evaluate two complementary levels of multimodal integration: (a) encoder architectures that differ in the modalities incorporated during pretraining and (b) downstream combinations of pocket, sequence, and text embeddings used for classification. To systematically probe the determinants of model performance, we benchmark these configurations across four assembled data sets of protein complexes representing a spectrum of biological complexity and a range of structural, dynamic, and evolutionary contexts for orthosteric and allosteric binding sites. Through comprehensive embedding ablations, encoder architecture comparisons, and variance decomposition, we demonstrate that model performance is governed primarily by intrinsic data set properties rather than architectural complexity, with data set identity accounting for 63.7% of explainable variance. Across the data sets examined, we identify substantial differences not only in overall separability but also in the information accessible from different pretrained representations. Single-modality controls show that high predictive performance does not necessarily imply reliance on the explicitly provided pocket representation: depending on data set composition, substantial discrimination can already be obtained from sequence- or text-based multimodal representations. Within-protein comparisons nevertheless demonstrate that pocket-containing representations retain binding site-specific discriminatory information when protein identity and the associated sequence and text representations are held constant. At the encoder level, structural and molecular dynamics encoders provide the greatest benefit in intermediate and high separability settings. Example-level analysis further shows that combining data sets can reshape which binding sites are preferentially recognized. These findings establish that the success of multimodal foundation models depends critically on alignment between available modalities and the biological signatures that distinguish regulatory classes in each data set.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ProteinsModels, MolecularComputational BiologyBinding SitesAllosteric SiteAllosteric RegulationProtein Conformation

Substanzen

Proteins

Autor:innen und Institutionen

  • Jülich Supercomputing Centre, Forschungszentrum Jülich, Wilhelm-Johnen-Strasse, Jülich52428, Germany.
  • Helmholtz AI Munich, Ingolstädter Landstraße 1, Neuherberg85764, Germany.
  • Keck Center for Science and Engineering, Schmid College of Science and Technology, Chapman University, Orange, California92866, United States.
  • Department of Biomedical and Pharmaceutical Sciences, School of Pharmacy, Chapman University, Irvine, California92618, United States.

ORCID-Profile: Alina Bazarova, Gennady M Verkhivker

Förderung

  • National Institute of Allergy and Infectious Diseases
  • Helmholtz Association
  • NIAID NIH HHS

Zitieren

APA

Bazarova, A., & Verkhivker, G. M. (2026). Systematic Profiling of Encoder Architectures and Multimodal Embeddings in Protein Foundation Models Reveals Data Set-Driven Separability Regimes in Prediction of Allosteric and Orthosteric Binding Sites. Journal of Chemical Information and Modeling, 66(21), 13913-13937. https://doi.org/10.1021/acs.jcim.6c03114

Vancouver

Bazarova A, Verkhivker GM. Systematic Profiling of Encoder Architectures and Multimodal Embeddings in Protein Foundation Models Reveals Data Set-Driven Separability Regimes in Prediction of Allosteric and Orthosteric Binding Sites. Journal of Chemical Information and Modeling. 2026;66(21):13913-13937. doi:10.1021/acs.jcim.6c03114

BibTeX
@article{Bazarova2026,
  author = {Bazarova, Alina and Verkhivker, Gennady M},
  title = {Systematic Profiling of Encoder Architectures and Multimodal Embeddings in Protein Foundation Models Reveals Data Set-Driven Separability Regimes in Prediction of Allosteric and Orthosteric Binding Sites},
  journal = {Journal of Chemical Information and Modeling},
  year = {2026},
  volume = {66},
  number = {21},
  pages = {13913--13937},
  doi = {10.1021/acs.jcim.6c03114}
}
Kostenlos starten →