Systematic Profiling of Encoder Architectures and Multimodal Embeddings in Protein Foundation Models Reveals Data Set-Driven Separability Regimes in Prediction of Allosteric and Orthosteric Binding Sites
Journal of Chemical Information and Modeling · 09.11.2026 · 66 (21) · 13913-13937
DOI: 10.1021/acs.jcim.6c03114 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Chemical Information and Modeling, online erschienen am 26.10.2026. Verfasst von Alina Bazarova und 1 weiteren Autor:innen. Beteiligte Einrichtung: Jülich Supercomputing Centre, Forschungszentrum Jülich, Wilhelm-Johnen-Strasse, Jülich52428, Germany. Hauptthemen laut MEDLINE: Proteins, Models, Molecular, Computational Biology. Die Arbeit nennt 76 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Institute of Allergy and Infectious Diseases, Helmholtz Association, NIAID NIH HHS.
Abstract (Originalsprache)
Allosteric regulation represents a fundamental mechanism of protein function, yet distinguishing allosteric from orthosteric protein-binding sites remains a persistent computational challenge. While multimodal protein foundation models offer the potential to integrate complementary biological signals, including sequence, structure, functional annotations, and conformational dynamics, their performance determinants in allosteric binding site detection remain poorly understood. We introduce a unified computational framework for profiling multimodal protein foundation models across distinct binding site separability regimes. Rather than evaluating models solely by predictive accuracy, the framework combines systematic modality embedding ablations, encoder architecture comparisons, and variance decomposition to characterize how evolutionary, structural, functional, and dynamical information contributes to allosteric site discrimination. Using the OneProt multimodal model, we evaluate two complementary levels of multimodal integration: (a) encoder architectures that differ in the modalities incorporated during pretraining and (b) downstream combinations of pocket, sequence, and text embeddings used for classification. To systematically probe the determinants of model performance, we benchmark these configurations across four assembled data sets of protein complexes representing a spectrum of biological complexity and a range of structural, dynamic, and evolutionary contexts for orthosteric and allosteric binding sites. Through comprehensive embedding ablations, encoder architecture comparisons, and variance decomposition, we demonstrate that model performance is governed primarily by intrinsic data set properties rather than architectural complexity, with data set identity accounting for 63.7% of explainable variance. Across the data sets examined, we identify substantial differences not only in overall separability but also in the information accessible from different pretrained representations. Single-modality controls show that high predictive performance does not necessarily imply reliance on the explicitly provided pocket representation: depending on data set composition, substantial discrimination can already be obtained from sequence- or text-based multimodal representations. Within-protein comparisons nevertheless demonstrate that pocket-containing representations retain binding site-specific discriminatory information when protein identity and the associated sequence and text representations are held constant. At the encoder level, structural and molecular dynamics encoders provide the greatest benefit in intermediate and high separability settings. Example-level analysis further shows that combining data sets can reshape which binding sites are preferentially recognized. These findings establish that the success of multimodal foundation models depends critically on alignment between available modalities and the biological signatures that distinguish regulatory classes in each data set.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Substanzen
Autor:innen und Institutionen
- Jülich Supercomputing Centre, Forschungszentrum Jülich, Wilhelm-Johnen-Strasse, Jülich52428, Germany.
- Helmholtz AI Munich, Ingolstädter Landstraße 1, Neuherberg85764, Germany.
- Keck Center for Science and Engineering, Schmid College of Science and Technology, Chapman University, Orange, California92866, United States.
- Department of Biomedical and Pharmaceutical Sciences, School of Pharmacy, Chapman University, Irvine, California92618, United States.
ORCID-Profile: Alina Bazarova, Gennady M Verkhivker
Förderung
- National Institute of Allergy and Infectious Diseases
- Helmholtz Association
- NIAID NIH HHS
Zitieren
APA
Bazarova, A., & Verkhivker, G. M. (2026). Systematic Profiling of Encoder Architectures and Multimodal Embeddings in Protein Foundation Models Reveals Data Set-Driven Separability Regimes in Prediction of Allosteric and Orthosteric Binding Sites. Journal of Chemical Information and Modeling, 66(21), 13913-13937. https://doi.org/10.1021/acs.jcim.6c03114
Vancouver
Bazarova A, Verkhivker GM. Systematic Profiling of Encoder Architectures and Multimodal Embeddings in Protein Foundation Models Reveals Data Set-Driven Separability Regimes in Prediction of Allosteric and Orthosteric Binding Sites. Journal of Chemical Information and Modeling. 2026;66(21):13913-13937. doi:10.1021/acs.jcim.6c03114
BibTeX
@article{Bazarova2026,
author = {Bazarova, Alina and Verkhivker, Gennady M},
title = {Systematic Profiling of Encoder Architectures and Multimodal Embeddings in Protein Foundation Models Reveals Data Set-Driven Separability Regimes in Prediction of Allosteric and Orthosteric Binding Sites},
journal = {Journal of Chemical Information and Modeling},
year = {2026},
volume = {66},
number = {21},
pages = {13913--13937},
doi = {10.1021/acs.jcim.6c03114}
}
EUVIMED