Multi-view mixture-of-experts for predicting molecular properties using SMILES, SELFIES, and graph-based representations
Machine Learning: Science and Technology · 30.06.2025 · 6 (2) · 025070
DOI: 10.1088/2632-2153/ade4ef ↗Kurz gefasst
Fachartikel in der Zeitschrift Machine Learning: Science and Technology, online erschienen am 25.06.2025. Verfasst von Eduardo Soares und 4 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Chemical foundation models are generally based on a two-step approach-pre-training on unlabeled data followed by fine-tuning on specific tasks-to boost model capacity. With the increasing demand for training efficiency, mixture-of-experts (MoEs) has become essential for scaling large models by selectively activating sub-networks of experts through a gating network, thereby optimizing performance. This paper presents molecular MoL-MoE, a multi-view MoEs framework designed to predict molecular properties by integrating latent spaces derived from SMILES, SELFIES, and molecular graphs. Our approach leverages the complementary strengths of these representations to enhance predictive accuracy. Here, we evaluate the performance of MoL-MoE with a total of 12 experts, organized into 4 experts for each modality (SMILES, SELFIES, and molecular graphs). We evaluate MoL-MoE on a range of benchmark datasets from MoleculeNet, demonstrating its superior performance compared to state-of-the-art methods across all nine datasets considering two different routing activation settings: k = 4 and k = 6. The results underscore the model’s robustness and adaptability in handling various complex molecular prediction tasks. Our analysis of routing activation patterns reveals that MoL-MoE dynamically adjusts its use of different molecular representations based on task-specific requirements. This adaptability highlights the importance of representation choice in optimizing model performance. Source code for MoL-MoE is available at https://github.com/IBM/materials/tree/main/models/mol_moe .
Zitieren
APA
Soares, E., Shirasuna, V. Y., Brazil, E. V., Priyadarsini, I., & Takeda, S. (2025). Multi-view mixture-of-experts for predicting molecular properties using SMILES, SELFIES, and graph-based representations. Machine Learning: Science and Technology, 6(2), 025070. https://doi.org/10.1088/2632-2153/ade4ef
Vancouver
Soares E, Shirasuna VY, Brazil EV, Priyadarsini I, Takeda S. Multi-view mixture-of-experts for predicting molecular properties using SMILES, SELFIES, and graph-based representations. Machine Learning: Science and Technology. 2025;6(2):025070. doi:10.1088/2632-2153/ade4ef
BibTeX
@article{Soares2025,
author = {Soares, Eduardo and Shirasuna, Victor Yukio and Brazil, Emilio Vital and Priyadarsini, Indra and Takeda, Seiji},
title = {Multi-view mixture-of-experts for predicting molecular properties using SMILES, SELFIES, and graph-based representations},
journal = {Machine Learning: Science and Technology},
year = {2025},
volume = {6},
number = {2},
pages = {025070},
doi = {10.1088/2632-2153/ade4ef}
}
EUVIMED