A Unified Multi-Modal Mixture-of-Experts Model for Integrated Representation Learning in Pharmaceutical Sciences
International Journal of Clinical Research and Medical Sciences · 13.06.2026 · 1 (2)
DOI: 10.67231/kytb0e28 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Clinical Research and Medical Sciences, online erschienen am 13.06.2026. Verfasst von Anushree Bhople. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
The rapid advancement of large language models (LLMs) has opened up opportunities for AI applications in pharmaceutical sciences. However, integrating diverse biological data modalities continues to remain challenging. We propose SciMind, a multi-modal mixture-of-experts (MoE) having the capability of integrated representation learning from pharmaceutical data sources, including biomedical text, DNA sequence, protein sequence, and molecular structure. The proposed method includes method-specific tokenization strategies, sparse expert routing mechanisms, and cross-modal pre-training for improved knowledge transfer across multiple biological representations. An expert initialization approach based on limited K-means and adaptive top-k routing can use the parameters effectively while preserving domain-specific knowledge. Through experimental evaluations across four applications, including biomedical natural language processing, molecular understanding, promoter prediction and protein-related tasks, SciMind achieves competitive performance against existing domain-specific and general-purpose models. According to the results, unified multi-modal learning can assist in the representation quality, drug reasoning capabilities, and applications in drug acceptance, molecule analysis, and personalized medicine.
Zitieren
APA
Bhople, A. (2026). A Unified Multi-Modal Mixture-of-Experts Model for Integrated Representation Learning in Pharmaceutical Sciences. International Journal of Clinical Research and Medical Sciences, 1(2). https://doi.org/10.67231/kytb0e28
Vancouver
Bhople A. A Unified Multi-Modal Mixture-of-Experts Model for Integrated Representation Learning in Pharmaceutical Sciences. International Journal of Clinical Research and Medical Sciences. 2026;1(2). doi:10.67231/kytb0e28
BibTeX
@article{Bhople2026,
author = {Bhople, Anushree},
title = {A Unified Multi-Modal Mixture-of-Experts Model for Integrated Representation Learning in Pharmaceutical Sciences},
journal = {International Journal of Clinical Research and Medical Sciences},
year = {2026},
volume = {1},
number = {2},
doi = {10.67231/kytb0e28}
}
EUVIMED