EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Unified Multi-Modal Mixture-of-Experts Model for Integrated Representation Learning in Pharmaceutical Sciences

Anushree Bhople

International Journal of Clinical Research and Medical Sciences · 13.06.2026 · 1 (2)

DOI: 10.67231/kytb0e28 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Clinical Research and Medical Sciences, online erschienen am 13.06.2026. Verfasst von Anushree Bhople. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid advancement of large language models (LLMs) has opened up opportunities for AI applications in pharmaceutical sciences. However, integrating diverse biological data modalities continues to remain challenging. We propose SciMind, a multi-modal mixture-of-experts (MoE) having the capability of integrated representation learning from pharmaceutical data sources, including biomedical text, DNA sequence, protein sequence, and molecular structure. The proposed method includes method-specific tokenization strategies, sparse expert routing mechanisms, and cross-modal pre-training for improved knowledge transfer across multiple biological representations. An expert initialization approach based on limited K-means and adaptive top-k routing can use the parameters effectively while preserving domain-specific knowledge. Through experimental evaluations across four applications, including biomedical natural language processing, molecular understanding, promoter prediction and protein-related tasks, SciMind achieves competitive performance against existing domain-specific and general-purpose models. According to the results, unified multi-modal learning can assist in the representation quality, drug reasoning capabilities, and applications in drug acceptance, molecule analysis, and personalized medicine.

Zitieren

APA

Bhople, A. (2026). A Unified Multi-Modal Mixture-of-Experts Model for Integrated Representation Learning in Pharmaceutical Sciences. International Journal of Clinical Research and Medical Sciences, 1(2). https://doi.org/10.67231/kytb0e28

Vancouver

Bhople A. A Unified Multi-Modal Mixture-of-Experts Model for Integrated Representation Learning in Pharmaceutical Sciences. International Journal of Clinical Research and Medical Sciences. 2026;1(2). doi:10.67231/kytb0e28

BibTeX
@article{Bhople2026,
  author = {Bhople, Anushree},
  title = {A Unified Multi-Modal Mixture-of-Experts Model for Integrated Representation Learning in Pharmaceutical Sciences},
  journal = {International Journal of Clinical Research and Medical Sciences},
  year = {2026},
  volume = {1},
  number = {2},
  doi = {10.67231/kytb0e28}
}
Kostenlos starten →