CAMR: cross-aligned multimodal representation learning for cancer survival prediction
Bioinformatics · 01.01.2023 · 39 (1)
DOI: 10.1093/bioinformatics/btad025 ↗Kurz gefasst
Fachartikel in der Zeitschrift Bioinformatics, online erschienen am 13.01.2023. Verfasst von Xingqi Wu und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Information Science and Technology, University of Science and Technology of China, Hefei AH230027, China. Hauptthemen laut MEDLINE: Neoplasms. Die Arbeit wurde bisher 50-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Motivation Accurately predicting cancer survival is crucial for helping clinicians to plan appropriate treatments, which largely improves the life quality of cancer patients and spares the related medical costs. Recent advances in survival prediction methods suggest that integrating complementary information from different modalities, e.g. histopathological images and genomic data, plays a key role in enhancing predictive performance. Despite promising results obtained by existing multimodal methods, the disparate and heterogeneous characteristics of multimodal data cause the so-called modality gap problem, which brings in dramatically diverse modality representations in feature space. Consequently, detrimental modality gaps make it difficult for comprehensive integration of multimodal information via representation learning and therefore pose a great challenge to further improvements of cancer survival prediction. Results To solve the above problems, we propose a novel method called cross-aligned multimodal representation learning (CAMR), which generates both modality-invariant and -specific representations for more accurate cancer survival prediction. Specifically, a cross-modality representation alignment learning network is introduced to reduce modality gaps by effectively learning modality-invariant representations in a common subspace, which is achieved by aligning the distributions of different modality representations through adversarial training. Besides, we adopt a cross-modality fusion module to fuse modality-invariant representations into a unified cross-modality representation for each patient. Meanwhile, CAMR learns modality-specific representations which complement modality-invariant representations and therefore provides a holistic view of the multimodal data for cancer survival prediction. Comprehensive experiment results demonstrate that CAMR can successfully narrow modality gaps and consistently yields better performance than other survival prediction methods using multimodal data. Availability and implementation CAMR is freely available at https://github.com/wxq-ustc/CAMR. Supplementary information Supplementary data are available at Bioinformatics online.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- School of Information Science and Technology, University of Science and Technology of China, Hefei AH230027, China.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Wu, X., Shi, Y., Wang, M., & Li, A. (2023). CAMR: cross-aligned multimodal representation learning for cancer survival prediction. Bioinformatics, 39(1). https://doi.org/10.1093/bioinformatics/btad025
Vancouver
Wu X, Shi Y, Wang M, Li A. CAMR: cross-aligned multimodal representation learning for cancer survival prediction. Bioinformatics. 2023;39(1). doi:10.1093/bioinformatics/btad025
BibTeX
@article{Wu2023,
author = {Wu, Xingqi and Shi, Yi and Wang, Minghui and Li, Ao},
title = {CAMR: cross-aligned multimodal representation learning for cancer survival prediction},
journal = {Bioinformatics},
year = {2023},
volume = {39},
number = {1},
doi = {10.1093/bioinformatics/btad025}
}
EUVIMED