EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Disentangled Representation-Based Multimodal Fusion Framework Integrating Pathomics and Radiomics for KRAS Mutation Detection in Colorectal Cancer

Zhilong Lv, Rui Yan, Yuexiao Lin, Lin Gao, Fa Zhang, Ying Wang

Big Data Mining and Analytics · 2024-09 · 7 (3) · 590-602

DOI: 10.26599/bdma.2024.9020012 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Big Data Mining and Analytics, 2024-09. Verfasst von Zhilong Lv und 5 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Kirsten rat sarcoma viral oncogene homolog (namely KRAS) is a key biomarker for prognostic analysis and targeted therapy of colorectal cancer. Recently, the advancement of machine learning, especially deep learning, has greatly promoted the development of KRAS mutation detection from tumor phenotype data, such as pathology slides or radiology images. However, there are still two major problems in existing studies: inadequate single-modal feature learning and lack of multimodal phenotypic feature fusion. In this paper, we propose a Disentangled Representation-based Multimodal Fusion framework integrating Pathomics and Radiomics (DRMF-PaRa) for KRAS mutation detection. Specifically, the DRMF-PaRa model consists of three parts: (1) the pathomics learning module, which introduces a tissue-guided Transformer model to extract more comprehensive and targeted pathological features; (2) the radiomics learning module, which captures the generic hand-crafted radiomics features and the task-specific deep radiomics features; (3) the disentangled representation-based multimodal fusion module, which learns factorized subspaces for each modality and provides a holistic view of the two heterogeneous phenotypic features. The proposed model is developed and evaluated on a multi modality dataset of 111 colorectal cancer patients with whole slide images and contrast-enhanced CT. The experimental results demonstrate the superiority of the proposed DRMF-PaRa model with an accuracy of 0.876 and an AUC of 0.865 for KRAS mutation detection.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Lv, Z., Yan, R., Lin, Y., Gao, L., Zhang, F., & Wang, Y. (2024). A Disentangled Representation-Based Multimodal Fusion Framework Integrating Pathomics and Radiomics for KRAS Mutation Detection in Colorectal Cancer. Big Data Mining and Analytics, 7(3), 590-602. https://doi.org/10.26599/bdma.2024.9020012

Vancouver

Lv Z, Yan R, Lin Y, Gao L, Zhang F, Wang Y. A Disentangled Representation-Based Multimodal Fusion Framework Integrating Pathomics and Radiomics for KRAS Mutation Detection in Colorectal Cancer. Big Data Mining and Analytics. 2024;7(3):590-602. doi:10.26599/bdma.2024.9020012

BibTeX
@article{Lv2024,
  author = {Lv, Zhilong and Yan, Rui and Lin, Yuexiao and Gao, Lin and Zhang, Fa and Wang, Ying},
  title = {A Disentangled Representation-Based Multimodal Fusion Framework Integrating Pathomics and Radiomics for KRAS Mutation Detection in Colorectal Cancer},
  journal = {Big Data Mining and Analytics},
  year = {2024},
  volume = {7},
  number = {3},
  pages = {590--602},
  doi = {10.26599/bdma.2024.9020012}
}
Kostenlos starten →