EUVIMEDEUVIMED entdecken
Open Access

Multimodal deep learning for immunotherapy response prediction and biomarker discovery in non-small cell lung cancer

Zijun Wang, Xi Liu, Kaitai Han, Lixin Lei, Chaojing Shi iD, Wu Liu, Qianjin Guo iD

Journal of the American Medical Informatics Association · 2025

DOI: 10.1093/jamia/ocaf142 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, 2025. Verfasst von Zijun Wang und 6 weiteren Autor:innen. Beteiligte Einrichtung: Academy of Artificial Intelligence, Beijing Institute of Petrochemical Technology, 19 Qingyuan North Road, Daxing District, Beijing 102617, China. Hauptthemen laut MEDLINE: Carcinoma, Non-Small-Cell Lung, Lung Neoplasms, Deep Learning, Immunotherapy. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: National Natural Science Foundation of China, Beijing Municipal Education Commission, Climbing Program Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

Immunotherapy has emerged as a promising treatment for advanced non-small cell lung cancer (NSCLC), but accurately predicting which patients will benefit from it remains a major clinical challenge. To address this, we aim to develop a novel multimodal method, DeepAFM, that integrates histopathology, genomic features, and clinical information to predict patient responses to anti-PD-(L)1 immunotherapy. Materials and Methods A total of 93 patients with advanced NSCLC were included in this study. Histopathological whole-slide images were processed using a self-supervised VQVAE2 for representation learning. PCA and K-means clustering were then applied for dimensionality reduction and feature grouping. Key regions of interest were visualized through permutation importance evaluation and color-coding techniques. The extracted histopathological features, along with genomic alterations and clinical variables, were integrated into the DeepAFM multimodal prediction model.

Results

The DeepAFM achieved a high predictive performance with an area under the curve (AUC) of 0.77 (95% confidence interval: 0.69-1.00). Attention-based heatmaps revealed that the model could identify critical pathological patterns, genomic mutations, and clinical indicators associated with patient responses to immunotherapy.

Discussion

The integration of multimodal data enabled the model to capture complex interactions among pathology, genomics, and clinical characteristics, enhancing the interpretability and predictive power of immunotherapy response prediction. The visualization techniques facilitated the identification of biologically meaningful features and potential biomarkers.

Conclusion

This study demonstrates the effectiveness of the DeepAFM in predicting responses to immunotherapy in advanced NSCLC. The approach not only improves prediction accuracy but also provides valuable insights for personalized treatment strategies and biomarker discovery.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Carcinoma, Non-Small-Cell LungLung NeoplasmsDeep LearningImmunotherapyImmune Checkpoint InhibitorsHumansBiomarkers, TumorMaleFemaleMiddle AgedAged

Stichwörter der Autor:innen

biomarker discoveryimmunotherapymultimodal deep learningnon-small cell lung cancer (NSCLC)response prediction

Substanzen

Biomarkers, TumorImmune Checkpoint Inhibitors

Autor:innen und Institutionen

  • Academy of Artificial Intelligence, Beijing Institute of Petrochemical Technology, 19 Qingyuan North Road, Daxing District, Beijing 102617, China.

ORCID-Profile: Chaojing Shi, Qianjin Guo

Förderung

  • National Natural Science Foundation of China
  • Beijing Municipal Education Commission
  • Climbing Program Foundation
  • ZhiYuan Fund Key Project of Beijing Institute of Petrochemical Technology

Zitieren

APA

Wang, Z., Liu, X., Han, K., Lei, L., Shi, C., Liu, W., & Guo, Q. (2025). Multimodal deep learning for immunotherapy response prediction and biomarker discovery in non-small cell lung cancer. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocaf142

Vancouver

Wang Z, Liu X, Han K, Lei L, Shi C, Liu W, et al. Multimodal deep learning for immunotherapy response prediction and biomarker discovery in non-small cell lung cancer. Journal of the American Medical Informatics Association. 2025. doi:10.1093/jamia/ocaf142

BibTeX
@article{Wang2025,
  author = {Wang, Zijun and Liu, Xi and Han, Kaitai and Lei, Lixin and Shi, Chaojing and Liu, Wu and Guo, Qianjin},
  title = {Multimodal deep learning for immunotherapy response prediction and biomarker discovery in non-small cell lung cancer},
  journal = {Journal of the American Medical Informatics Association},
  year = {2025},
  doi = {10.1093/jamia/ocaf142}
}
Kostenlos starten →