EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Interpretable Multimodal AI for Horizon-Specific Survival Prediction in Hepatocellular Carcinoma Using Transcriptomics and Caption-Based Histopathology

Mayank Kapadia, Mohammad Masum

Information · 30.07.2026 · 17 (8) · 737

DOI: 10.3390/info17080737 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Information, online erschienen am 30.07.2026. Verfasst von Mayank Kapadia und 1 weiteren Autor:innen. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurate survival prediction in Liver Hepatocellular Carcinoma (LIHC) remains challenging because outcomes are shaped by clinical, molecular, and morphological heterogeneity. Although multimodal learning may improve prognosis, the contribution of each modality across clinically relevant survival horizons remains unclear, and many existing approaches provide limited interpretability. We present an interpretable multimodal framework for LIHC survival prediction using clinical variables, transcriptomic profiles, and histopathology whole-slide images from the TCGA-LIHC cohort. Survival prediction was formulated as horizon-specific classification at 1-, 3-, and 5-year endpoints. Histopathology patches were converted into morphology-focused textual descriptions using a vision–language captioning framework, aggregated into patient-level summaries, and embedded as predictive features. Caption quality was evaluated using automated semantic metrics and expert pathological review. Multimodal fusion was performed using a leakage-aware out-of-fold stacking strategy. The best fusion configurations achieved ROC-AUC values of 0.70, 0.74, and 0.66 for 1-, 3-, and 5-year prediction, respectively. Genomic features provided the strongest standalone signal at 1 and 3 years, while histopathology-derived captions contributed most clearly when combined with genomics at 3 years. These findings show that multimodal benefit is horizon-dependent and depends on modality complementarity rather than simply adding more data sources.

Zitieren

APA

Kapadia, M., & Masum, M. (2026). Interpretable Multimodal AI for Horizon-Specific Survival Prediction in Hepatocellular Carcinoma Using Transcriptomics and Caption-Based Histopathology. Information, 17(8), 737. https://doi.org/10.3390/info17080737

Vancouver

Kapadia M, Masum M. Interpretable Multimodal AI for Horizon-Specific Survival Prediction in Hepatocellular Carcinoma Using Transcriptomics and Caption-Based Histopathology. Information. 2026;17(8):737. doi:10.3390/info17080737

BibTeX
@article{Kapadia2026,
  author = {Kapadia, Mayank and Masum, Mohammad},
  title = {Interpretable Multimodal AI for Horizon-Specific Survival Prediction in Hepatocellular Carcinoma Using Transcriptomics and Caption-Based Histopathology},
  journal = {Information},
  year = {2026},
  volume = {17},
  number = {8},
  pages = {737},
  doi = {10.3390/info17080737}
}
Kostenlos starten →