Interpretable Multimodal AI for Horizon-Specific Survival Prediction in Hepatocellular Carcinoma Using Transcriptomics and Caption-Based Histopathology
Information · 30.07.2026 · 17 (8) · 737
DOI: 10.3390/info17080737 ↗Kurz gefasst
Fachartikel in der Zeitschrift Information, online erschienen am 30.07.2026. Verfasst von Mayank Kapadia und 1 weiteren Autor:innen. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Accurate survival prediction in Liver Hepatocellular Carcinoma (LIHC) remains challenging because outcomes are shaped by clinical, molecular, and morphological heterogeneity. Although multimodal learning may improve prognosis, the contribution of each modality across clinically relevant survival horizons remains unclear, and many existing approaches provide limited interpretability. We present an interpretable multimodal framework for LIHC survival prediction using clinical variables, transcriptomic profiles, and histopathology whole-slide images from the TCGA-LIHC cohort. Survival prediction was formulated as horizon-specific classification at 1-, 3-, and 5-year endpoints. Histopathology patches were converted into morphology-focused textual descriptions using a vision–language captioning framework, aggregated into patient-level summaries, and embedded as predictive features. Caption quality was evaluated using automated semantic metrics and expert pathological review. Multimodal fusion was performed using a leakage-aware out-of-fold stacking strategy. The best fusion configurations achieved ROC-AUC values of 0.70, 0.74, and 0.66 for 1-, 3-, and 5-year prediction, respectively. Genomic features provided the strongest standalone signal at 1 and 3 years, while histopathology-derived captions contributed most clearly when combined with genomics at 3 years. These findings show that multimodal benefit is horizon-dependent and depends on modality complementarity rather than simply adding more data sources.
Zitieren
APA
Kapadia, M., & Masum, M. (2026). Interpretable Multimodal AI for Horizon-Specific Survival Prediction in Hepatocellular Carcinoma Using Transcriptomics and Caption-Based Histopathology. Information, 17(8), 737. https://doi.org/10.3390/info17080737
Vancouver
Kapadia M, Masum M. Interpretable Multimodal AI for Horizon-Specific Survival Prediction in Hepatocellular Carcinoma Using Transcriptomics and Caption-Based Histopathology. Information. 2026;17(8):737. doi:10.3390/info17080737
BibTeX
@article{Kapadia2026,
author = {Kapadia, Mayank and Masum, Mohammad},
title = {Interpretable Multimodal AI for Horizon-Specific Survival Prediction in Hepatocellular Carcinoma Using Transcriptomics and Caption-Based Histopathology},
journal = {Information},
year = {2026},
volume = {17},
number = {8},
pages = {737},
doi = {10.3390/info17080737}
}
EUVIMED