EUVIMEDEUVIMED entdecken
Crossref

Toward Resilient Medical Multimodal AI: A Framework for Missing Modality Recovery Under Clinical Constraints

Jiahe Hou, John Moraros, Guangliang Cheng, Shuihua Wang

Proceedings of the AAAI Symposium Series · 23.06.2026 · 9 (1) · 148-151

DOI: 10.1609/aaaiss.v9i1.42917 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Symposium Series, online erschienen am 23.06.2026. Verfasst von Jiahe Hou und 3 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Real-world medical AI systems rarely operate under ideal conditions: multimodal clinical data are frequently incomplete due to resource constraints, equipment limitations, and workflow disruptions—challenges amplified in under-resourced hospitals and community clinics where infrastructure gaps make missing modalities the norm. Existing multimodal learning methods typically assume data completeness or treat missing modalities as a narrow technical problem, limiting their reliability in practice. We posit that missing-modality learning should be reframed as a core challenge of AI resilience in medicine, where systems must maintain reliable performance under real-world constraints while transparently communicating uncertainty. To this end, we propose a two-tier framework aligned with clinical workflows. Tier 1 enables efficient, uncertainty-aware inference under missing modalities using prompt-enhanced modality encoding and learnable pseudo-embeddings. Cases with elevated uncertainty are routed to Tier 2, which performs high-fidelity generative recovery using conditional diffusion models for precision-critical decisions. Component-level validation on a multi-center colorectal cancer cohort (1,679 patients, four centers) demonstrates that each design element contributes measurably to downstream prognostic performance: learnable pseudo-embeddings improve the concordance index (C-index) by 10.1 points over zero-filling in feature space, while missing-aware prompts and modality-aware prompts contribute 4.4 and 3.7 points, respectively. Full evaluation of uncertainty-guided routing and generative recovery across brain tumor, cardiac, and CT–MRI benchmarks is ongoing.

Zitieren

APA

Hou, J., Moraros, J., Cheng, G., & Wang, S. (2026). Toward Resilient Medical Multimodal AI: A Framework for Missing Modality Recovery Under Clinical Constraints. Proceedings of the AAAI Symposium Series, 9(1), 148-151. https://doi.org/10.1609/aaaiss.v9i1.42917

Vancouver

Hou J, Moraros J, Cheng G, Wang S. Toward Resilient Medical Multimodal AI: A Framework for Missing Modality Recovery Under Clinical Constraints. Proceedings of the AAAI Symposium Series. 2026;9(1):148-151. doi:10.1609/aaaiss.v9i1.42917

BibTeX
@article{Hou2026,
  author = {Hou, Jiahe and Moraros, John and Cheng, Guangliang and Wang, Shuihua},
  title = {Toward Resilient Medical Multimodal AI: A Framework for Missing Modality Recovery Under Clinical Constraints},
  journal = {Proceedings of the AAAI Symposium Series},
  year = {2026},
  volume = {9},
  number = {1},
  pages = {148--151},
  doi = {10.1609/aaaiss.v9i1.42917}
}
Kostenlos starten →