EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An LLM-Enabled Multimodal Agentic AI Framework for the Medical Internet of Things (MIoT)

M. A. Rahman, Syed Usman Jamil, M. Shamim Hossain, Muhammad Arif Khan, Tanveer Zia, Muhammad Ali Paracha, Mubarak Alrashoud, Min Chen, Selwa A. F Al-Hazzaa

ACM Transactions on Multimedia Computing, Communications, and Applications · 31.08.2026 · 22 (8) · 1-35

DOI: 10.1145/3805047 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 22.08.2026. Verfasst von M. A. Rahman und 8 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Deputyship for Research and Innovation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The integration of Large Language Models (LLM) with multimodal agentic AI within the Medical Internet of Things (MIoT) ecosystem is redefining modern healthcare intelligence. This convergence enables continuous patient observation, adaptive clinical decision-making, and context-aware interaction between humans and machines across various biomedical data modalities. Healthcare systems generate a wide range of multimodal data, including textual records such as EHRs, prescriptions, and pathology notes; medical imagery such as CT, MRI, fundus, and radiographs; spoken data from consultations and transcriptions; video streams for rehabilitation and physiotherapy monitoring; and sensor readings such as ECG, SpO \({}_{2}\) , and glucose levels. Conventional unimodal algorithms fall short in interpreting this diversity, whereas LLM-augmented agentic frameworks fuse and reason over these heterogeneous sources, grounding their outputs in medical ontologies and coordinating task-specific agents to enhance real-world clinical workflows. This article presents a comprehensive overview of multimodal agentic AI powered by LLM for MIoT-enabled healthcare systems. Introduces a 6D unified taxonomy that covers multimodal input channels, fusion mechanisms, core LLM reasoning capabilities, agentic coordination models, computational deployment layers, and ethical governance frameworks. To contextualize this taxonomy, the discussion includes a Virtual Hospital case study centered on cancer that demonstrates how multimodal signals such as imaging, genomics, patient dialogues, and clinical updates integrate through intelligent agents to enable personalized diagnosis, automated documentation, home rehabilitation, and rapid intervention in emergencies. The survey also consolidates current progress on datasets, benchmarks, and evaluation protocols for AI in multimodal and agentic healthcare. The survey identifies critical research gaps, such as the lack of longitudinal multimodal datasets, standardized evaluation frameworks for multi-agent reasoning, and reliable methods to assess trustworthiness in clinical AI. Furthermore, it examines security and compliance issues such as adversarial manipulation, data leakage, and accountability across distributed agent networks, and it proposes countermeasures through federated data governance, secure MCP-oriented orchestration, and privacy-aware edge deployment strategies. By situating recent advances within the Virtual Hospital paradigm and oncology workflows, this study provides a systematic foundation for developing scalable, secure, and ethically aligned multimodal agentic systems based on LLMs, guiding the next generation of intelligent MIoT-driven healthcare ecosystems.

Förderung

  • Deputyship for Research and Innovation

Zitieren

APA

Rahman, M. A., Jamil, S. U., Hossain, M. S., Khan, M. A., Zia, T., Paracha, M. A., Alrashoud, M., Chen, M., & Al-Hazzaa, S. A. F. (2026). An LLM-Enabled Multimodal Agentic AI Framework for the Medical Internet of Things (MIoT). ACM Transactions on Multimedia Computing, Communications, and Applications, 22(8), 1-35. https://doi.org/10.1145/3805047

Vancouver

Rahman MA, Jamil SU, Hossain MS, Khan MA, Zia T, Paracha MA, et al. An LLM-Enabled Multimodal Agentic AI Framework for the Medical Internet of Things (MIoT). ACM Transactions on Multimedia Computing, Communications, and Applications. 2026;22(8):1-35. doi:10.1145/3805047

BibTeX
@article{Rahman2026,
  author = {Rahman, M. A. and Jamil, Syed Usman and Hossain, M. Shamim and Khan, Muhammad Arif and Zia, Tanveer and Paracha, Muhammad Ali and Alrashoud, Mubarak and Chen, Min and Al-Hazzaa, Selwa A. F},
  title = {An LLM-Enabled Multimodal Agentic AI Framework for the Medical Internet of Things (MIoT)},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2026},
  volume = {22},
  number = {8},
  pages = {1--35},
  doi = {10.1145/3805047}
}
Kostenlos starten →