EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multimodal AI for Landslide Disaster Response: Fusing IoT Prediction, UAV Detection, and Social Media Triage

Yash V. Shinde, Jay J. Shinde, Tejas V. Joshi

International Journal of Scientific Research in Science and Technology · 20.06.2026 · 13 (3) · 1082-1093

DOI: 10.32628/ijsrst26133243 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Scientific Research in Science and Technology, online erschienen am 20.06.2026. Verfasst von Yash V. Shinde und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Finding a way to predict landslides, detect the physical damage, and organize rescues on the fly is incredibly difficult for emergency teams. This paper presents "Multimodal AI for Landslide Disaster Response: Fusing IoT Prediction, UAV Detection, and Social Media Triage", an end-to-end machine learning framework designed to manage the complete timeline of an emergency. Rather than just sticking to one specific data type, the approach we took breaks disaster management down into three separate phases. To start the pipeline, we apply a Deep Neural Network (DNN) to IoT sensor data so we can forecast landslide risks well before the soil actually gives way. Right after an event hits, a Vision Transformer (ViT-B/16) steps in to look over incoming drone imagery and spot any structural destruction. From there, the system handles the logistics of the aftermath by merging computer vision (ResNet50) with natural language processing (DistilBERT) to read through distress posts that citizens put on social media. To ensure rescue teams are deployed effectively, we incorporated the YOLOv8x algorithm to physically count the number of victims directly from uploaded images. We realized that blindly trusting a neural network's classification is dangerous, so our software actually relies on YOLO's bounding-box tensors to act as a strict safety check. Because of this built-in rule, if a social media post claims there is a critical emergency but the object detector spots zero victims in the photo, the system actively blocks the automated dispatch. This effectively stops AI hallucinations and keeps rescue resources from being wasted. When we ran the evaluations, our sensor prediction model hit 97.8% accuracy, and the drone image classifier came in at 91.42%. These integrated models operate within a single Streamlit dashboard, providing a clear and reliable tool for emergency dispatchers. Future expansions of this work could involve integrating retrieval-augmented generation (RAG) and autonomous AI agents to further optimize rescue routing.

Zitieren

APA

Shinde, Y. V., Shinde, J. J., & Joshi, T. V. (2026). Multimodal AI for Landslide Disaster Response: Fusing IoT Prediction, UAV Detection, and Social Media Triage. International Journal of Scientific Research in Science and Technology, 13(3), 1082-1093. https://doi.org/10.32628/ijsrst26133243

Vancouver

Shinde YV, Shinde JJ, Joshi TV. Multimodal AI for Landslide Disaster Response: Fusing IoT Prediction, UAV Detection, and Social Media Triage. International Journal of Scientific Research in Science and Technology. 2026;13(3):1082-1093. doi:10.32628/ijsrst26133243

BibTeX
@article{Shinde2026,
  author = {Shinde, Yash V. and Shinde, Jay J. and Joshi, Tejas V.},
  title = {Multimodal AI for Landslide Disaster Response: Fusing IoT Prediction, UAV Detection, and Social Media Triage},
  journal = {International Journal of Scientific Research in Science and Technology},
  year = {2026},
  volume = {13},
  number = {3},
  pages = {1082--1093},
  doi = {10.32628/ijsrst26133243}
}
Kostenlos starten →