EUVIMEDEUVIMED entdecken
Crossref

Methods and Tools for Identifying HumanResource Lesions in Emergency Based onMultimodal Analysis and Deep Learning

Yurii Ushenko, Dmytro Uhryn, Victoria Vysotska, Lyubomyr Chyrun, Zhengbing Hu, Tetiana Rekunenko

International Journal of Image, Graphics and Signal Processing · 08.06.2026 · 18 (3) · 17-53

DOI: 10.5815/ijigsp.2026.03.02 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Image, Graphics and Signal Processing, erschienen am 08.06.2026. Verfasst von Yurii Ushenko und 5 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Emergencies of natural, technological, and military origin require rapid and accurate assessment of victims' conditions to support effective rescue and medical response. Traditional visual examination methods are often limited by stress, time pressure, and incomplete information, leading to delayed or inaccurate decisions. This study proposes a multimodal deep learning approach for automated identification of human resource lesions in emergency scenarios. The developed framework integrates visual, audio, and text/sensory data using convolutional neural networks, Transformer-based models, and a Transformer Cross-Attention fusion mechanism. The proposed architecture enables effective extraction and integration of heterogeneous features for lesion classification, severity estimation, and automated medical triage. Experimental evaluation was conducted on multimodal datasets containing injury images, audio recordings, and symptom descriptions. The model was trained using a combined loss function and evaluated with classification, regression, and triage metrics. The results demonstrate high system performance, achieving a macro-F1 score of 0.87, validation accuracy of 86–87%, and triage accuracy above 90%, including 95% for the RED category. The regression model for severity prediction achieved an R² value of 0.92, while modality importance analysis confirmed the dominant contribution of visual information. The experiments also showed stable model convergence and strong generalisation ability without significant overfitting. The proposed multimodal framework confirms the effectiveness of deep learning and cross-attention mechanisms for automated lesion identification and emergency medical triage. The developed approach can be applied in decision-support systems for rescue operations, emergency medicine, and intelligent VR/AR training simulators.

Zitieren

APA

Ushenko, Y., Uhryn, D., Vysotska, V., Chyrun, L., Hu, Z., & Rekunenko, T. (2026). Methods and Tools for Identifying HumanResource Lesions in Emergency Based onMultimodal Analysis and Deep Learning. International Journal of Image, Graphics and Signal Processing, 18(3), 17-53. https://doi.org/10.5815/ijigsp.2026.03.02

Vancouver

Ushenko Y, Uhryn D, Vysotska V, Chyrun L, Hu Z, Rekunenko T. Methods and Tools for Identifying HumanResource Lesions in Emergency Based onMultimodal Analysis and Deep Learning. International Journal of Image, Graphics and Signal Processing. 2026;18(3):17-53. doi:10.5815/ijigsp.2026.03.02

BibTeX
@article{Ushenko2026,
  author = {Ushenko, Yurii and Uhryn, Dmytro and Vysotska, Victoria and Chyrun, Lyubomyr and Hu, Zhengbing and Rekunenko, Tetiana},
  title = {Methods and Tools for Identifying HumanResource Lesions in Emergency Based onMultimodal Analysis and Deep Learning},
  journal = {International Journal of Image, Graphics and Signal Processing},
  year = {2026},
  volume = {18},
  number = {3},
  pages = {17--53},
  doi = {10.5815/ijigsp.2026.03.02}
}
Kostenlos starten →