Early and Late Fusion for Multimodal Aggression Prediction in Dementia Patients: A Comparative Analysis
Applied Sciences · 22.05.2025 · 15 (11) · 5823
DOI: 10.3390/app15115823 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 22.05.2025. Verfasst von Ioannis Galanakis und 5 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Themen: Gewalt gegen Pflegekräfte, Demenz
Abstract (Originalsprache)
Aggression in patients with dementia poses significant caregiving and clinical issues. In this work, fusion approaches—Early Fusion and Late Fusion—were compared to classify aggression using audio and visual signals. Early Fusion integrates the extracted features of the two modalities into one dataset before classification, while Late Fusion integrates the prediction probabilities of standalone audio and visual classifiers with a meta-classifier. Both models were tested using a Random Forest classifier with five-fold cross-validation, and the performance was compared on accuracy, precision, recall, F1-score, ROC-AUC, and inference time. The results showcase that Late Fusion is superior to Early Fusion in terms of accuracy (0.876 vs. 0.828), recall (0.914 vs. 0.818), F1-score (0.867 vs. 0.835), and ROC-AUC score (0.970 vs. 0.922), proving more suitable for high-sensitivity use cases like healthcare and security. However, Early Fusion exhibited higher precision (0.852 vs. 0.824), indicating that in cases when false positives are a requirement, Early Fusion is preferable. Paired t-tests were applied for statistical comparison and indicate that precision alone is significantly different, with the advantage of Early Fusion. Late Fusion also performs slightly less in inference time, which makes it suitable for use in real-time systems. These findings provide significant information on multimodal fusion strategies and their applicability in the detection of aggressive behavior, which can contribute to the development of efficient monitoring systems for dementia care.
Zitieren
APA
Galanakis, I., Soldatos, R. F., Karanikolas, N., Voulodimos, A., Voyiatzis, I., & Samarakou, M. (2025). Early and Late Fusion for Multimodal Aggression Prediction in Dementia Patients: A Comparative Analysis. Applied Sciences, 15(11), 5823. https://doi.org/10.3390/app15115823
Vancouver
Galanakis I, Soldatos RF, Karanikolas N, Voulodimos A, Voyiatzis I, Samarakou M. Early and Late Fusion for Multimodal Aggression Prediction in Dementia Patients: A Comparative Analysis. Applied Sciences. 2025;15(11):5823. doi:10.3390/app15115823
BibTeX
@article{Galanakis2025,
author = {Galanakis, Ioannis and Soldatos, Rigas Filippos and Karanikolas, Nikitas and Voulodimos, Athanasios and Voyiatzis, Ioannis and Samarakou, Maria},
title = {Early and Late Fusion for Multimodal Aggression Prediction in Dementia Patients: A Comparative Analysis},
journal = {Applied Sciences},
year = {2025},
volume = {15},
number = {11},
pages = {5823},
doi = {10.3390/app15115823}
}
EUVIMED