EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Early and Late Fusion for Multimodal Aggression Prediction in Dementia Patients: A Comparative Analysis

Ioannis Galanakis, Rigas Filippos Soldatos, Nikitas Karanikolas, Athanasios Voulodimos, Ioannis Voyiatzis, Maria Samarakou

Applied Sciences · 22.05.2025 · 15 (11) · 5823

DOI: 10.3390/app15115823 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 22.05.2025. Verfasst von Ioannis Galanakis und 5 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Aggression in patients with dementia poses significant caregiving and clinical issues. In this work, fusion approaches—Early Fusion and Late Fusion—were compared to classify aggression using audio and visual signals. Early Fusion integrates the extracted features of the two modalities into one dataset before classification, while Late Fusion integrates the prediction probabilities of standalone audio and visual classifiers with a meta-classifier. Both models were tested using a Random Forest classifier with five-fold cross-validation, and the performance was compared on accuracy, precision, recall, F1-score, ROC-AUC, and inference time. The results showcase that Late Fusion is superior to Early Fusion in terms of accuracy (0.876 vs. 0.828), recall (0.914 vs. 0.818), F1-score (0.867 vs. 0.835), and ROC-AUC score (0.970 vs. 0.922), proving more suitable for high-sensitivity use cases like healthcare and security. However, Early Fusion exhibited higher precision (0.852 vs. 0.824), indicating that in cases when false positives are a requirement, Early Fusion is preferable. Paired t-tests were applied for statistical comparison and indicate that precision alone is significantly different, with the advantage of Early Fusion. Late Fusion also performs slightly less in inference time, which makes it suitable for use in real-time systems. These findings provide significant information on multimodal fusion strategies and their applicability in the detection of aggressive behavior, which can contribute to the development of efficient monitoring systems for dementia care.

Zitieren

APA

Galanakis, I., Soldatos, R. F., Karanikolas, N., Voulodimos, A., Voyiatzis, I., & Samarakou, M. (2025). Early and Late Fusion for Multimodal Aggression Prediction in Dementia Patients: A Comparative Analysis. Applied Sciences, 15(11), 5823. https://doi.org/10.3390/app15115823

Vancouver

Galanakis I, Soldatos RF, Karanikolas N, Voulodimos A, Voyiatzis I, Samarakou M. Early and Late Fusion for Multimodal Aggression Prediction in Dementia Patients: A Comparative Analysis. Applied Sciences. 2025;15(11):5823. doi:10.3390/app15115823

BibTeX
@article{Galanakis2025,
  author = {Galanakis, Ioannis and Soldatos, Rigas Filippos and Karanikolas, Nikitas and Voulodimos, Athanasios and Voyiatzis, Ioannis and Samarakou, Maria},
  title = {Early and Late Fusion for Multimodal Aggression Prediction in Dementia Patients: A Comparative Analysis},
  journal = {Applied Sciences},
  year = {2025},
  volume = {15},
  number = {11},
  pages = {5823},
  doi = {10.3390/app15115823}
}
Kostenlos starten →