Multi-Scale Temporal Fusion Network for Real-Time Multimodal Emotion Recognition in IoT Environments
Sensors · 14.08.2025 · 25 (16) · 5066
DOI: 10.3390/s25165066 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 14.08.2025. Verfasst von Sungwook Yoon und 1 weiteren Autor:innen. Beteiligte Einrichtung: Gyeongbuk Development Institute, 201 Docheong-daero, Homyeong-eup, Yecheon 36849, Gyeongsangbuk-do, Republic of Korea. Hauptthemen laut MEDLINE: Emotions, Internet of Things. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
This paper introduces EmotionTFN (Emotion-Multi-Scale Temporal Fusion Network), a novel hierarchical temporal fusion architecture that addresses key challenges in IoT emotion recognition by processing diverse sensor data while maintaining accuracy across multiple temporal scales. The architecture integrates physiological signals (EEG, PPG, and GSR), visual, and audio data using hierarchical temporal attention across short-term (0.5–2 s), medium-term (2–10 s), and long-term (10–60 s) windows. Edge computing optimizations, including model compression, quantization, and adaptive sampling, enable deployment on resource-constrained devices. Extensive experiments on MELD, DEAP, and G-REx datasets demonstrate 94.2% accuracy on discrete emotion classification and 0.087 mean absolute error on dimensional prediction, outperforming the best baseline (87.4%). The system maintains sub-200 ms latency on IoT hardware while achieving a 40% improvement in energy efficiency. Real-world deployment validation over four weeks achieved 97.2% uptime and user satisfaction scores of 4.1/5.0 while ensuring privacy through local processing.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Gyeongbuk Development Institute, 201 Docheong-daero, Homyeong-eup, Yecheon 36849, Gyeongsangbuk-do, Republic of Korea.
- Dept. of Electronic and Mechanical Engineering, GyeongKuk National University, 1375 Gyeongdong-ro, Andong 36729, Gyeongsangbuk-do, Republic of Korea.
ORCID-Profile: Sungwook Yoon, Byungmun Kim
Zitieren
APA
Yoon, S., & Kim, B. (2025). Multi-Scale Temporal Fusion Network for Real-Time Multimodal Emotion Recognition in IoT Environments. Sensors, 25(16), 5066. https://doi.org/10.3390/s25165066
Vancouver
Yoon S, Kim B. Multi-Scale Temporal Fusion Network for Real-Time Multimodal Emotion Recognition in IoT Environments. Sensors. 2025;25(16):5066. doi:10.3390/s25165066
BibTeX
@article{Yoon2025,
author = {Yoon, Sungwook and Kim, Byungmun},
title = {Multi-Scale Temporal Fusion Network for Real-Time Multimodal Emotion Recognition in IoT Environments},
journal = {Sensors},
year = {2025},
volume = {25},
number = {16},
pages = {5066},
doi = {10.3390/s25165066}
}
EUVIMED