EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multi-Scale Temporal Fusion Network for Real-Time Multimodal Emotion Recognition in IoT Environments

Sungwook Yoon iD, Byungmun Kim iD

Sensors · 14.08.2025 · 25 (16) · 5066

DOI: 10.3390/s25165066 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 14.08.2025. Verfasst von Sungwook Yoon und 1 weiteren Autor:innen. Beteiligte Einrichtung: Gyeongbuk Development Institute, 201 Docheong-daero, Homyeong-eup, Yecheon 36849, Gyeongsangbuk-do, Republic of Korea. Hauptthemen laut MEDLINE: Emotions, Internet of Things. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper introduces EmotionTFN (Emotion-Multi-Scale Temporal Fusion Network), a novel hierarchical temporal fusion architecture that addresses key challenges in IoT emotion recognition by processing diverse sensor data while maintaining accuracy across multiple temporal scales. The architecture integrates physiological signals (EEG, PPG, and GSR), visual, and audio data using hierarchical temporal attention across short-term (0.5–2 s), medium-term (2–10 s), and long-term (10–60 s) windows. Edge computing optimizations, including model compression, quantization, and adaptive sampling, enable deployment on resource-constrained devices. Extensive experiments on MELD, DEAP, and G-REx datasets demonstrate 94.2% accuracy on discrete emotion classification and 0.087 mean absolute error on dimensional prediction, outperforming the best baseline (87.4%). The system maintains sub-200 ms latency on IoT hardware while achieving a 40% improvement in energy efficiency. Real-world deployment validation over four weeks achieved 97.2% uptime and user satisfaction scores of 4.1/5.0 while ensuring privacy through local processing.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

EmotionsInternet of ThingsHumansElectroencephalographyAlgorithmsSignal Processing, Computer-AssistedNeural Networks, Computer

Stichwörter der Autor:innen

Internet of Thingsedge computingemotion recognitionmultimodal fusionreal-time processingtemporal attention

Autor:innen und Institutionen

  • Gyeongbuk Development Institute, 201 Docheong-daero, Homyeong-eup, Yecheon 36849, Gyeongsangbuk-do, Republic of Korea.
  • Dept. of Electronic and Mechanical Engineering, GyeongKuk National University, 1375 Gyeongdong-ro, Andong 36729, Gyeongsangbuk-do, Republic of Korea.

ORCID-Profile: Sungwook Yoon, Byungmun Kim

Zitieren

APA

Yoon, S., & Kim, B. (2025). Multi-Scale Temporal Fusion Network for Real-Time Multimodal Emotion Recognition in IoT Environments. Sensors, 25(16), 5066. https://doi.org/10.3390/s25165066

Vancouver

Yoon S, Kim B. Multi-Scale Temporal Fusion Network for Real-Time Multimodal Emotion Recognition in IoT Environments. Sensors. 2025;25(16):5066. doi:10.3390/s25165066

BibTeX
@article{Yoon2025,
  author = {Yoon, Sungwook and Kim, Byungmun},
  title = {Multi-Scale Temporal Fusion Network for Real-Time Multimodal Emotion Recognition in IoT Environments},
  journal = {Sensors},
  year = {2025},
  volume = {25},
  number = {16},
  pages = {5066},
  doi = {10.3390/s25165066}
}
Kostenlos starten →