EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

IoT-based approach to multimodal music emotion recognition

Hanbing Zhao, Ling Jin

Alexandria Engineering Journal · 2025-02 · 113 · 19-31

DOI: 10.1016/j.aej.2024.10.059 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Alexandria Engineering Journal, 2025-02. Verfasst von Hanbing Zhao und 1 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the rapid development of Internet of Things (IoT) technology, multimodal emotion recognition has gradually become an important research direction in the field of artificial intelligence . However, existing methods often face challenges in efficiency and accuracy when processing multimodal data. This study aims to propose an IoT-supported multimodal music emotion recognition model that integrates audio and video signals to achieve real-time emotion recognition and classification. The proposed CGF-Net model combines a 3D Convolutional Neural Network (3D-CNN), Gated Recurrent Unit (GRU), and Fully Connected Network (FCN). By effectively fusing multimodal data, the model enhances the accuracy and efficiency of music emotion recognition. Extensive experiments were conducted on two public datasets, DEAM and DEAP, and the results demonstrate that CGF-Net performs exceptionally well in various emotion recognition tasks, particularly achieving high accuracy and F1 scores in recognizing positive emotions such as ”Happy” and ”Relax.” Compared to other benchmark models , CGF-Net shows significant advantages in both accuracy and stability. This study presents an effective solution for multimodal emotion recognition, demonstrating its broad potential in applications such as intelligent emotional interaction and music recommendation systems.

Zitieren

APA

Zhao, H., & Jin, L. (2025). IoT-based approach to multimodal music emotion recognition. Alexandria Engineering Journal, 113, 19-31. https://doi.org/10.1016/j.aej.2024.10.059

Vancouver

Zhao H, Jin L. IoT-based approach to multimodal music emotion recognition. Alexandria Engineering Journal. 2025;113:19-31. doi:10.1016/j.aej.2024.10.059

BibTeX
@article{Zhao2025,
  author = {Zhao, Hanbing and Jin, Ling},
  title = {IoT-based approach to multimodal music emotion recognition},
  journal = {Alexandria Engineering Journal},
  year = {2025},
  volume = {113},
  pages = {19--31},
  doi = {10.1016/j.aej.2024.10.059}
}
Kostenlos starten →