EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MM-EMOR: Multi-Modal Emotion Recognition of Social Media Using Concatenated Deep Learning Networks

Omar Adel, Karma M. Fathalla, Ahmed Abo ElFarag

Big Data and Cognitive Computing · 13.10.2023 · 7 (4) · 164

DOI: 10.3390/bdcc7040164 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Big Data and Cognitive Computing, online erschienen am 13.10.2023. Verfasst von Omar Adel und 2 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Emotion recognition is crucial in artificial intelligence, particularly in the domain of human–computer interaction. The ability to accurately discern and interpret emotions plays a critical role in helping machines to effectively decipher users’ underlying intentions, allowing for a more streamlined interaction process that invariably translates into an elevated user experience. The recent increase in social media usage, as well as the availability of an immense amount of unstructured data, has resulted in a significant demand for the deployment of automated emotion recognition systems. Artificial intelligence (AI) techniques have emerged as a powerful solution to this pressing concern in this context. In particular, the incorporation of multimodal AI-driven approaches for emotion recognition has proven beneficial in capturing the intricate interplay of diverse human expression cues that manifest across multiple modalities. The current study aims to develop an effective multimodal emotion recognition system known as MM-EMOR in order to improve the efficacy of emotion recognition efforts focused on audio and text modalities. The use of Mel spectrogram features, Chromagram features, and the Mobilenet Convolutional Neural Network (CNN) for processing audio data are central to the operation of this system, while an attention-based Roberta model caters to the text modality. The methodology of this study is based on an exhaustive evaluation of this approach across three different datasets. Notably, the empirical findings show that MM-EMOR outperforms competing models across the same datasets. This performance boost is noticeable, with accuracy gains of an impressive 7% on one dataset and a substantial 8% on another. Most significantly, the observed increase in accuracy for the final dataset was an astounding 18%.

Zitieren

APA

Adel, O., Fathalla, K. M., & ElFarag, A. A. (2023). MM-EMOR: Multi-Modal Emotion Recognition of Social Media Using Concatenated Deep Learning Networks. Big Data and Cognitive Computing, 7(4), 164. https://doi.org/10.3390/bdcc7040164

Vancouver

Adel O, Fathalla KM, ElFarag AA. MM-EMOR: Multi-Modal Emotion Recognition of Social Media Using Concatenated Deep Learning Networks. Big Data and Cognitive Computing. 2023;7(4):164. doi:10.3390/bdcc7040164

BibTeX
@article{Adel2023,
  author = {Adel, Omar and Fathalla, Karma M. and ElFarag, Ahmed Abo},
  title = {MM-EMOR: Multi-Modal Emotion Recognition of Social Media Using Concatenated Deep Learning Networks},
  journal = {Big Data and Cognitive Computing},
  year = {2023},
  volume = {7},
  number = {4},
  pages = {164},
  doi = {10.3390/bdcc7040164}
}
Kostenlos starten →