EUVIMEDEUVIMED entdecken
Systematische Übersicht

Multimodal sentiment analysis: A systematic review of history, datasets, multimodal fusion methods, applications, challenges and future directions

Ankita Gandhi, Kinjal Adhvaryu, Soujanya Poria, Erik Cambria, Amir Hussain

Information Fusion · 2023-03 · 91 · 424-444

DOI: 10.1016/j.inffus.2022.09.025 ↗

Kurz gefasst

Systematische Übersicht in der Zeitschrift Information Fusion, 2023-03. Verfasst von Ankita Gandhi und 4 weiteren Autor:innen. Die Arbeit wurde bisher 773-mal zitiert (Crossref) und nennt 100 Literaturangaben. Gefördert von: Ministry of Education - Singapore, Engineering and Physical Sciences Research Council.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Sentiment analysis (SA) has gained much traction In the field of artificial intelligence (AI) and natural language processing (NLP). There is growing demand to automate analysis of user sentiment towards products or services. Opinions are increasingly being shared online in the form of videos rather than text alone. This has led to SA using multiple modalities, termed Multimodal Sentiment Analysis (MSA), becoming an important research area. MSA utilises latest advancements in machine learning and deep learning at various stages including for multi-modal feature extraction and fusion and sentiment polarity detection, with aims to minimize error rate and improve performance. This survey paper examines primary taxonomy and newly released multimodal fusion architectures. Recent developments in MSA architectures are divided into ten categories, namely early fusion, late fusion, hybrid fusion, model-level fusion, tensor fusion, hierarchical fusion, bi-modal fusion, attention-based fusion, quantum-based fusion and word-level fusion. A comparison of several architectural evolutions in terms of MSA fusion categories and their relative strengths and limitations are presented. Finally, a number of interdisciplinary applications and future research directions are proposed.

Förderung

  • Ministry of Education - Singapore
  • Engineering and Physical Sciences Research Council

Zitieren

APA

Gandhi, A., Adhvaryu, K., Poria, S., Cambria, E., & Hussain, A. (2023). Multimodal sentiment analysis: A systematic review of history, datasets, multimodal fusion methods, applications, challenges and future directions. Information Fusion, 91, 424-444. https://doi.org/10.1016/j.inffus.2022.09.025

Vancouver

Gandhi A, Adhvaryu K, Poria S, Cambria E, Hussain A. Multimodal sentiment analysis: A systematic review of history, datasets, multimodal fusion methods, applications, challenges and future directions. Information Fusion. 2023;91:424-444. doi:10.1016/j.inffus.2022.09.025

BibTeX
@article{Gandhi2023,
  author = {Gandhi, Ankita and Adhvaryu, Kinjal and Poria, Soujanya and Cambria, Erik and Hussain, Amir},
  title = {Multimodal sentiment analysis: A systematic review of history, datasets, multimodal fusion methods, applications, challenges and future directions},
  journal = {Information Fusion},
  year = {2023},
  volume = {91},
  pages = {424--444},
  doi = {10.1016/j.inffus.2022.09.025}
}
Kostenlos starten →