EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multimodal Sarcasm Detection via Hybrid Classifier with Optimistic Logic

Dnyaneshwar Madhukar Bavkar, Ramgopal Kashyap, Vaishali Khairnar

Journal of Telecommunications and Information Technology · 30.09.2022 · (3) · 97-114

DOI: 10.26636/jtit.2022.161622 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Telecommunications and Information Technology, online erschienen am 30.09.2022. Verfasst von Dnyaneshwar Madhukar Bavkar und 2 weiteren Autor:innen. Die Arbeit wurde bisher 125-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This work aims to provide a novel multimodal sarcasm detection model that includes four stages: pre-processing, feature extraction, feature level fusion, and classification. The pre-processing uses multimodal data that includes text, video, and audio. Here, text is pre-processed using tokenization and stemming, video is pre-processed during the face detection phase, and audio is pre-processed using the filtering technique. During the feature extraction stage, such text features as TF-IDF, improved bag of visual words, n-gram, and emojis as well on the video features using improved SLBT, and constraint local model (CLM) are extraction. Similarly the audio features like MFCC, chroma, spectral features, and jitter are extracted. Then, the extracted features are transferred to the feature level fusion stage, wherein an improved multilevel canonical correlation analysis (CCA) fusion technique is performed. The classification is performed using a hybrid classifier (HC), e.g. bidirectional gated recurrent unit (Bi-GRU) and LSTM. The outcomes of Bi-GRU and LSTM are averaged to obtain an effective output. To make the detection results more accurate, the weight of LSTM will be optimally tuned by the proposed opposition learning-based aquila optimization (OLAO) model. The MUStARD dataset is a multimodal video corpus used for automated sarcasm discovery studies. Finally, the effectiveness of the proposed approach is proved based on various metrics.

Zitieren

APA

Bavkar, D. M., Kashyap, R., & Khairnar, V. (2022). Multimodal Sarcasm Detection via Hybrid Classifier with Optimistic Logic. Journal of Telecommunications and Information Technology, 97-114. https://doi.org/10.26636/jtit.2022.161622

Vancouver

Bavkar DM, Kashyap R, Khairnar V. Multimodal Sarcasm Detection via Hybrid Classifier with Optimistic Logic. Journal of Telecommunications and Information Technology. 2022:97-114. doi:10.26636/jtit.2022.161622

BibTeX
@article{Bavkar2022,
  author = {Bavkar, Dnyaneshwar Madhukar and Kashyap, Ramgopal and Khairnar, Vaishali},
  title = {Multimodal Sarcasm Detection via Hybrid Classifier with Optimistic Logic},
  journal = {Journal of Telecommunications and Information Technology},
  year = {2022},
  number = {3},
  pages = {97--114},
  doi = {10.26636/jtit.2022.161622}
}
Kostenlos starten →