Stability Analysis of ChatGPT-Based Sentiment Analysis in AI Quality Assurance
Electronics · 22.12.2024 · 13 (24) · 5043
DOI: 10.3390/electronics13245043 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 22.12.2024. Verfasst von Tinghui Ouyang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: New Energy and Industrial Technology Development Organization (NEDO), JSPS Grant-in-Aid for Early-Career Scientists.
Abstract (Originalsprache)
In the era of large AI models, the intricate architectures and vast parameter sets of models such as large language models (LLMs) present significant challenges for effective AI quality management (AIQM). This paper investigates the quality assurance of a specific LLM-based AI product: ChatGPT-based sentiment analysis. The study focuses on stability issues, examining both the operation and robustness of ChatGPT’s underlying large-scale AI model. Through experimental analysis on benchmark datasets for sentiment analysis, the findings highlight the ChatGPT-based sentiment analysis’s susceptibility to uncertainty, which relates to various operational factors. Furthermore, the study reveals that the ChatGPT-based model faces stability challenges, particularly when confronted with conventional small-text adversarial attacks targeting robustness.
Förderung
- New Energy and Industrial Technology Development Organization (NEDO)
- JSPS Grant-in-Aid for Early-Career Scientists
Zitieren
APA
Ouyang, T., MaungMaung, A., Konishi, K., Seo, Y., & Echizen, I. (2024). Stability Analysis of ChatGPT-Based Sentiment Analysis in AI Quality Assurance. Electronics, 13(24), 5043. https://doi.org/10.3390/electronics13245043
Vancouver
Ouyang T, MaungMaung A, Konishi K, Seo Y, Echizen I. Stability Analysis of ChatGPT-Based Sentiment Analysis in AI Quality Assurance. Electronics. 2024;13(24):5043. doi:10.3390/electronics13245043
BibTeX
@article{Ouyang2024,
author = {Ouyang, Tinghui and MaungMaung, AprilPyone and Konishi, Koichi and Seo, Yoshiki and Echizen, Isao},
title = {Stability Analysis of ChatGPT-Based Sentiment Analysis in AI Quality Assurance},
journal = {Electronics},
year = {2024},
volume = {13},
number = {24},
pages = {5043},
doi = {10.3390/electronics13245043}
}
EUVIMED