User-centric AI: evaluating the usability of generative AI applications through user reviews on app stores
PeerJ Computer Science · 25.10.2024 · 10 · e2421
DOI: 10.7717/peerj-cs.2421 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 25.10.2024. Verfasst von Reham Alabduljabbar. Beteiligte Einrichtung: Information Technology Department, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Researchers Supporting Project.
Abstract (Originalsprache)
This article presents a usability evaluation and comparison of generative AI applications through the analysis of user reviews from popular digital marketplaces, specifically Apple’s App Store and Google Play. The study aims to bridge the research gap in real-world usability assessments of generative AI tools. A total of 11,549 reviews were extracted and analyzed from January to March 2024 for five generative AI apps: ChatGPT, Bing AI, Microsoft Copilot, Gemini AI, and Da Vinci AI. The dataset has been made publicly available, allowing for further analysis by other researchers. The evaluation follows ISO 9241 usability standards, focusing on effectiveness, efficiency, and user satisfaction. This study is believed to be the first usability evaluation for generative AI applications using user reviews across digital marketplaces. The results show that ChatGPT achieved the highest compound usability scores among Android and iOS users, with scores of 0.504 and 0.462, respectively. Conversely, Gemini AI scored the lowest among Android apps at 0.016, and Da Vinci AI had the lowest among iOS apps at 0.275. Satisfaction scores were critical in usability assessments, with ChatGPT obtaining the highest rates of 0.590 for Android and 0.565 for iOS, while Gemini AI had the lowest satisfaction rate at −0.138 for Android users. The findings revealed usability issues related to ease of use, functionality, and reliability in generative AI tools, providing valuable insights from user opinions and feedback. Based on the analysis, actionable recommendations were proposed to enhance the usability of generative AI tools, aiming to address identified usability issues and improve the overall user experience. This study contributes to a deeper understanding of user experiences and offers valuable guidance for enhancing the usability of generative AI applications.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Information Technology Department, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia.
Förderung
- Researchers Supporting Project
Zitieren
APA
Alabduljabbar, R. (2024). User-centric AI: evaluating the usability of generative AI applications through user reviews on app stores. PeerJ Computer Science, 10, e2421. https://doi.org/10.7717/peerj-cs.2421
Vancouver
Alabduljabbar R. User-centric AI: evaluating the usability of generative AI applications through user reviews on app stores. PeerJ Computer Science. 2024;10:e2421. doi:10.7717/peerj-cs.2421
BibTeX
@article{Alabduljabbar2024,
author = {Alabduljabbar, Reham},
title = {User-centric AI: evaluating the usability of generative AI applications through user reviews on app stores},
journal = {PeerJ Computer Science},
year = {2024},
volume = {10},
pages = {e2421},
doi = {10.7717/peerj-cs.2421}
}
EUVIMED