EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

User-centric AI: evaluating the usability of generative AI applications through user reviews on app stores

Reham Alabduljabbar

PeerJ Computer Science · 25.10.2024 · 10 · e2421

DOI: 10.7717/peerj-cs.2421 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 25.10.2024. Verfasst von Reham Alabduljabbar. Beteiligte Einrichtung: Information Technology Department, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Researchers Supporting Project.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This article presents a usability evaluation and comparison of generative AI applications through the analysis of user reviews from popular digital marketplaces, specifically Apple’s App Store and Google Play. The study aims to bridge the research gap in real-world usability assessments of generative AI tools. A total of 11,549 reviews were extracted and analyzed from January to March 2024 for five generative AI apps: ChatGPT, Bing AI, Microsoft Copilot, Gemini AI, and Da Vinci AI. The dataset has been made publicly available, allowing for further analysis by other researchers. The evaluation follows ISO 9241 usability standards, focusing on effectiveness, efficiency, and user satisfaction. This study is believed to be the first usability evaluation for generative AI applications using user reviews across digital marketplaces. The results show that ChatGPT achieved the highest compound usability scores among Android and iOS users, with scores of 0.504 and 0.462, respectively. Conversely, Gemini AI scored the lowest among Android apps at 0.016, and Da Vinci AI had the lowest among iOS apps at 0.275. Satisfaction scores were critical in usability assessments, with ChatGPT obtaining the highest rates of 0.590 for Android and 0.565 for iOS, while Gemini AI had the lowest satisfaction rate at −0.138 for Android users. The findings revealed usability issues related to ease of use, functionality, and reliability in generative AI tools, providing valuable insights from user opinions and feedback. Based on the analysis, actionable recommendations were proposed to enhance the usability of generative AI tools, aiming to address identified usability issues and improve the overall user experience. This study contributes to a deeper understanding of user experiences and offers valuable guidance for enhancing the usability of generative AI applications.

Schlagwörter

Stichwörter der Autor:innen

ChatGPTGenerative AIHCIHuman–AI interactionLLMsMicrosoft CopilotUsability evaluationsUser experienceUser reviewUser-centred design

Autor:innen und Institutionen

  • Information Technology Department, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia.

Förderung

  • Researchers Supporting Project

Zitieren

APA

Alabduljabbar, R. (2024). User-centric AI: evaluating the usability of generative AI applications through user reviews on app stores. PeerJ Computer Science, 10, e2421. https://doi.org/10.7717/peerj-cs.2421

Vancouver

Alabduljabbar R. User-centric AI: evaluating the usability of generative AI applications through user reviews on app stores. PeerJ Computer Science. 2024;10:e2421. doi:10.7717/peerj-cs.2421

BibTeX
@article{Alabduljabbar2024,
  author = {Alabduljabbar, Reham},
  title = {User-centric AI: evaluating the usability of generative AI applications through user reviews on app stores},
  journal = {PeerJ Computer Science},
  year = {2024},
  volume = {10},
  pages = {e2421},
  doi = {10.7717/peerj-cs.2421}
}
Kostenlos starten →