EUVIMEDEUVIMED entdecken
Mixed-Methods-StudieOpen Access

Developing a Service Quality Index System for AI Health Care Chatbots: Mixed Methods Study

Yu Gu iD, Xinyi Wang iD

Journal of Medical Internet Research · 2026

DOI: 10.2196/83051 ↗

Kurz gefasst

Mixed-Methods-Studie in der Zeitschrift Journal of Medical Internet Research, 2026. Verfasst von Yu Gu und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Medical Technology, Capital Medical University, Beijing, China. Hauptthemen laut MEDLINE: Artificial Intelligence, Quality of Health Care, Delivery of Health Care. Die Arbeit nennt 50 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Artificial intelligence (AI) health care chatbots are gaining widespread adoption worldwide. It is imperative to understand the service quality of AI health care chatbots. However, there is limited guidance on how to comprehensively evaluate their service quality.

Objective

This study aimed to develop an index system based on the SERVQUAL framework for evaluating the service quality of AI health care chatbots.

Methods

An initial indicator pool was compiled through a comprehensive literature review and consultations with 4 experts. These indicators were mapped and categorized into 5 domains adapted from the SERVQUAL framework. The experts were recruited from hospital, university, and health commission settings by purposive sampling. The service quality index system was identified using a 2-round Delphi process, which included a virtual meeting between the 2 rounds. In the third round, indicator weights within each quality domain and subdomain were determined using the analytic hierarchy process.

Results

There were 26 indicators identified in the literature, based on which the 2-round Delphi process was conducted. A total of 20 experts were invited. The response rates in both rounds of Delphi and the analytic hierarchy process were 100%, and the authoritative coefficients were both >0.7. The final service quality index system for AI health care chatbots comprises 5 primary indicators and 17 secondary indicators. There were 3 (18%) indicators on assurance, 4 (24%) on reliability, 3 (18%) on human-likeness, 4 (24%) on tangibility, and 3 (18%) on responsiveness. The primary indicators, ranked from highest to lowest weight, were assurance (0.239), reliability (0.237), human-likeness (0.187), tangibility (0.170), and responsiveness (0.167).

Conclusions

This study pioneers the development of a service quality index system for AI health care chatbots adapted from the SERVQUAL framework. The results provide a validated tool for evaluating the performance of chatbots and offer valuable insights for health service managers and developers to enhance AI-driven medical consultation services.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceQuality of Health CareDelivery of Health CareDelphi TechniqueHumans

Stichwörter der Autor:innen

AIDelphi methodSERVQUALanalytic hierarchy processartificial intelligenceartificial intelligence health care chatbotindex system developmentservice quality

Autor:innen und Institutionen

  • School of Medical Technology, Capital Medical University, Beijing, China.

ORCID-Profile: Yu Gu, Xinyi Wang

Zitieren

APA

Gu, Y., & Wang, X. (2026). Developing a Service Quality Index System for AI Health Care Chatbots: Mixed Methods Study. Journal of Medical Internet Research. https://doi.org/10.2196/83051

Vancouver

Gu Y, Wang X. Developing a Service Quality Index System for AI Health Care Chatbots: Mixed Methods Study. Journal of Medical Internet Research. 2026. doi:10.2196/83051

BibTeX
@article{Gu2026,
  author = {Gu, Yu and Wang, Xinyi},
  title = {Developing a Service Quality Index System for AI Health Care Chatbots: Mixed Methods Study},
  journal = {Journal of Medical Internet Research},
  year = {2026},
  doi = {10.2196/83051}
}
Kostenlos starten →