EUVIMEDSkopri EUVIMED
Open access

Quality and Accountability of ChatGPT in Health Care in Low- and Middle-Income Countries: Simulated Patient Study

Yafei Si iD, Yuyi Yang iD, Xi Wang iD, Jiaqi Zu iD, Xi Chen iD, Xiaojing Fan iD, Ruopeng An iD, Sen Gong iD

Journal of Medical Internet Research · 2024

DOI: 10.2196/56121 ↗

At a glance

Journal article in Journal of Medical Internet Research, 2024. Written by Yafei Si and 7 co-authors. Institution: UNSW Business School and CEPAR, The University of New South Wales, Kensington, Australia. Major MEDLINE topics: Developing Countries. Cited 7 times so far (Crossref); 10 references. The full text is freely available in PubMed Central. Funded by: NIA NIH HHS.

AstrattSubjectsDettalji biblijografiċiCiteRelated studies

Abstract (original language)

Using simulated patients to mimic 9 established noncommunicable and infectious diseases, we assessed ChatGPT’s performance in treatment recommendations for common diseases in low- and middle-income countries. ChatGPT had a high level of accuracy in both correct diagnoses (20/27, 74%) and medication prescriptions (22/27, 82%) but a concerning level of unnecessary or harmful medications (23/27, 85%) even with correct diagnoses. ChatGPT performed better in managing noncommunicable diseases than infectious ones. These results highlight the need for cautious AI integration in health care systems to ensure quality and safety.

Subjects

MeSH terms (MEDLINE)

Developing CountriesHumansPatient SimulationQuality of Health CareDelivery of Health CareNoncommunicable DiseasesCommunicable Diseases

Author keywords

AIAI integrationChatGPTLMICartificial intelligenceeffectivenessgenerative AIhealth carelow- and middle-income countriesmedication prescriptionnoncommunicable diseasespatient studyprescriptionqualityquality and safety

Authors and institutions

  • UNSW Business School and CEPAR, The University of New South Wales, Kensington, Australia.
  • Division of Computational and Data Sciences, Washington University in St Louis, St. Louis, MO, United States.
  • Brown School, Washington University in St Louis, St Louis, MT, United States.
  • Global Health Research Center, Duke Kunshan University, Kunshan, China.
  • Department of Health Policy and Management, Yale University, New Haven, CT, United States.
  • Department of Economics, Yale University, New Haven, CT, United States.

ORCID profiles: Yafei Si, Yuyi Yang, Xi Wang, Jiaqi Zu, Xi Chen, Xiaojing Fan, Ruopeng An, Sen Gong

Funding

  • NIA NIH HHS

Cite

APA

Si, Y., Yang, Y., Wang, X., Zu, J., Chen, X., Fan, X., An, R., & Gong, S. (2024). Quality and Accountability of ChatGPT in Health Care in Low- and Middle-Income Countries: Simulated Patient Study. Journal of Medical Internet Research. https://doi.org/10.2196/56121

Vancouver

Si Y, Yang Y, Wang X, Zu J, Chen X, Fan X, et al. Quality and Accountability of ChatGPT in Health Care in Low- and Middle-Income Countries: Simulated Patient Study. Journal of Medical Internet Research. 2024. doi:10.2196/56121

BibTeX
@article{Si2024,
  author = {Si, Yafei and Yang, Yuyi and Wang, Xi and Zu, Jiaqi and Chen, Xi and Fan, Xiaojing and An, Ruopeng and Gong, Sen},
  title = {Quality and Accountability of ChatGPT in Health Care in Low- and Middle-Income Countries: Simulated Patient Study},
  journal = {Journal of Medical Internet Research},
  year = {2024},
  doi = {10.2196/56121}
}
Start for free →