The critical need for expert oversight of ChatGPT: Prompt engineering for safeguarding child healthcare information
Journal of Pediatric Psychology · 01.11.2024 · 49 (11) · 812-817
DOI: 10.1093/jpepsy/jsae075 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Pediatric Psychology, online erschienen am 13.09.2024. Verfasst von Calissa J Leslie-Miller und 4 weiteren Autor:innen. Beteiligte Einrichtung: Clinical Child Psychology Program, University of Kansas, Lawrence, KS, United States. Hauptthemen laut MEDLINE: Parents. Die Arbeit wurde bisher 31-mal zitiert (Crossref) und nennt 30 Literaturangaben.
Abstract (Originalsprache)
Objective
ChatGPT and other large language models have the potential to transform the health information landscape online. However, lack of domain-specific expertise and known errors in large language models raise concerns about the widespread adoption of content generated by these tools for parents making healthcare decisions for their children. The aim of this study is to determine if health-related text generated by ChatGPT under the supervision of an expert is comparable to that generated by an expert regarding persuasiveness and credibility from the perspective of a parent.
Methods
In a cross-sectional study 116 parents aged 18–65 years (M = 45.02, SD = 10.92) were asked to complete a baseline assessment of their behavioral intentions regarding pediatric healthcare topics. Subsequently, participants were asked to rate text generated by either an expert or by ChatGPT under supervision of an expert.
Results
Results indicate that prompt engineered ChatGPT is capable of impacting behavioral intentions for medication, sleep, and diet decision-making. Additionally, there was little distinction between prompt engineered ChatGPT and content experts on perceived morality, trustworthiness, expertise, accuracy, and reliance. Notably, when differences were present, prompt engineered ChatGPT was rated as higher in trustworthiness and accuracy, and participants indicated they would be more likely to rely on the information presented by prompt engineered ChatGPT compared to the expert.
Discussion
Given that parents will trust and rely on information generated by ChatGPT, it is critically important that human domain-specific expertise be applied to healthcare information that will ultimately be presented to consumers (e.g., parents).
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Clinical Child Psychology Program, University of Kansas, Lawrence, KS, United States.
- Children's Hospital Colorado & University of Colorado School of Medicine, Aurora, CO, United States.
- Center for Healthy Lifestyles and Nutrition, Children's Mercy, Kansas City, MO, United States.
- Altasciences Clinical Kansas, Overland Park, KS, United States.
- Schiefelbush Lifespan Institute, University of Kansas, Lawrence, KS, United States.
ORCID-Profile: Stacey L Simon
Zitieren
APA
Leslie-Miller, C. J., Simon, S. L., Dean, K., Mokhallati, N., & Cushing, C. C. (2024). The critical need for expert oversight of ChatGPT: Prompt engineering for safeguarding child healthcare information. Journal of Pediatric Psychology, 49(11), 812-817. https://doi.org/10.1093/jpepsy/jsae075
Vancouver
Leslie-Miller CJ, Simon SL, Dean K, Mokhallati N, Cushing CC. The critical need for expert oversight of ChatGPT: Prompt engineering for safeguarding child healthcare information. Journal of Pediatric Psychology. 2024;49(11):812-817. doi:10.1093/jpepsy/jsae075
BibTeX
@article{LeslieMiller2024,
author = {Leslie-Miller, Calissa J and Simon, Stacey L and Dean, Kelsey and Mokhallati, Nadine and Cushing, Christopher C},
title = {The critical need for expert oversight of ChatGPT: Prompt engineering for safeguarding child healthcare information},
journal = {Journal of Pediatric Psychology},
year = {2024},
volume = {49},
number = {11},
pages = {812--817},
doi = {10.1093/jpepsy/jsae075}
}
EUVIMED