EUVIMEDEUVIMED entdecken
Open Access

Gender Representation of Health Care Professionals in Large Language Model–Generated Stories

Bradley D Menz, Nicole M Kuderer, Benjamin Chin-Yee, Jessica M Logan, Andrew Rowland, Michael J Sorich, Ashley M Hopkins

JAMA Network Open · 23.09.2024 · 7 (9) · e2434997

DOI: 10.1001/jamanetworkopen.2024.34997 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JAMA Network Open, online erschienen am 23.09.2024. Verfasst von Bradley D Menz und 6 weiteren Autor:innen. Beteiligte Einrichtung: College of Medicine and Public Health, Flinders University, Adelaide, South Australia, Australia. Hauptthemen laut MEDLINE: Health Personnel. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Importance With the growing use of large language models (LLMs) in education and health care settings, it is important to ensure that the information they generate is diverse and equitable, to avoid reinforcing or creating stereotypes that may influence the aspirations of upcoming generations.

Objective

To evaluate the gender representation of LLM-generated stories involving medical doctors, surgeons, and nurses and to investigate the association of varying personality and professional seniority descriptors with the gender proportions for these professions. Design, Setting, and Participants This is a cross-sectional simulation study of publicly accessible LLMs, accessed from December 2023 to January 2024. GPT-3.5-turbo and GPT-4 (OpenAI), Gemini-pro (Google), and Llama-2-70B-chat (Meta) were prompted to generate 500 stories featuring medical doctors, surgeons, and nurses for a total 6000 stories. A further 43 200 prompts were submitted to the LLMs containing varying descriptors of personality (agreeableness, neuroticism, extraversion, conscientiousness, and openness) and professional seniority. Main Outcomes and Measures The primary outcome was the gender proportion (she/her vs he/him) within stories generated by LLMs about medical doctors, surgeons, and nurses, through analyzing the pronouns contained within the stories using χ 2 analyses. The pronoun proportions for each health care profession were compared with US Census data by descriptive statistics and χ 2 tests.

Results

In the initial 6000 prompts submitted to the LLMs, 98% of nurses were referred to by she/her pronouns. The representation of she/her for medical doctors ranged from 50% to 84%, and that for surgeons ranged from 36% to 80%. In the 43 200 additional prompts containing personality and seniority descriptors, stories of medical doctors and surgeons with higher agreeableness, openness, and conscientiousness, as well as lower neuroticism, resulted in higher she/her (reduced he/him) representation. For several LLMs, stories focusing on senior medical doctors and surgeons were less likely to be she/her than stories focusing on junior medical doctors and surgeons. Conclusions and Relevance This cross-sectional study highlights the need for LLM developers to update their tools for equitable and diverse gender representation in essential health care roles, including medical doctors, surgeons, and nurses. As LLMs become increasingly adopted throughout health care and education, continuous monitoring of these tools is needed to ensure that they reflect a diverse workforce, capable of serving society’s needs effectively.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Health PersonnelHumansCross-Sectional StudiesFemaleMaleLanguagePersonalityPhysicians

Autor:innen und Institutionen

  • College of Medicine and Public Health, Flinders University, Adelaide, South Australia, Australia.
  • Advanced Cancer Research Group, Kirkland, Washington.
  • Schulich School of Medicine and Dentistry, Western University, London, Canada.
  • Department of History and Philosophy of Science, University of Cambridge, Cambridge, United Kingdom.
  • Clinical and Health Sciences, University of South Australia, Adelaide, South Australia, Australia.

Zitieren

APA

Menz, B. D., Kuderer, N. M., Chin-Yee, B., Logan, J. M., Rowland, A., Sorich, M. J., & Hopkins, A. M. (2024). Gender Representation of Health Care Professionals in Large Language Model–Generated Stories. JAMA Network Open, 7(9), e2434997. https://doi.org/10.1001/jamanetworkopen.2024.34997

Vancouver

Menz BD, Kuderer NM, Chin-Yee B, Logan JM, Rowland A, Sorich MJ, et al. Gender Representation of Health Care Professionals in Large Language Model–Generated Stories. JAMA Network Open. 2024;7(9):e2434997. doi:10.1001/jamanetworkopen.2024.34997

BibTeX
@article{Menz2024,
  author = {Menz, Bradley D and Kuderer, Nicole M and Chin-Yee, Benjamin and Logan, Jessica M and Rowland, Andrew and Sorich, Michael J and Hopkins, Ashley M},
  title = {Gender Representation of Health Care Professionals in Large Language Model–Generated Stories},
  journal = {JAMA Network Open},
  year = {2024},
  volume = {7},
  number = {9},
  pages = {e2434997},
  doi = {10.1001/jamanetworkopen.2024.34997}
}
Kostenlos starten →