EUVIMEDEUVIMED entdecken
Open Access

Demographic Representation in 3 Leading Artificial Intelligence Text-to-Image Generators

Rohaid Ali, Oliver Y Tang, Ian D Connolly, Hael F Abdulrazeq, Fatima N Mirza, Rachel K Lim, Benjamin R Johnston, Michael W Groff, Theresa Williamson, Konstantina Svokos, Tiffany J Libby, John H Shin und 4 weitere

JAMA Surgery · 01.01.2024 · 159 (1) · 87

DOI: 10.1001/jamasurg.2023.5695 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JAMA Surgery, erschienen am 01.01.2024. Verfasst von Rohaid Ali und 15 weiteren Autor:innen. Beteiligte Einrichtung: Department of Neurosurgery, The Warren Alpert Medical School of Brown University, Providence, Rhode Island. Hauptthemen laut MEDLINE: Surgeons, Specialties, Surgical. Die Arbeit wurde bisher 92-mal zitiert (Crossref) und nennt 22 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Importance The progression of artificial intelligence (AI) text-to-image generators raises concerns of perpetuating societal biases, including profession-based stereotypes.

Objective

To gauge the demographic accuracy of surgeon representation by 3 prominent AI text-to-image models compared to real-world attending surgeons and trainees. Design, Setting, and Participants The study used a cross-sectional design, assessing the latest release of 3 leading publicly available AI text-to-image generators. Seven independent reviewers categorized AI-produced images. A total of 2400 images were analyzed, generated across 8 surgical specialties within each model. An additional 1200 images were evaluated based on geographic prompts for 3 countries. The study was conducted in May 2023. The 3 AI text-to-image generators were chosen due to their popularity at the time of this study. The measure of demographic characteristics was provided by the Association of American Medical Colleges subspecialty report, which references the American Medical Association master file for physician demographic characteristics across 50 states. Given changing demographic characteristics in trainees compared to attending surgeons, the decision was made to look into both groups separately. Race (non-White, defined as any race other than non-Hispanic White, and White) and gender (female and male) were assessed to evaluate known societal biases. Exposures Images were generated using a prompt template, “a photo of the face of a [blank]”, with the blank replaced by a surgical specialty. Geographic-based prompting was evaluated by specifying the most populous countries on 3 continents (the US, Nigeria, and China). Main Outcomes and Measures The study compared representation of female and non-White surgeons in each model with real demographic data using χ 2 , Fisher exact, and proportion tests.

Results

There was a significantly higher mean representation of female (35.8% vs 14.7%; P < .001) and non-White (37.4% vs 22.8%; P < .001) surgeons among trainees than attending surgeons. DALL-E 2 reflected attending surgeons’ true demographic data for female surgeons (15.9% vs 14.7%; P = .39) and non-White surgeons (22.6% vs 22.8%; P = .92) but underestimated trainees’ representation for both female (15.9% vs 35.8%; P < .001) and non-White (22.6% vs 37.4%; P < .001) surgeons. In contrast, Midjourney and Stable Diffusion had significantly lower representation of images of female (0% and 1.8%, respectively; P < .001) and non-White (0.5% and 0.6%, respectively; P < .001) surgeons than DALL-E 2 or true demographic data. Geographic-based prompting increased non-White surgeon representation but did not alter female representation for all models in prompts specifying Nigeria and China. Conclusion and Relevance In this study, 2 leading publicly available text-to-image generators amplified societal biases, depicting over 98% surgeons as White and male. While 1 of the models depicted comparable demographic characteristics to real attending surgeons, all 3 models underestimated trainee representation. The study suggests the need for guardrails and robust feedback systems to minimize AI text-to-image generators magnifying stereotypes in professions such as surgery.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

SurgeonsSpecialties, SurgicalUnited StatesHumansMaleFemaleCross-Sectional StudiesArtificial IntelligenceDemography

Autor:innen und Institutionen

  • Department of Neurosurgery, The Warren Alpert Medical School of Brown University, Providence, Rhode Island.
  • Department of Neurosurgery, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania.
  • Department of Neurosurgery, Massachusetts General Hospital, Boston.
  • Department of Dermatology, The Warren Alpert Medical School of Brown University, Providence, Rhode Island.
  • Department of Neurosurgery, Brigham and Women's Hospital, Boston, Massachusetts.
  • Department of Biomedical Data Science and, by courtesy, Computer Science and Electrical Engineering, Stanford University, Stanford, California.

Zitieren

APA

Ali, R., Tang, O. Y., Connolly, I. D., Abdulrazeq, H. F., Mirza, F. N., Lim, R. K., Johnston, B. R., Groff, M. W., Williamson, T., Svokos, K., Libby, T. J., Shin, J. H., Gokaslan, Z. L., Doberstein, C. E., Zou, J., & Asaad, W. F. (2024). Demographic Representation in 3 Leading Artificial Intelligence Text-to-Image Generators. JAMA Surgery, 159(1), 87. https://doi.org/10.1001/jamasurg.2023.5695

Vancouver

Ali R, Tang OY, Connolly ID, Abdulrazeq HF, Mirza FN, Lim RK, et al. Demographic Representation in 3 Leading Artificial Intelligence Text-to-Image Generators. JAMA Surgery. 2024;159(1):87. doi:10.1001/jamasurg.2023.5695

BibTeX
@article{Ali2024,
  author = {Ali, Rohaid and Tang, Oliver Y and Connolly, Ian D and Abdulrazeq, Hael F and Mirza, Fatima N and Lim, Rachel K and Johnston, Benjamin R and Groff, Michael W and Williamson, Theresa and Svokos, Konstantina and Libby, Tiffany J and Shin, John H and Gokaslan, Ziya L and Doberstein, Curtis E and Zou, James and Asaad, Wael F},
  title = {Demographic Representation in 3 Leading Artificial Intelligence Text-to-Image Generators},
  journal = {JAMA Surgery},
  year = {2024},
  volume = {159},
  number = {1},
  pages = {87},
  doi = {10.1001/jamasurg.2023.5695}
}
Kostenlos starten →