EUVIMEDEUVIMED entdecken
ValidierungsstudieOpen Access · CC BY-NC-ND 4.0

CARE-SD: classifier-based analysis for recognizing provider stigmatizing and doubt marker labels in electronic health records: model development and validation

Andrew Walker iD, Annie Thorne, Sudeshna Das iD, Jennifer Love, Hannah L F Cooper, Melvin Livingston, Abeed Sarker iD

Journal of the American Medical Informatics Association · 2025

DOI: 10.1093/jamia/ocae310 ↗

Kurz gefasst

Validierungsstudie in der Zeitschrift Journal of the American Medical Informatics Association, 2025. Verfasst von Andrew Walker und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Informatics, School of Medicine, Emory University, Atlanta, GA 30322, United States. Hauptthemen laut MEDLINE: Electronic Health Records, Natural Language Processing, Stereotyping, Supervised Machine Learning. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: NIDA NIH HHS, NIH, NIDA.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

To detect and classify features of stigmatizing and biased language in intensive care electronic health records (EHRs) using natural language processing techniques. Materials and Methods We first created a lexicon and regular expression lists from literature-driven stem words for linguistic features of stigmatizing patient labels, doubt markers, and scare quotes within EHRs. The lexicon was further extended using Word2Vec and GPT 3.5, and refined through human evaluation. These lexicons were used to search for matches across 18 million sentences from the de-identified Medical Information Mart for Intensive Care-III (MIMIC-III) dataset. For each linguistic bias feature, 1000 sentence matches were sampled, labeled by expert clinical and public health annotators, and used to supervised learning classifiers.

Results

Lexicon development from expanded literature stem-word lists resulted in a doubt marker lexicon containing 58 expressions, and a stigmatizing labels lexicon containing 127 expressions. Classifiers for doubt markers and stigmatizing labels had the highest performance, with macro F1-scores of 0.84 and 0.79, positive-label recall and precision values ranging from 0.71 to 0.86, and accuracies aligning closely with human annotator agreement (0.87).

Discussion

This study demonstrated the feasibility of supervised classifiers in automatically identifying stigmatizing labels and doubt markers in medical text and identified trends in stigmatizing language use in an EHR setting. Additional labeled data may help improve lower scare quote model performance.

Conclusions

Classifiers developed in this study showed high model performance and can be applied to identify patterns and target interventions to reduce stigmatizing labels and doubt markers in healthcare systems.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Electronic Health RecordsNatural Language ProcessingStereotypingSupervised Machine LearningSocial StigmaHumans

Stichwörter der Autor:innen

electronic health recordnatural language processingstigmatext classification

Autor:innen und Institutionen

  • Department of Biomedical Informatics, School of Medicine, Emory University, Atlanta, GA 30322, United States.
  • Department of Infectious Disease, Children's Healthcare of Atlanta, Atlanta, GA 30329, United States.
  • Department of Emergency Medicine, Mount Sinai, New York, NY 10029, United States.
  • Department of Behavioral, Social, Health Education Sciences, Rollins School of Public Health, Emory University, Atlanta, GA 30322, United States.
  • Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, GA 30332, United States.

ORCID-Profile: Andrew Walker, Sudeshna Das, Abeed Sarker

Förderung

  • NIDA NIH HHS
  • NIH
  • NIDA
  • National Institute on Drug Abuse

Zitieren

APA

Walker, A., Thorne, A., Das, S., Love, J., Cooper, H. L. F., Livingston, M., & Sarker, A. (2025). CARE-SD: classifier-based analysis for recognizing provider stigmatizing and doubt marker labels in electronic health records: model development and validation. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocae310

Vancouver

Walker A, Thorne A, Das S, Love J, Cooper HLF, Livingston M, et al. CARE-SD: classifier-based analysis for recognizing provider stigmatizing and doubt marker labels in electronic health records: model development and validation. Journal of the American Medical Informatics Association. 2025. doi:10.1093/jamia/ocae310

BibTeX
@article{Walker2025,
  author = {Walker, Andrew and Thorne, Annie and Das, Sudeshna and Love, Jennifer and Cooper, Hannah L F and Livingston, Melvin and Sarker, Abeed},
  title = {CARE-SD: classifier-based analysis for recognizing provider stigmatizing and doubt marker labels in electronic health records: model development and validation},
  journal = {Journal of the American Medical Informatics Association},
  year = {2025},
  doi = {10.1093/jamia/ocae310}
}
Kostenlos starten →