Identifying stigmatizing and positive/preferred language in obstetric clinical notes using natural language processing
Journal of the American Medical Informatics Association · 2025
DOI: 10.1093/jamia/ocae290 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, 2025. Verfasst von Jihye Kim Scroggins und 9 weiteren Autor:innen. Beteiligte Einrichtung: School of Nursing, Columbia University, New York, NY 10032, United States. Hauptthemen laut MEDLINE: Natural Language Processing, Electronic Health Records, Social Stigma, Obstetrics. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Gordon and Betty Moore Foundation, Columbia University Data Science Institute Seed Funds.
Abstract (Originalsprache)
Objective
To identify stigmatizing language in obstetric clinical notes using natural language processing (NLP). Materials and Methods We analyzed electronic health records from birth admissions in the Northeast United States in 2017. We annotated 1771 clinical notes to generate the initial gold standard dataset. Annotators labeled for exemplars of 5 stigmatizing and 1 positive/preferred language categories. We used a semantic similarity-based search approach to expand the initial dataset by adding additional exemplars, composing an enhanced dataset. We employed traditional classifiers (Support Vector Machine, Decision Trees, and Random Forest) and a transformer-based model, ClinicalBERT (Bidirectional Encoder Representations from Transformers) and BERT base. Models were trained and validated on initial and enhanced datasets and were tested on enhanced testing dataset.
Results
In the initial dataset, we annotated 963 exemplars as stigmatizing or positive/preferred. The most frequently identified category was marginalized language/identities (n = 397, 41%), and the least frequent was questioning patient credibility (n = 51, 5%). After employing a semantic similarity-based search approach, 502 additional exemplars were added, increasing the number of low-frequency categories. All NLP models also showed improved performance, with Decision Trees demonstrating the greatest improvement (21%). ClinicalBERT outperformed other models, with the highest average F1-score of 0.78.
Discussion
Clinical BERT seems to most effectively capture the nuanced and context-dependent stigmatizing language found in obstetric clinical notes, demonstrating its potential clinical applications for real-time monitoring and alerts to prevent usages of stigmatizing language use and reduce healthcare bias. Future research should explore stigmatizing language in diverse geographic locations and clinical settings to further contribute to high-quality and equitable perinatal care.
Conclusion
ClinicalBERT effectively captures the nuanced stigmatizing language in obstetric clinical notes. Our semantic similarity-based search approach to rapidly extract additional exemplars enhanced the performances while reducing the need for labor-intensive annotation.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Nursing, Columbia University, New York, NY 10032, United States.
- Icahn School of Medicine, Mount Sinai, NY 10029, United States.
- Department of Computer Science, Aalto University, Espoo 02150, Finland.
- VNS Health, New York, NY 10017, United States.
- School of Nursing, University of Pennsylvania, Philadelphia, PA 19104, United States.
- Center for Community-Engaged Health Informatics and Data Science, Columbia University Irving Medical Center, New York, NY 10032, United States.
ORCID-Profile: Jihye Kim Scroggins, Ismael I Hulchafo, Maxim Topaz
Förderung
- Gordon and Betty Moore Foundation
- Columbia University Data Science Institute Seed Funds
Zitieren
APA
Scroggins, J. K., Hulchafo, I. I., Harkins, S., Scharp, D., Moen, H., Davoudi, A., Cato, K., Tadiello, M., Topaz, M., & Barcelona, V. (2025). Identifying stigmatizing and positive/preferred language in obstetric clinical notes using natural language processing. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocae290
Vancouver
Scroggins JK, Hulchafo II, Harkins S, Scharp D, Moen H, Davoudi A, et al. Identifying stigmatizing and positive/preferred language in obstetric clinical notes using natural language processing. Journal of the American Medical Informatics Association. 2025. doi:10.1093/jamia/ocae290
BibTeX
@article{Scroggins2025,
author = {Scroggins, Jihye Kim and Hulchafo, Ismael I and Harkins, Sarah and Scharp, Danielle and Moen, Hans and Davoudi, Anahita and Cato, Kenrick and Tadiello, Michele and Topaz, Maxim and Barcelona, Veronica},
title = {Identifying stigmatizing and positive/preferred language in obstetric clinical notes using natural language processing},
journal = {Journal of the American Medical Informatics Association},
year = {2025},
doi = {10.1093/jamia/ocae290}
}
EUVIMED