EUVIMEDEUVIMED entdecken
Open Access

Does synthetic data augmentation improve the performances of machine learning classifiers for identifying health problems in patient–nurse verbal communications in home healthcare settings?

Jihye Kim Scroggins iD, Maxim Topaz, Jiyoun Song iD, Maryam Zolnoori

Journal of Nursing Scholarship · 2025

DOI: 10.1111/jnu.13004 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Nursing Scholarship, 2025. Verfasst von Jihye Kim Scroggins und 3 weiteren Autor:innen. Beteiligte Einrichtung: Columbia University School of Nursing, New York, New York, USA. Hauptthemen laut MEDLINE: Nurses, Data Analysis, Boosting Machine Learning Algorithms, Home Health Nursing. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NIA NIH HHS, National Institute on Aging.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Identifying health problems in audio‐recorded patient–nurse communication is important to improve outcomes in home healthcare patients who have complex conditions with increased risks of hospital utilization. Training machine learning classifiers for identifying problems requires resource‐intensive human annotation.

Objective

To generate synthetic patient–nurse communication and to automatically annotate for common health problems encountered in home healthcare settings using GPT‐4. We also examined whether augmenting real‐world patient–nurse communication with synthetic data can improve the performance of machine learning to identify health problems.

Design

Secondary data analysis of patient–nurse verbal communication data in home healthcare settings.

Methods

The data were collected from one of the largest home healthcare organizations in the United States. We used 23 audio recordings of patient–nurse communications from 15 patients. The audio recordings were transcribed verbatim and manually annotated for health problems (e.g., circulation, skin, pain) indicated in the Omaha System Classification scheme. Synthetic data of patient–nurse communication were generated using the in‐context learning prompting method, enhanced by chain‐of‐thought prompting to improve the automatic annotation performance. Machine learning classifiers were applied to three training datasets: real‐world communication, synthetic communication, and real‐world communication augmented by synthetic communication.

Results

Average F 1 scores improved from 0.62 to 0.63 after training data were augmented with synthetic communication. The largest increase was observed using the XGBoost classifier where F 1 scores improved from 0.61 to 0.64 (about 5% improvement). When trained solely on either real‐world communication or synthetic communication, the classifiers showed comparable F 1 scores of 0.62–0.61, respectively.

Conclusion

Integrating synthetic data improves machine learning classifiers' ability to identify health problems in home healthcare, with performance comparable to training on real‐world data alone, highlighting the potential of synthetic data in healthcare analytics. Clinical Relevance This study demonstrates the clinical relevance of leveraging synthetic patient–nurse communication data to enhance machine learning classifier performances to identify health problems in home healthcare settings, which will contribute to more accurate and efficient problem identification and detection of home healthcare patients with complex health conditions.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

NursesData AnalysisBoosting Machine Learning AlgorithmsHome Health NursingNurse-Patient RelationsCommunicationSound RecordingsUnited StatesHumansMaleFemaleAgedLarge Language Models

Stichwörter der Autor:innen

home healthcarelarge language modelmachine learningpatient–nurse verbal communicationsynthetic data augmentation

Autor:innen und Institutionen

  • Columbia University School of Nursing, New York, New York, USA.
  • Data Science Institute, Columbia University, New York, New York, USA.
  • Center for Home Care Policy & Research, VNS Health, New York, New York, USA.
  • University of Pennsylvania School of Nursing, Philadelphia, Pennsylvania, USA.

ORCID-Profile: Jihye Kim Scroggins, Jiyoun Song

Förderung

  • NIA NIH HHS
  • National Institute on Aging

Zitieren

APA

Scroggins, J. K., Topaz, M., Song, J., & Zolnoori, M. (2025). Does synthetic data augmentation improve the performances of machine learning classifiers for identifying health problems in patient–nurse verbal communications in home healthcare settings?. Journal of Nursing Scholarship. https://doi.org/10.1111/jnu.13004

Vancouver

Scroggins JK, Topaz M, Song J, Zolnoori M. Does synthetic data augmentation improve the performances of machine learning classifiers for identifying health problems in patient–nurse verbal communications in home healthcare settings?. Journal of Nursing Scholarship. 2025. doi:10.1111/jnu.13004

BibTeX
@article{Scroggins2025,
  author = {Scroggins, Jihye Kim and Topaz, Maxim and Song, Jiyoun and Zolnoori, Maryam},
  title = {Does synthetic data augmentation improve the performances of machine learning classifiers for identifying health problems in patient–nurse verbal communications in home healthcare settings?},
  journal = {Journal of Nursing Scholarship},
  year = {2025},
  doi = {10.1111/jnu.13004}
}
Kostenlos starten →