EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Development and validation of natural language processing algorithms in the national ENACT network

Yanshan Wang iD, Jordan Hilsman, Chenyu Li iD, Michele Morris, Paul M Heider, Sunyang Fu, Min Ji Kwak, Andrew Wen, Joseph R Applegate, Liwei Wang, Elmer Bernstam, Hongfang Liu und 24 weitere

Journal of Clinical and Translational Science · 2025 · 9 (1)

DOI: 10.1017/cts.2025.10116 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Clinical and Translational Science, online erschienen am 22.08.2025. Verfasst von Yanshan Wang und 35 weiteren Autor:innen. Beteiligte Einrichtung: Clinical and Translational Science Institute, University of Pittsburgh, Pittsburgh, PA, USA. Die Arbeit wurde bisher 3-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NLM NIH HHS, NINDS NIH HHS, NCI NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

Electronic Health Record (EHR) data are critical for advancing translational research and AI technologies. The ENACT network offers access to structured EHR data across 57 CTSA hubs. However, substantial information is contained in clinical narratives, requiring natural language processing (NLP) for research. The ENACT NLP Working Group was formed to make NLP-derived clinical information accessible and queryable across the network.

Methods

We established the ENACT NLP Working Group with 13 sites selected based on criteria including clinical notes access, IT infrastructure, NLP expertise, and institutional support. We divided sites into five focus groups targeting clinical tasks within disease contexts. Each focus group consisted of two development sites and two validation sites. We extended the ENACT ontology to standardize NLP-derived data and conducted multisite evaluations using the Open Health Natural Language Processing (OHNLP) Toolkit.

Results

The working group achieved 100% site retention and deployed NLP infrastructure across all sites. We developed and validated NLP algorithms for rare disease phenotyping, social determinants of health, opioid use disorder, sleep phenotyping, and delirium phenotyping. Performance varied across sites (F1 scores 0.53–0.96), highlighting data heterogeneity impacts. We extended the ENACT common data model and ontology to incorporate NLP-derived data while maintaining Shared Health Research Informatics NEtwork (SHRINE) compatibility.

Conclusion

This demonstrates feasibility of deploying NLP infrastructure across large, federated networks. The focus group approach proved more practical than general-purpose approaches. Key lessons include the challenge of data heterogeneity and importance of collaborative governance. This work also provides a foundation that other networks can build on to implement NLP capabilities for translational research.

Schlagwörter

Stichwörter der Autor:innen

ENACTTranslational researchelectronic health recordsnatural language processingnetwork

Autor:innen und Institutionen

  • Clinical and Translational Science Institute, University of Pittsburgh, Pittsburgh, PA, USA.
  • Department of Health Information Management, University of Pittsburgh, Pittsburgh, PA, USA.
  • Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA, USA.
  • Biomedical Informatics Center and Department of Public Health Sciences, Medical University of South Carolina, Charleston, SC, USA.
  • McWilliams School of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, TX, USA.
  • McGovern Medical School, University of Texas Health Science Center at Houston, Houston, TX, USA.

ORCID-Profile: Yanshan Wang, Chenyu Li, Daniel R Harris, Jungwei W Fan

Förderung

  • NLM NIH HHS
  • NINDS NIH HHS
  • NCI NIH HHS
  • NIA NIH HHS

Zitieren

APA

Wang, Y., Hilsman, J., Li, C., Morris, M., Heider, P. M., Fu, S., Kwak, M. J., Wen, A., Applegate, J. R., Wang, L., Bernstam, E., Liu, H., Chang, J., Harris, D. R., Corbeau, A., Henderson, D., Osborne, J., Kennedy, R. E., Garduno-Rapp, N. E., …, & Visweswaran, S. (2025). Development and validation of natural language processing algorithms in the national ENACT network. Journal of Clinical and Translational Science, 9(1). https://doi.org/10.1017/cts.2025.10116

Vancouver

Wang Y, Hilsman J, Li C, Morris M, Heider PM, Fu S, et al. Development and validation of natural language processing algorithms in the national ENACT network. Journal of Clinical and Translational Science. 2025;9(1). doi:10.1017/cts.2025.10116

BibTeX
@article{Wang2025,
  author = {Wang, Yanshan and Hilsman, Jordan and Li, Chenyu and Morris, Michele and Heider, Paul M and Fu, Sunyang and Kwak, Min Ji and Wen, Andrew and Applegate, Joseph R and Wang, Liwei and Bernstam, Elmer and Liu, Hongfang and Chang, Jack and Harris, Daniel R and Corbeau, Alexandria and Henderson, Darren and Osborne, John and Kennedy, Richard E and Garduno-Rapp, Nelly-Estefanie and Rousseau, Justin F and Yan, Chao and Chen, You and Patel, Mayur B and Murphy, Tyler J and Malin, Bradley A and Park, Chan Mi and Fan, Jungwei W and Sohn, Sunghwan and Pagali, Sandeep and Peng, Yifan and Pathak, Aman and Wu, Yonghui and Xia, Zongqi and Loguercio, Salvatore and Reis, Steven E and Visweswaran, Shyam},
  title = {Development and validation of natural language processing algorithms in the national ENACT network},
  journal = {Journal of Clinical and Translational Science},
  year = {2025},
  volume = {9},
  number = {1},
  doi = {10.1017/cts.2025.10116}
}
Kostenlos starten →