Development and validation of natural language processing algorithms in the national ENACT network
Journal of Clinical and Translational Science · 2025 · 9 (1)
DOI: 10.1017/cts.2025.10116 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Clinical and Translational Science, online erschienen am 22.08.2025. Verfasst von Yanshan Wang und 35 weiteren Autor:innen. Beteiligte Einrichtung: Clinical and Translational Science Institute, University of Pittsburgh, Pittsburgh, PA, USA. Die Arbeit wurde bisher 3-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NLM NIH HHS, NINDS NIH HHS, NCI NIH HHS.
Abstract (Originalsprache)
Objective
Electronic Health Record (EHR) data are critical for advancing translational research and AI technologies. The ENACT network offers access to structured EHR data across 57 CTSA hubs. However, substantial information is contained in clinical narratives, requiring natural language processing (NLP) for research. The ENACT NLP Working Group was formed to make NLP-derived clinical information accessible and queryable across the network.
Methods
We established the ENACT NLP Working Group with 13 sites selected based on criteria including clinical notes access, IT infrastructure, NLP expertise, and institutional support. We divided sites into five focus groups targeting clinical tasks within disease contexts. Each focus group consisted of two development sites and two validation sites. We extended the ENACT ontology to standardize NLP-derived data and conducted multisite evaluations using the Open Health Natural Language Processing (OHNLP) Toolkit.
Results
The working group achieved 100% site retention and deployed NLP infrastructure across all sites. We developed and validated NLP algorithms for rare disease phenotyping, social determinants of health, opioid use disorder, sleep phenotyping, and delirium phenotyping. Performance varied across sites (F1 scores 0.53–0.96), highlighting data heterogeneity impacts. We extended the ENACT common data model and ontology to incorporate NLP-derived data while maintaining Shared Health Research Informatics NEtwork (SHRINE) compatibility.
Conclusion
This demonstrates feasibility of deploying NLP infrastructure across large, federated networks. The focus group approach proved more practical than general-purpose approaches. Key lessons include the challenge of data heterogeneity and importance of collaborative governance. This work also provides a foundation that other networks can build on to implement NLP capabilities for translational research.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Clinical and Translational Science Institute, University of Pittsburgh, Pittsburgh, PA, USA.
- Department of Health Information Management, University of Pittsburgh, Pittsburgh, PA, USA.
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA, USA.
- Biomedical Informatics Center and Department of Public Health Sciences, Medical University of South Carolina, Charleston, SC, USA.
- McWilliams School of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, TX, USA.
- McGovern Medical School, University of Texas Health Science Center at Houston, Houston, TX, USA.
ORCID-Profile: Yanshan Wang, Chenyu Li, Daniel R Harris, Jungwei W Fan
Förderung
- NLM NIH HHS
- NINDS NIH HHS
- NCI NIH HHS
- NIA NIH HHS
Zitieren
APA
Wang, Y., Hilsman, J., Li, C., Morris, M., Heider, P. M., Fu, S., Kwak, M. J., Wen, A., Applegate, J. R., Wang, L., Bernstam, E., Liu, H., Chang, J., Harris, D. R., Corbeau, A., Henderson, D., Osborne, J., Kennedy, R. E., Garduno-Rapp, N. E., …, & Visweswaran, S. (2025). Development and validation of natural language processing algorithms in the national ENACT network. Journal of Clinical and Translational Science, 9(1). https://doi.org/10.1017/cts.2025.10116
Vancouver
Wang Y, Hilsman J, Li C, Morris M, Heider PM, Fu S, et al. Development and validation of natural language processing algorithms in the national ENACT network. Journal of Clinical and Translational Science. 2025;9(1). doi:10.1017/cts.2025.10116
BibTeX
@article{Wang2025,
author = {Wang, Yanshan and Hilsman, Jordan and Li, Chenyu and Morris, Michele and Heider, Paul M and Fu, Sunyang and Kwak, Min Ji and Wen, Andrew and Applegate, Joseph R and Wang, Liwei and Bernstam, Elmer and Liu, Hongfang and Chang, Jack and Harris, Daniel R and Corbeau, Alexandria and Henderson, Darren and Osborne, John and Kennedy, Richard E and Garduno-Rapp, Nelly-Estefanie and Rousseau, Justin F and Yan, Chao and Chen, You and Patel, Mayur B and Murphy, Tyler J and Malin, Bradley A and Park, Chan Mi and Fan, Jungwei W and Sohn, Sunghwan and Pagali, Sandeep and Peng, Yifan and Pathak, Aman and Wu, Yonghui and Xia, Zongqi and Loguercio, Salvatore and Reis, Steven E and Visweswaran, Shyam},
title = {Development and validation of natural language processing algorithms in the national ENACT network},
journal = {Journal of Clinical and Translational Science},
year = {2025},
volume = {9},
number = {1},
doi = {10.1017/cts.2025.10116}
}
EUVIMED