Performance of 4 Methods to Assess Health-Related Social Needs
JAMA Network Open · 18.08.2025 · 8 (8) · e2527426
DOI: 10.1001/jamanetworkopen.2025.27426 ↗Kurz gefasst
Fachartikel in der Zeitschrift JAMA Network Open, online erschienen am 18.08.2025. Verfasst von Joshua R Vest und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Health Policy & Management, Indiana University Richard M. Fairbanks School of Public Health, Indianapolis. Hauptthemen laut MEDLINE: Needs Assessment. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Importance Organizations use health-related social needs (HRSN) information to identify patients in need of referrals, to increase clinician awareness, to improve analytics, and for quality reporting.
Objective
To contrast the performance of screening questionnaires, natural language processing (NLP) of clinical notes, rule-based computable phenotypes, and machine learning (ML) classification models in measuring HRSNs. Design, Setting, and Participants This cross-sectional study assessed 4 measurement approaches for 5 HRSNs in parallel. Each approach was treated as a screening test. Data included notes from adult patients treated at primary care clinics in 2 health systems in Indianapolis, Indiana, from January 2022 to June 2023. Data were analyzed from December 2024 to February 2025. Exposures Reference standard instruments measured food insecurity, housing instability, financial strain, transportation barriers, and history of legal problems. Participants completed the HRSN screening questions in the electronic health record (EHR). NLP algorithms, gradient-boosted decision tree ML classifiers, and refined versions of human-defined rule-based computable phenotypes were applied to participants’ past 12 months EHR data. Main Outcomes and Measures Sensitivity, specificity, area under the curve (AUC), and positive predictive values (PPV) described performance of each approach against the reference standard measures. False-negative rates were used to explore fairness.
Results
Data from a total of 1252 adult patients (407 [32.51%] aged 30 to 49 years; 821 [65.58%] female) were assessed, including 94 (7.51%) who identified as Hispanic, 602 (48.08%) as non-Hispanic Black or African American, and 442 (35.30%) as non-Hispanic White. The screening questions method had the strongest overall performance for food insecurity (AUC, 0.94; 95% CI, 0.93-0.95), housing instability (AUC, 0.78; 95% CI, 0.75-0.80), transportation barriers (AUC, 0.77; 95% CI, 0.74-0.79), and legal problems (AUC, 0.81; 95% CI, 0.77-0.85). The screening questions had poor performance for financial strain (AUC, 0.62; 95% CI, 0.60-0.65). The PPV for screening tools ranged from 0.77 to 0.92, indicating utility for individual-level decision-making. NLP and rule-based computable phenotypes had poor performance. ML classification resulted in higher sensitivities than the other methods. False-negative rates indicated differential, unfair performance for all measurement approaches by gender, race and ethnicity, and age groups. Conclusions and Relevance In this cross-sectional study of HRSN measurement, no approach performed strongly for every HRSN, and every approach had indication of unfair performance. These findings suggest that practitioners, health care and public health organizations, researchers, and policymakers who rely on a single method to collect HRSN data will likely underestimate patients’ true social burden.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Health Policy & Management, Indiana University Richard M. Fairbanks School of Public Health, Indianapolis.
- Center for Biomedical Informatics, Regenstrief Institute, Indianapolis, Indiana.
- Department of Psychology, Indiana University, Indianapolis.
- Department of Health Outcomes & Biomedical Informatics, College of Medicine, University of Florida, Gainesville.
- Division of Biomedical Informatics, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio.
- Department of Biostatistics and Health Data Science, Indiana University School of Medicine, Indianapolis.
Zitieren
APA
Vest, J. R., Wu, W., Gregory, M. E., Kasturi, S. N., Mendonca, E. A., Bian, J., Magoc, T., Grannis, S., McNamee, C., & Harle, C. A. (2025). Performance of 4 Methods to Assess Health-Related Social Needs. JAMA Network Open, 8(8), e2527426. https://doi.org/10.1001/jamanetworkopen.2025.27426
Vancouver
Vest JR, Wu W, Gregory ME, Kasturi SN, Mendonca EA, Bian J, et al. Performance of 4 Methods to Assess Health-Related Social Needs. JAMA Network Open. 2025;8(8):e2527426. doi:10.1001/jamanetworkopen.2025.27426
BibTeX
@article{Vest2025,
author = {Vest, Joshua R and Wu, Wei and Gregory, Megan E and Kasturi, Suranga N and Mendonca, Eneida A and Bian, Jiang and Magoc, Tanja and Grannis, Shaun and McNamee, Cassidy and Harle, Christopher A},
title = {Performance of 4 Methods to Assess Health-Related Social Needs},
journal = {JAMA Network Open},
year = {2025},
volume = {8},
number = {8},
pages = {e2527426},
doi = {10.1001/jamanetworkopen.2025.27426}
}
EUVIMED