Comparison of Machine Learning Algorithms Identifying Children at Increased Risk of Out‐of‐Home Placement: Development and Practical Considerations
Health Services Research · 2025
DOI: 10.1111/1475-6773.14601 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Health Services Research, 2025. Verfasst von Tyler J Gorham und 3 weiteren Autor:innen. Beteiligte Einrichtung: IT Research & Innovation, The Abigail Wexner Research Institute at Nationwide Children's Hospital, Columbus, Ohio, USA. Hauptthemen laut MEDLINE: Machine Learning, Algorithms, Foster Home Care. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Centers for Medicare and Medicaid Services.
Themen: Künstliche Intelligenz in der Pflege, Kinderkrankenpflege
Abstract (Originalsprache)
Objective
To develop a machine learning (ML) algorithm capable of identifying children at risk of out‐of‐home placement among a Medicaid‐insured population. Study Setting and Design The study population includes children enrolled in a Medicaid accountable care organization between 2018 and 2022 in two nonurban Ohio counties served by the Centers for Medicare and Medicaid Services‐funded Integrated Care for Kids Model. Using a retrospective cohort, we developed and compared a set of ML algorithms to identify children at risk of out‐of‐home placement within one year. ML algorithms tested include least absolute shrinkage and selection operator (LASSO)‐regularized logistic regression and eXtreme gradient‐boosted trees (XGBoost). We compared both modeling approaches with and without race as a candidate predictor. Performance metrics included the area under the receiver operating characteristic curve (AUROC) and the corrected partial AUROC at specificities ≥ 90% (pAUROC 90 ). Algorithmic bias was tested by comparing pAUROC 90 across each model between Black and White children. Data Sources and Analytic Sample The modeling dataset was comprised of Medicaid claims and patient demographics data from Partners For Kids, a pediatric accountable care organization. Principal Findings Overall, XGBoost models outperformed LASSO models. When race was included in the model, XGBoost had an AUROC of 0.78 (95% confidence interval [CI]: 0.77–0.79) while the LASSO model had an AUROC of 0.75 (95% CI: 0.74–0.77). When race was excluded from the model, XGBoost had an AUROC of 0.76 (95% CI: 0.74–0.77) while LASSO had an AUROC of 0.73 (95% CI: 0.72–0.74).
Conclusions
The more complex XGBoost outperformed the simpler LASSO in predicting out‐of‐home placement and had less evidence of racial bias. This study highlights the complexities of developing predictive models in systems with known racial disparities and illustrates what can be accomplished when ML developers and policy leaders collaborate to maximize data to meet the needs of children and families.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- IT Research & Innovation, The Abigail Wexner Research Institute at Nationwide Children's Hospital, Columbus, Ohio, USA.
- Center for Child Health Equity and Outcomes Research, The Abigail Wexner Research Institute at Nationwide Children's Hospital, Columbus, Ohio, USA.
ORCID-Profile: Tyler J Gorham, Rose Y Hardy, Deena J Chisolm
Förderung
- Centers for Medicare and Medicaid Services
Zitieren
APA
Gorham, T. J., Hardy, R. Y., Ciccone, D., & Chisolm, D. J. (2025). Comparison of Machine Learning Algorithms Identifying Children at Increased Risk of Out‐of‐Home Placement: Development and Practical Considerations. Health Services Research. https://doi.org/10.1111/1475-6773.14601
Vancouver
Gorham TJ, Hardy RY, Ciccone D, Chisolm DJ. Comparison of Machine Learning Algorithms Identifying Children at Increased Risk of Out‐of‐Home Placement: Development and Practical Considerations. Health Services Research. 2025. doi:10.1111/1475-6773.14601
BibTeX
@article{Gorham2025,
author = {Gorham, Tyler J and Hardy, Rose Y and Ciccone, David and Chisolm, Deena J},
title = {Comparison of Machine Learning Algorithms Identifying Children at Increased Risk of Out‐of‐Home Placement: Development and Practical Considerations},
journal = {Health Services Research},
year = {2025},
doi = {10.1111/1475-6773.14601}
}
EUVIMED