EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY 4.0

Comparison of Machine Learning Algorithms Identifying Children at Increased Risk of Out‐of‐Home Placement: Development and Practical Considerations

Tyler J Gorham iD, Rose Y Hardy iD, David Ciccone, Deena J Chisolm iD

Health Services Research · 2025

DOI: 10.1111/1475-6773.14601 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Health Services Research, 2025. Verfasst von Tyler J Gorham und 3 weiteren Autor:innen. Beteiligte Einrichtung: IT Research & Innovation, The Abigail Wexner Research Institute at Nationwide Children's Hospital, Columbus, Ohio, USA. Hauptthemen laut MEDLINE: Machine Learning, Algorithms, Foster Home Care. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Centers for Medicare and Medicaid Services.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

To develop a machine learning (ML) algorithm capable of identifying children at risk of out‐of‐home placement among a Medicaid‐insured population. Study Setting and Design The study population includes children enrolled in a Medicaid accountable care organization between 2018 and 2022 in two nonurban Ohio counties served by the Centers for Medicare and Medicaid Services‐funded Integrated Care for Kids Model. Using a retrospective cohort, we developed and compared a set of ML algorithms to identify children at risk of out‐of‐home placement within one year. ML algorithms tested include least absolute shrinkage and selection operator (LASSO)‐regularized logistic regression and eXtreme gradient‐boosted trees (XGBoost). We compared both modeling approaches with and without race as a candidate predictor. Performance metrics included the area under the receiver operating characteristic curve (AUROC) and the corrected partial AUROC at specificities ≥ 90% (pAUROC 90 ). Algorithmic bias was tested by comparing pAUROC 90 across each model between Black and White children. Data Sources and Analytic Sample The modeling dataset was comprised of Medicaid claims and patient demographics data from Partners For Kids, a pediatric accountable care organization. Principal Findings Overall, XGBoost models outperformed LASSO models. When race was included in the model, XGBoost had an AUROC of 0.78 (95% confidence interval [CI]: 0.77–0.79) while the LASSO model had an AUROC of 0.75 (95% CI: 0.74–0.77). When race was excluded from the model, XGBoost had an AUROC of 0.76 (95% CI: 0.74–0.77) while LASSO had an AUROC of 0.73 (95% CI: 0.72–0.74).

Conclusions

The more complex XGBoost outperformed the simpler LASSO in predicting out‐of‐home placement and had less evidence of racial bias. This study highlights the complexities of developing predictive models in systems with known racial disparities and illustrates what can be accomplished when ML developers and policy leaders collaborate to maximize data to meet the needs of children and families.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Machine LearningAlgorithmsFoster Home CareHumansMedicaidUnited StatesRetrospective StudiesMaleFemaleChildChild, PreschoolOhioAccountable Care OrganizationsInfantLogistic ModelsROC CurveAdolescentRisk Assessment

Stichwörter der Autor:innen

Medicaidaccountable care organizationmachine learningout‐of‐home placementpredictive modeling

Autor:innen und Institutionen

  • IT Research & Innovation, The Abigail Wexner Research Institute at Nationwide Children's Hospital, Columbus, Ohio, USA.
  • Center for Child Health Equity and Outcomes Research, The Abigail Wexner Research Institute at Nationwide Children's Hospital, Columbus, Ohio, USA.

ORCID-Profile: Tyler J Gorham, Rose Y Hardy, Deena J Chisolm

Förderung

  • Centers for Medicare and Medicaid Services

Zitieren

APA

Gorham, T. J., Hardy, R. Y., Ciccone, D., & Chisolm, D. J. (2025). Comparison of Machine Learning Algorithms Identifying Children at Increased Risk of Out‐of‐Home Placement: Development and Practical Considerations. Health Services Research. https://doi.org/10.1111/1475-6773.14601

Vancouver

Gorham TJ, Hardy RY, Ciccone D, Chisolm DJ. Comparison of Machine Learning Algorithms Identifying Children at Increased Risk of Out‐of‐Home Placement: Development and Practical Considerations. Health Services Research. 2025. doi:10.1111/1475-6773.14601

BibTeX
@article{Gorham2025,
  author = {Gorham, Tyler J and Hardy, Rose Y and Ciccone, David and Chisolm, Deena J},
  title = {Comparison of Machine Learning Algorithms Identifying Children at Increased Risk of Out‐of‐Home Placement: Development and Practical Considerations},
  journal = {Health Services Research},
  year = {2025},
  doi = {10.1111/1475-6773.14601}
}
Kostenlos starten →