TRUE-EWS: TRUSTWORTHY EARLY WARNING WITH EQUALIZED CONFORMAL GUARANTEES FOR EQUITABLE STUDENT SUPPORT IN U.S. EDUCATION
Educational Research and Human Development · 11.12.2024 · 1 (2) · 44-54
DOI: 10.61784/erhd4059 ↗Kurz gefasst
Fachartikel in der Zeitschrift Educational Research and Human Development, online erschienen am 11.12.2024. Verfasst von QianYi Fang. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Early-warning systems are now routine in U.S. schools, colleges, and professional programs, yet a risk score alone does not tell a counselor how often at-risk students from each demographic group will be overlooked, or how often students who are on track will be flagged. This paper presents TRUE-EWS, a Transparent, Reliable, Uncertainty-aware, and Equitable early-warning framework. TRUE-EWS combines a gradient-boosted risk model, a strictly increasing group-wise Beta calibration map, an equalized conformal decision layer (ECC) that runs a Mondrian conformal predictor over group-by-outcome cells, and a TreeSHAP decomposition of between-group risk gaps. ECC maps each student to one of three actions (flag for support, no action, or referral to a counselor) and guarantees, in finite samples and without distributional assumptions, that the miss rate of at-risk students and the false-flag rate of students on track are bounded within every group. We also prove that strictly increasing recalibration leaves ECC decisions unchanged, so probability reliability and decision guarantees can be managed separately. Experiments with 30 stratified random splits on three U.S. cohorts that span the education pipeline, namely Tennessee STAR (early grades), High School and Beyond (college access), and the LSAC National Longitudinal Bar Passage Study (professional licensure), show that standard conformal prediction meets its 90% target overall while covering only 3.0% of at-risk White law students, and that label-conditional prediction flags 37.6% of Non-White students who go on to pass the bar. ECC holds every group-by-outcome coverage between 0.898 and 0.909, lowers the worst-group false-flag rate on LSAC from 0.371 to 0.098 relative to confidence-based deferral at the same counselor workload, and extends directly to intersectional groups.
Zitieren
APA
Fang, Q. (2024). TRUE-EWS: TRUSTWORTHY EARLY WARNING WITH EQUALIZED CONFORMAL GUARANTEES FOR EQUITABLE STUDENT SUPPORT IN U.S. EDUCATION. Educational Research and Human Development, 1(2), 44-54. https://doi.org/10.61784/erhd4059
Vancouver
Fang Q. TRUE-EWS: TRUSTWORTHY EARLY WARNING WITH EQUALIZED CONFORMAL GUARANTEES FOR EQUITABLE STUDENT SUPPORT IN U.S. EDUCATION. Educational Research and Human Development. 2024;1(2):44-54. doi:10.61784/erhd4059
BibTeX
@article{Fang2024,
author = {Fang, QianYi},
title = {TRUE-EWS: TRUSTWORTHY EARLY WARNING WITH EQUALIZED CONFORMAL GUARANTEES FOR EQUITABLE STUDENT SUPPORT IN U.S. EDUCATION},
journal = {Educational Research and Human Development},
year = {2024},
volume = {1},
number = {2},
pages = {44--54},
doi = {10.61784/erhd4059}
}
EUVIMED