EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

TRUE-EWS: TRUSTWORTHY EARLY WARNING WITH EQUALIZED CONFORMAL GUARANTEES FOR EQUITABLE STUDENT SUPPORT IN U.S. EDUCATION

QianYi Fang

Educational Research and Human Development · 11.12.2024 · 1 (2) · 44-54

DOI: 10.61784/erhd4059 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Educational Research and Human Development, online erschienen am 11.12.2024. Verfasst von QianYi Fang. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Early-warning systems are now routine in U.S. schools, colleges, and professional programs, yet a risk score alone does not tell a counselor how often at-risk students from each demographic group will be overlooked, or how often students who are on track will be flagged. This paper presents TRUE-EWS, a Transparent, Reliable, Uncertainty-aware, and Equitable early-warning framework. TRUE-EWS combines a gradient-boosted risk model, a strictly increasing group-wise Beta calibration map, an equalized conformal decision layer (ECC) that runs a Mondrian conformal predictor over group-by-outcome cells, and a TreeSHAP decomposition of between-group risk gaps. ECC maps each student to one of three actions (flag for support, no action, or referral to a counselor) and guarantees, in finite samples and without distributional assumptions, that the miss rate of at-risk students and the false-flag rate of students on track are bounded within every group. We also prove that strictly increasing recalibration leaves ECC decisions unchanged, so probability reliability and decision guarantees can be managed separately. Experiments with 30 stratified random splits on three U.S. cohorts that span the education pipeline, namely Tennessee STAR (early grades), High School and Beyond (college access), and the LSAC National Longitudinal Bar Passage Study (professional licensure), show that standard conformal prediction meets its 90% target overall while covering only 3.0% of at-risk White law students, and that label-conditional prediction flags 37.6% of Non-White students who go on to pass the bar. ECC holds every group-by-outcome coverage between 0.898 and 0.909, lowers the worst-group false-flag rate on LSAC from 0.371 to 0.098 relative to confidence-based deferral at the same counselor workload, and extends directly to intersectional groups.

Zitieren

APA

Fang, Q. (2024). TRUE-EWS: TRUSTWORTHY EARLY WARNING WITH EQUALIZED CONFORMAL GUARANTEES FOR EQUITABLE STUDENT SUPPORT IN U.S. EDUCATION. Educational Research and Human Development, 1(2), 44-54. https://doi.org/10.61784/erhd4059

Vancouver

Fang Q. TRUE-EWS: TRUSTWORTHY EARLY WARNING WITH EQUALIZED CONFORMAL GUARANTEES FOR EQUITABLE STUDENT SUPPORT IN U.S. EDUCATION. Educational Research and Human Development. 2024;1(2):44-54. doi:10.61784/erhd4059

BibTeX
@article{Fang2024,
  author = {Fang, QianYi},
  title = {TRUE-EWS: TRUSTWORTHY EARLY WARNING WITH EQUALIZED CONFORMAL GUARANTEES FOR EQUITABLE STUDENT SUPPORT IN U.S. EDUCATION},
  journal = {Educational Research and Human Development},
  year = {2024},
  volume = {1},
  number = {2},
  pages = {44--54},
  doi = {10.61784/erhd4059}
}
Kostenlos starten →