EUVIMEDSkopri EUVIMED
Crossref

Distribution-free inference with hierarchical data

Yonghoon Lee, Rina Barber, Rebecca Willett

ACM Journal of Data Science · 2026-03-19

DOI: 10.1145/3786352 ↗

At a glance

Journal article in ACM Journal of Data Science, published online on 2026-03-19. Written by Yonghoon Lee and 2 co-authors. Cited 2 times so far (Crossref); 33 references.

AstrattDettalji biblijografiċiCiteRelated studies

Abstract (original language)

This paper studies distribution-free inference in settings where the data set has a hierarchical structure—for example, groups of observations, or repeated measurements. In such settings, standard notions of exchangeability may not hold. To address this challenge, a hierarchical form of exchangeability is derived, facilitating extensions of distribution-free methods, including conformal prediction and jackknife+. While the standard theoretical guarantee obtained by the conformal prediction framework is a marginal predictive coverage guarantee, in the special case of independent repeated measurements, it is possible to achieve a stronger form of coverage—the “second-moment coverage” property—to provide better control of conditional miscoverage rates, and distribution-free prediction sets that achieve this property are constructed. Simulations illustrate that this guarantee indeed leads to uniformly small conditional miscoverage rates. Empirically, this stronger guarantee comes at the cost of a larger width of the prediction set in scenarios where the fitted model is poorly calibrated, but this cost is very mild in cases where the fitted model is accurate.

Cite

APA

Lee, Y., Barber, R., & Willett, R. (2026). Distribution-free inference with hierarchical data. ACM Journal of Data Science. https://doi.org/10.1145/3786352

Vancouver

Lee Y, Barber R, Willett R. Distribution-free inference with hierarchical data. ACM Journal of Data Science. 2026. doi:10.1145/3786352

BibTeX
@article{Lee2026,
  author = {Lee, Yonghoon and Barber, Rina and Willett, Rebecca},
  title = {Distribution-free inference with hierarchical data},
  journal = {ACM Journal of Data Science},
  year = {2026},
  doi = {10.1145/3786352}
}
Start for free →