EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitScoping ReviewOpen Access

Reporting of Fairness Metrics in Clinical Risk Prediction Models Used for Precision Health: Scoping Review

Lillian Rountree iD, Yi-Ting Lin iD, Chuyu Liu iD, Maxwell Salvatore iD, Andrew Admon iD, Brahmajee Nallamothu iD, Karandeep Singh iD, Anirban Basu iD, Fan Bu iD, Bhramar Mukherjee iD

Online Journal of Public Health Informatics · 19.03.2025 · 17 · e66598

DOI: 10.2196/66598 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Online Journal of Public Health Informatics, online erschienen am 19.03.2025. Verfasst von Lillian Rountree und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biostatistics, School of Public Health, University of Michigan, Ann Arbor, MI, United States. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NHLBI NIH HHS, NCI NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Clinical risk prediction models integrated into digitized health care informatics systems hold promise for personalized primary prevention and care, a core goal of precision health. Fairness metrics are important tools for evaluating potential disparities across sensitive features, such as sex and race or ethnicity, in the field of prediction modeling. However, fairness metric usage in clinical risk prediction models remains infrequent, sporadic, and rarely empirically evaluated.

Objective

We seek to assess the uptake of fairness metrics in clinical risk prediction modeling through an empirical evaluation of popular prediction models for 2 diseases, 1 chronic and 1 infectious disease.

Methods

We conducted a scoping literature review in November 2023 of recent high-impact publications on clinical risk prediction models for cardiovascular disease (CVD) and COVID-19 using Google Scholar.

Results

Our review resulted in a shortlist of 23 CVD-focused articles and 22 COVID-19 pandemic–focused articles. No articles evaluated fairness metrics. Of the CVD-focused articles, 26% used a sex-stratified model, and of those with race or ethnicity data, 92% had study populations that were more than 50% from 1 race or ethnicity. Of the COVID-19 models, 9% used a sex-stratified model, and of those that included race or ethnicity data, 50% had study populations that were more than 50% from 1 race or ethnicity. No articles for either disease stratified their models by race or ethnicity.

Conclusions

Our review shows that the use of fairness metrics for evaluating differences across sensitive features is rare, despite their ability to identify inequality and flag potential gaps in prevention and care. We also find that training data remain largely racially and ethnically homogeneous, demonstrating an urgent need for diversifying study cohorts and data collection. We propose an implementation framework to initiate change, calling for better connections between theory and practice when it comes to the adoption of fairness metrics for clinical risk prediction. We hypothesize that this integration will lead to a more equitable prediction world.

Schlagwörter

Stichwörter der Autor:innen

COVID-19biascardiovascular diseaseclinical risk predictionequityrisk stratificationsensitive features

Autor:innen und Institutionen

  • Department of Biostatistics, School of Public Health, University of Michigan, Ann Arbor, MI, United States.
  • Department of Epidemiology and Biostatistics, College of Human Medicine, Michigan State University, East Lansing, MI, United States.
  • Departments of Biostatistics, Epidemiology, and Informatics and Genetics, University of Pennsylvania, Philadelphia, PA, United States.
  • Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, University of Michigan, Ann Arbor, MI, United States.
  • Institute for Healthcare Policy & Innovation, University of Michigan, Ann Arbor, MI, United States.
  • Department of Medicine, School of Medicine, University of California San Diego, San Diego, CA, United States.

ORCID-Profile: Lillian Rountree, Yi-Ting Lin, Chuyu Liu, Maxwell Salvatore, Andrew Admon, Brahmajee Nallamothu, Karandeep Singh, Anirban Basu, Fan Bu, Bhramar Mukherjee

Förderung

  • NHLBI NIH HHS
  • NCI NIH HHS

Zitieren

APA

Rountree, L., Lin, Y. T., Liu, C., Salvatore, M., Admon, A., Nallamothu, B., Singh, K., Basu, A., Bu, F., & Mukherjee, B. (2025). Reporting of Fairness Metrics in Clinical Risk Prediction Models Used for Precision Health: Scoping Review. Online Journal of Public Health Informatics, 17, e66598. https://doi.org/10.2196/66598

Vancouver

Rountree L, Lin YT, Liu C, Salvatore M, Admon A, Nallamothu B, et al. Reporting of Fairness Metrics in Clinical Risk Prediction Models Used for Precision Health: Scoping Review. Online Journal of Public Health Informatics. 2025;17:e66598. doi:10.2196/66598

BibTeX
@article{Rountree2025,
  author = {Rountree, Lillian and Lin, Yi-Ting and Liu, Chuyu and Salvatore, Maxwell and Admon, Andrew and Nallamothu, Brahmajee and Singh, Karandeep and Basu, Anirban and Bu, Fan and Mukherjee, Bhramar},
  title = {Reporting of Fairness Metrics in Clinical Risk Prediction Models Used for Precision Health: Scoping Review},
  journal = {Online Journal of Public Health Informatics},
  year = {2025},
  volume = {17},
  pages = {e66598},
  doi = {10.2196/66598}
}
Kostenlos starten →