EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Emerging algorithmic bias: fairness drift as the next dimension of model maintenance and sustainability

Sharon E Davis iD, Chad Dorn, Daniel J Park, Michael E Matheny

Journal of the American Medical Informatics Association · 01.05.2025 · 32 (5) · 845-854

DOI: 10.1093/jamia/ocaf039 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of the American Medical Informatics Association, online erschienen am 13.03.2025. Verfasst von Sharon E Davis und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN 37203, United States. Hauptthemen laut MEDLINE: Algorithms, Models, Statistical. Die Arbeit wurde bisher 52-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NICHD NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objectives

While performance drift of clinical prediction models is well-documented, the potential for algorithmic biases to emerge post-deployment has had limited characterization. A better understanding of how temporal model performance may shift across subpopulations is required to incorporate fairness drift into model maintenance strategies. Materials and Methods We explore fairness drift in a national population over 11 years, with and without model maintenance aimed at sustaining population-level performance. We trained random forest models predicting 30-day post-surgical readmission, mortality, and pneumonia using 2013 data from US Department of Veterans Affairs facilities. We evaluated performance quarterly from 2014 to 2023 by self-reported race and sex. We estimated discrimination, calibration, and accuracy, and operationalized fairness using metric parity measured as the gap between disadvantaged and advantaged groups.

Results

Our cohort included 1 739 666 surgical cases. We observed fairness drift in both the original and temporally updated models. Model updating had a larger impact on overall performance than fairness gaps. During periods of stable fairness, updating models at the population level increased, decreased, or did not impact fairness gaps. During periods of fairness drift, updating models restored fairness in some cases and exacerbated fairness gaps in others.

Discussion

This exploratory study highlights that algorithmic fairness cannot be assured through one-time assessments during model development. Temporal changes in fairness may take multiple forms and interact with model updating strategies in unanticipated ways.

Conclusion

Equitable and sustainable clinical artificial intelligence deployments will require novel methods to monitor algorithmic fairness, detect emerging bias, and adopt model updates that promote fairness.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

AlgorithmsModels, StatisticalHumansUnited StatesFemaleMaleBiasMiddle AgedPatient ReadmissionAged

Stichwörter der Autor:innen

algorithmic fairnessdataset shiftmodel updatingperformance driftpredictive analytics

Autor:innen und Institutionen

  • Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN 37203, United States.
  • Department of Medicine, Vanderbilt University Medical Center, Nashville, TN 37232, United States.
  • Department of Biostatistics, Vanderbilt University Medical Center, Nashville, TN 37203, United States.
  • Tennessee Valley Healthcare System VA Medical Center, Veterans Health Administration, Nashville, TN 37212, United States.

ORCID-Profile: Sharon E Davis

Förderung

  • NICHD NIH HHS

Zitieren

APA

Davis, S. E., Dorn, C., Park, D. J., & Matheny, M. E. (2025). Emerging algorithmic bias: fairness drift as the next dimension of model maintenance and sustainability. Journal of the American Medical Informatics Association, 32(5), 845-854. https://doi.org/10.1093/jamia/ocaf039

Vancouver

Davis SE, Dorn C, Park DJ, Matheny ME. Emerging algorithmic bias: fairness drift as the next dimension of model maintenance and sustainability. Journal of the American Medical Informatics Association. 2025;32(5):845-854. doi:10.1093/jamia/ocaf039

BibTeX
@article{Davis2025,
  author = {Davis, Sharon E and Dorn, Chad and Park, Daniel J and Matheny, Michael E},
  title = {Emerging algorithmic bias: fairness drift as the next dimension of model maintenance and sustainability},
  journal = {Journal of the American Medical Informatics Association},
  year = {2025},
  volume = {32},
  number = {5},
  pages = {845--854},
  doi = {10.1093/jamia/ocaf039}
}
Kostenlos starten →