EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access · CC BY 4.0

Cross-modal bias in medical vision-language models: a pipeline-aware framework for mechanisms, evaluation, and mitigation

Rafid Mehda, Ramisa Anjum Oishi, Tamzid Tanvi Alam, Md Kishor Morol, Liew Tze Hui

Frontiers in Digital Health · 07.08.2026 · 8

DOI: 10.3389/fdgth.2026.1904053 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Frontiers in Digital Health, online erschienen am 07.08.2026. Verfasst von Rafid Mehda und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Information and Communication Technology, Bangladesh University of Professionals, Dhaka, Bangladesh. Die Arbeit nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Medical vision-language models encode images and clinical text in a shared representation. Across radiology and ophthalmology, their diagnostic performance now approaches that of specialist clinicians. The mechanism behind that performance is also the source of a problem that has gone largely unexamined. These models are trained by contrastive alignment, so bias from the image encoder and bias from the text encoder meet at a single point: the alignment interface. There they can interact and compound in ways that single-modality systems never experience. Fairness research has so far studied the two modalities separately, and medical vision-language models have fallen into the gap between those literatures. We organize the evidence into a three-tier taxonomy keyed to the pretraining pipeline. Tier 1 is data-level bias in the pretraining corpus. Tier 2 is alignment bias produced at the contrastive interface. Tier 3 is inference-time bias that surfaces during deployment. Within this structure, we compare the major evaluation benchmarks, show where they disagree, and assign each mitigation strategy to the tier it actually addresses. Three points emerge. First, no published method spans all three tiers; mitigation is fragmented by pipeline stage. Second, fine-tuning does not remove alignment-stage bias, even in parameter-efficient form, which shifts the burden of debiasing onto pretraining rather than adaptation. Third, the inference-time failures are more dangerous than the literature suggests. Medical-specialist models will abandon a correct reading and defer to a confident user on most trials, and specialization appears to make this worse, not better. We close with a research agenda.

Schlagwörter

Stichwörter der Autor:innen

algorithmic biascontrastive learningcross-modal alignmentfairnesshealthcare disparitiesmedical vision-language modelssycophancytrustworthy AI

Autor:innen und Institutionen

  • Department of Information and Communication Technology, Bangladesh University of Professionals, Dhaka, Bangladesh.
  • California Lutheran University, Thousand Oaks, CA, United States.
  • ELITE Research Lab, Dhaka, Bangladesh.
  • Centre for Intelligent Cloud Computing (CICC), Centre of Excellence (COE) of Advanced Cloud, Faculty of Information Science & Technology, Multimedia University, Melaka, Malaysia.

Zitieren

APA

Mehda, R., Oishi, R. A., Alam, T. T., Morol, M. K., & Hui, L. T. (2026). Cross-modal bias in medical vision-language models: a pipeline-aware framework for mechanisms, evaluation, and mitigation. Frontiers in Digital Health, 8. https://doi.org/10.3389/fdgth.2026.1904053

Vancouver

Mehda R, Oishi RA, Alam TT, Morol MK, Hui LT. Cross-modal bias in medical vision-language models: a pipeline-aware framework for mechanisms, evaluation, and mitigation. Frontiers in Digital Health. 2026;8. doi:10.3389/fdgth.2026.1904053

BibTeX
@article{Mehda2026,
  author = {Mehda, Rafid and Oishi, Ramisa Anjum and Alam, Tamzid Tanvi and Morol, Md Kishor and Hui, Liew Tze},
  title = {Cross-modal bias in medical vision-language models: a pipeline-aware framework for mechanisms, evaluation, and mitigation},
  journal = {Frontiers in Digital Health},
  year = {2026},
  volume = {8},
  doi = {10.3389/fdgth.2026.1904053}
}
Kostenlos starten →