Cross-modal bias in medical vision-language models: a pipeline-aware framework for mechanisms, evaluation, and mitigation
Frontiers in Digital Health · 07.08.2026 · 8
DOI: 10.3389/fdgth.2026.1904053 ↗Kurz gefasst
Übersichtsarbeit in der Zeitschrift Frontiers in Digital Health, online erschienen am 07.08.2026. Verfasst von Rafid Mehda und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Information and Communication Technology, Bangladesh University of Professionals, Dhaka, Bangladesh. Die Arbeit nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Medical vision-language models encode images and clinical text in a shared representation. Across radiology and ophthalmology, their diagnostic performance now approaches that of specialist clinicians. The mechanism behind that performance is also the source of a problem that has gone largely unexamined. These models are trained by contrastive alignment, so bias from the image encoder and bias from the text encoder meet at a single point: the alignment interface. There they can interact and compound in ways that single-modality systems never experience. Fairness research has so far studied the two modalities separately, and medical vision-language models have fallen into the gap between those literatures. We organize the evidence into a three-tier taxonomy keyed to the pretraining pipeline. Tier 1 is data-level bias in the pretraining corpus. Tier 2 is alignment bias produced at the contrastive interface. Tier 3 is inference-time bias that surfaces during deployment. Within this structure, we compare the major evaluation benchmarks, show where they disagree, and assign each mitigation strategy to the tier it actually addresses. Three points emerge. First, no published method spans all three tiers; mitigation is fragmented by pipeline stage. Second, fine-tuning does not remove alignment-stage bias, even in parameter-efficient form, which shifts the burden of debiasing onto pretraining rather than adaptation. Third, the inference-time failures are more dangerous than the literature suggests. Medical-specialist models will abandon a correct reading and defer to a confident user on most trials, and specialization appears to make this worse, not better. We close with a research agenda.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Information and Communication Technology, Bangladesh University of Professionals, Dhaka, Bangladesh.
- California Lutheran University, Thousand Oaks, CA, United States.
- ELITE Research Lab, Dhaka, Bangladesh.
- Centre for Intelligent Cloud Computing (CICC), Centre of Excellence (COE) of Advanced Cloud, Faculty of Information Science & Technology, Multimedia University, Melaka, Malaysia.
Zitieren
APA
Mehda, R., Oishi, R. A., Alam, T. T., Morol, M. K., & Hui, L. T. (2026). Cross-modal bias in medical vision-language models: a pipeline-aware framework for mechanisms, evaluation, and mitigation. Frontiers in Digital Health, 8. https://doi.org/10.3389/fdgth.2026.1904053
Vancouver
Mehda R, Oishi RA, Alam TT, Morol MK, Hui LT. Cross-modal bias in medical vision-language models: a pipeline-aware framework for mechanisms, evaluation, and mitigation. Frontiers in Digital Health. 2026;8. doi:10.3389/fdgth.2026.1904053
BibTeX
@article{Mehda2026,
author = {Mehda, Rafid and Oishi, Ramisa Anjum and Alam, Tamzid Tanvi and Morol, Md Kishor and Hui, Liew Tze},
title = {Cross-modal bias in medical vision-language models: a pipeline-aware framework for mechanisms, evaluation, and mitigation},
journal = {Frontiers in Digital Health},
year = {2026},
volume = {8},
doi = {10.3389/fdgth.2026.1904053}
}
EUVIMED