Severity Matters: Risk-Calibrated Reinforcement Fine-Tuning for Clinically Aligned Medical Vision–Language Models
IEEE Access · 2026 · 14 · 115480-115505
DOI: 10.1109/access.2026.3716267 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Yu Su und 1 weiteren Autor:innen. Die Arbeit nennt 75 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Jilin Province Science and Technology Innovation Platform Construction Project.
Abstract (Originalsprache)
In clinical vision-language model (VLM) post-training, the relevant failure mode is not only how often a model is wrong, but whether errors concentrate in cases where missed findings carry greater clinical cost. Risk-Calibrated Reinforcement Fine-Tuning (RCRFT) addresses this mismatch by making severity an explicit signal in reinforcement learning rather than an after-the-fact evaluation stratum. The framework combines a severity-weighted multimodal reward, slot-aware post-rollout edits that respect clinical report structure, and a unified clinical utility spanning report quality, grounding fidelity, calibration, and safety penalties. A formal analysis decomposes the risk-weighted objective into mean utility, a global severity-scaling term, and a severity–reward covariance term; under severity centering only the mean and the covariance remain, indicating that the method favors positive association between utility and case severity rather than simple reward amplification. On MIMIC-CXR, this shift in optimization improves the safety-critical region first: relative to a matched RL baseline, severe-case false negatives fall from 9.8% to 5.6%, and high-risk utility rises from 0.65 to 0.74. The same training signal also lifts general report quality, raising ROUGE-L from 29.9 to 30.8 and RadGraph F1 from 25.8 to 27.3 while lowering RadCliQ from 0.86 to 0.72. Ablations show that each component contributes, with severity weighting accounting for the largest share of the improvement.
Förderung
- Jilin Province Science and Technology Innovation Platform Construction Project
Zitieren
APA
Su, Y., & Wang, P. (2026). Severity Matters: Risk-Calibrated Reinforcement Fine-Tuning for Clinically Aligned Medical Vision–Language Models. IEEE Access, 14, 115480-115505. https://doi.org/10.1109/access.2026.3716267
Vancouver
Su Y, Wang P. Severity Matters: Risk-Calibrated Reinforcement Fine-Tuning for Clinically Aligned Medical Vision–Language Models. IEEE Access. 2026;14:115480-115505. doi:10.1109/access.2026.3716267
BibTeX
@article{Su2026,
author = {Su, Yu and Wang, Peng},
title = {Severity Matters: Risk-Calibrated Reinforcement Fine-Tuning for Clinically Aligned Medical Vision–Language Models},
journal = {IEEE Access},
year = {2026},
volume = {14},
pages = {115480--115505},
doi = {10.1109/access.2026.3716267}
}
EUVIMED