EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

Risk-Calibrated Patient-Facing AI Safety Cards: A UI/UX Benchmark for Explainable Medical AI Response Interfaces

Chenyu Li, Binghua Zhou, Krystal Gao

International Journal of Graphic Design · 22.10.2025 · 3 (2) · 381-394

DOI: 10.51903/ijgd.v3i2.3709 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Graphic Design, online erschienen am 22.10.2025. Verfasst von Chenyu Li und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Patient-facing medical AI systems communicate risk at moments when a non-expert user may act on what they read. This study evaluates risk-calibrated AI safety cards as a UI/UX framework for explainable medical response interfaces. The main experiment used 466 PatientSafetyBench prompts across five patient-safety categories: harmful medical advice, misdiagnosis and overconfidence, unlicensed practice of medicine, health misinformation, and bias or stigmatization. For each prompt, five response interfaces were generated: plain text, risk-label card, refusal-plus-explanation card, evidence-disclosure card, and next-step action card. The evaluation reports deterministic rubric-based communication scores rather than clinical safety outcomes. Across 2,330 PatientSafetyBench responses, the integrated Next-Step Action Card lowered the mean communication-risk score from 3.85 to 1.00 on a 1-5 scale, lowered the overconfidence-indicator score from 3.38 to 1.41, increased actionability from 16.46 to 98.09 on a 0-100 scale, increased risk-label clarity from 10.20 to 94.97, and increased evidence disclosure from 22.82 to 96.98. A second analysis used HealthBench physician-created rubric criteria to test whether the card structure aligned with communication, context, uncertainty, and escalation expectations in broader health conversations. The action-card condition increased communication-rubric coverage from 11.23% to 85.29% in HealthBench OSS, from 10.44% to 83.86% in HealthBench Consensus, and from 9.88% to 86.50% in HealthBench Hard. These results support the safety card as a reproducible information-design intervention for risk communication. They do not establish real-world patient behavior change or clinical safety; clinician review, patient testing, multilingual adaptation, and live-system evaluation remain necessary before deployment.

Zitieren

APA

Li, C., Zhou, B., & Gao, K. (2025). Risk-Calibrated Patient-Facing AI Safety Cards: A UI/UX Benchmark for Explainable Medical AI Response Interfaces. International Journal of Graphic Design, 3(2), 381-394. https://doi.org/10.51903/ijgd.v3i2.3709

Vancouver

Li C, Zhou B, Gao K. Risk-Calibrated Patient-Facing AI Safety Cards: A UI/UX Benchmark for Explainable Medical AI Response Interfaces. International Journal of Graphic Design. 2025;3(2):381-394. doi:10.51903/ijgd.v3i2.3709

BibTeX
@article{Li2025,
  author = {Li, Chenyu and Zhou, Binghua and Gao, Krystal},
  title = {Risk-Calibrated Patient-Facing AI Safety Cards: A UI/UX Benchmark for Explainable Medical AI Response Interfaces},
  journal = {International Journal of Graphic Design},
  year = {2025},
  volume = {3},
  number = {2},
  pages = {381--394},
  doi = {10.51903/ijgd.v3i2.3709}
}
Kostenlos starten →