Does the Agent Follow the Evidence? Counterfactual Auditing for Trustworthy Multimodal Health Agents
Proceedings of the AAAI Symposium Series · 06.11.2026 · 10 (1) · 1114-1123
DOI: 10.1609/aaaiss.v10i1.43534 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Symposium Series, online erschienen am 06.11.2026. Verfasst von Shadman Sakib und 1 weiteren Autor:innen.
Abstract (Originalsprache)
A multimodal health agent can produce the correct answer for the wrong evidentiary reasons. Accuracy and calibration alone therefore cannot establish whether a decision actually follows the evidence that should support it. We address this gap with provenance-conditioned counterfactual evidence auditing, which links claims to their supporting evidence and tests whether controlled interventions induce the expected Preserve, Revise, or Defer behavior. We integrate this audit into a verify-before-commit mechanism that blocks automatic decisions when provenance, evidence sufficiency, cross-modal consistency, or counterfactual behavior is invalid. We further introduce PhysioAgent-Bench, a controlled stress-test suite spanning cross-modal conflict, tool-output injection, and memory poisoning. Across three contactless respiratory-rate datasets and multiple multimodal backbones, the proposed framework improves behavioral fidelity, provenance attribution, and robustness. It reduces average attack success rate to 9.1%, compared with 20.3% for the strongest perturbation-based baseline, while reaching 92.1% transition fidelity on cases whose original predictions are already correct. These results demonstrate that answer correctness and evidence faithfulness are distinct properties, and that trustworthy multimodal agents should be evaluated not only by what they predict, but by whether their decisions respond appropriately when supporting evidence changes.
Zitieren
APA
Sakib, S., & Roy, N. (2026). Does the Agent Follow the Evidence? Counterfactual Auditing for Trustworthy Multimodal Health Agents. Proceedings of the AAAI Symposium Series, 10(1), 1114-1123. https://doi.org/10.1609/aaaiss.v10i1.43534
Vancouver
Sakib S, Roy N. Does the Agent Follow the Evidence? Counterfactual Auditing for Trustworthy Multimodal Health Agents. Proceedings of the AAAI Symposium Series. 2026;10(1):1114-1123. doi:10.1609/aaaiss.v10i1.43534
BibTeX
@article{Sakib2026,
author = {Sakib, Shadman and Roy, Nirmalya},
title = {Does the Agent Follow the Evidence? Counterfactual Auditing for Trustworthy Multimodal Health Agents},
journal = {Proceedings of the AAAI Symposium Series},
year = {2026},
volume = {10},
number = {1},
pages = {1114--1123},
doi = {10.1609/aaaiss.v10i1.43534}
}
EUVIMED