EUVIMEDEUVIMED entdecken
Crossref

Does the Agent Follow the Evidence? Counterfactual Auditing for Trustworthy Multimodal Health Agents

Shadman Sakib, Nirmalya Roy

Proceedings of the AAAI Symposium Series · 06.11.2026 · 10 (1) · 1114-1123

DOI: 10.1609/aaaiss.v10i1.43534 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Symposium Series, online erschienen am 06.11.2026. Verfasst von Shadman Sakib und 1 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A multimodal health agent can produce the correct answer for the wrong evidentiary reasons. Accuracy and calibration alone therefore cannot establish whether a decision actually follows the evidence that should support it. We address this gap with provenance-conditioned counterfactual evidence auditing, which links claims to their supporting evidence and tests whether controlled interventions induce the expected Preserve, Revise, or Defer behavior. We integrate this audit into a verify-before-commit mechanism that blocks automatic decisions when provenance, evidence sufficiency, cross-modal consistency, or counterfactual behavior is invalid. We further introduce PhysioAgent-Bench, a controlled stress-test suite spanning cross-modal conflict, tool-output injection, and memory poisoning. Across three contactless respiratory-rate datasets and multiple multimodal backbones, the proposed framework improves behavioral fidelity, provenance attribution, and robustness. It reduces average attack success rate to 9.1%, compared with 20.3% for the strongest perturbation-based baseline, while reaching 92.1% transition fidelity on cases whose original predictions are already correct. These results demonstrate that answer correctness and evidence faithfulness are distinct properties, and that trustworthy multimodal agents should be evaluated not only by what they predict, but by whether their decisions respond appropriately when supporting evidence changes.

Zitieren

APA

Sakib, S., & Roy, N. (2026). Does the Agent Follow the Evidence? Counterfactual Auditing for Trustworthy Multimodal Health Agents. Proceedings of the AAAI Symposium Series, 10(1), 1114-1123. https://doi.org/10.1609/aaaiss.v10i1.43534

Vancouver

Sakib S, Roy N. Does the Agent Follow the Evidence? Counterfactual Auditing for Trustworthy Multimodal Health Agents. Proceedings of the AAAI Symposium Series. 2026;10(1):1114-1123. doi:10.1609/aaaiss.v10i1.43534

BibTeX
@article{Sakib2026,
  author = {Sakib, Shadman and Roy, Nirmalya},
  title = {Does the Agent Follow the Evidence? Counterfactual Auditing for Trustworthy Multimodal Health Agents},
  journal = {Proceedings of the AAAI Symposium Series},
  year = {2026},
  volume = {10},
  number = {1},
  pages = {1114--1123},
  doi = {10.1609/aaaiss.v10i1.43534}
}
Kostenlos starten →