EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

TRACE-QA: Task-routed constraint elimination for auditable multi-agent question answering

Jiaxin Lu, Hao Chen, Yangyan Zhu, Jiachen Xu, Ang Xu

Journal of King Saud University Computer and Information Sciences · 2026-09 · 38 (7)

DOI: 10.1007/s44443-026-01141-3 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of King Saud University Computer and Information Sciences, online erschienen am 20.08.2026. Verfasst von Jiaxin Lu und 4 weiteren Autor:innen. Die Arbeit nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Nantong Institute of Technology Scientific Research Project, Nantong Municipal Social Development and Livelihood Science and Technology Program Project, Higher Education Teaching Reform Research Project of Nantong Institute of Technology.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models (LLMs) remain vulnerable to answer anchoring, overconfidence, and fluent but unsupported justifications in binary and multiple-choice question answering. Recent answer-first debate frameworks force agents to inspect alternative stances, but they still spend substantial budget defending likely wrong answers and let a final judge consume long free-form interaction traces. We propose TRACE-QA, a training-free multi-agent protocol that routes each instance to a sparse set of reasoning operators, constructs option-blind necessity constraints, audits every candidate in a structured elimination ledger, revisits risky eliminations through global risk-aware rescue, and aggregates role-specialized judge votes. Under a unified three-seed protocol on HoVer, BoolQ, CosmosQA, and CommonsenseQA, TRACE-QA attains an average of 0.7731, exceeding the strongest common-protocol baseline (CFMAD) by 1.94 percentage points and improving on all five evaluation columns. Risk-aware rescue lowers the false-elimination rate from 5.2% without rescue to 1.4% and recovers 73.1% of recoverable false eliminations. We further evaluate structured graph reasoning on GraphSQA and a discrete in-toolset subset of Graph4real: TRACE-QA improves over text-only baselines, and with deterministic graph tools reaches 95.1%–97.8% accuracy across Graph4real scales. Full TRACE-QA remains substantially more expensive than chain-of-thought, but uses 19.7% fewer total tokens than CFMAD, and an adaptive variant saves 29.5% of its tokens at a 0.67-point accuracy cost. These results support constraint-guided elimination as an auditable alternative to answer-first debate, while exposing residual dependence on routing quality, ledger reliability, and backbone capability.

Förderung

  • Nantong Institute of Technology Scientific Research Project
  • Nantong Municipal Social Development and Livelihood Science and Technology Program Project
  • Higher Education Teaching Reform Research Project of Nantong Institute of Technology

Zitieren

APA

Lu, J., Chen, H., Zhu, Y., Xu, J., & Xu, A. (2026). TRACE-QA: Task-routed constraint elimination for auditable multi-agent question answering. Journal of King Saud University Computer and Information Sciences, 38(7). https://doi.org/10.1007/s44443-026-01141-3

Vancouver

Lu J, Chen H, Zhu Y, Xu J, Xu A. TRACE-QA: Task-routed constraint elimination for auditable multi-agent question answering. Journal of King Saud University Computer and Information Sciences. 2026;38(7). doi:10.1007/s44443-026-01141-3

BibTeX
@article{Lu2026,
  author = {Lu, Jiaxin and Chen, Hao and Zhu, Yangyan and Xu, Jiachen and Xu, Ang},
  title = {TRACE-QA: Task-routed constraint elimination for auditable multi-agent question answering},
  journal = {Journal of King Saud University Computer and Information Sciences},
  year = {2026},
  volume = {38},
  number = {7},
  doi = {10.1007/s44443-026-01141-3}
}
Kostenlos starten →