FinTruthQA: A Benchmark for AI-Driven Financial Disclosure Quality Assessment in Investor–Firm Interactions
Proceedings of the AAAI Symposium Series · 23.06.2026 · 9 (1) · 204-212
DOI: 10.1609/aaaiss.v9i1.42926 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Symposium Series, online erschienen am 23.06.2026. Verfasst von Peilin Zhou und 9 weiteren Autor:innen.
Abstract (Originalsprache)
Accurate and transparent financial information disclosure is essential for market efficiency, investor decision-making, and corporate governance. Chinese stock exchanges’ investor interactive platforms provide a widely used channel through which listed firms respond to investor concerns, yet these responses are often limited or non-substantive, making disclosure quality difficult to assess at scale. To address this challenge, we introduce FinTruthQA, to our knowledge the first benchmark for AI-driven assessment of financial disclosure quality in investor–firm interactions. FinTruthQA comprises 6,000 real-world financial Q&A entries, each manually annotated based on four key evaluation criteria: question identification, question relevance, answer readability, and answer relevance. We benchmark statistical machine learning models, pre-trained language models and their fine-tuned variants, as well as large language models (LLMs), on FinTruthQA. Experiments show that existing models achieve strong performance on question identification and question relevance (F1>95%), but remain substantially weaker on answer readability (Micro F1∼88%) and especially answer relevance (Micro F1∼80%), highlighting the nontrivial difficulty of fine-grained disclosure quality assessment. Domainand task-adapted pre-trained language models consistently outperform general-purpose models and LLM-based prompting on the most challenging settings. These findings position FinTruthQA as a practical foundation for AI-driven disclosure monitoring in capital markets, with value for regulatory oversight, investor protection, and disclosure governance in real-world financial settings.
Zitieren
APA
Zhou, P., Xu, Z., Shi, X., Wu, J., Jiang, Y., Chong, D., Dong, W., Chen, J., Ke, B., & Yang, J. (2026). FinTruthQA: A Benchmark for AI-Driven Financial Disclosure Quality Assessment in Investor–Firm Interactions. Proceedings of the AAAI Symposium Series, 9(1), 204-212. https://doi.org/10.1609/aaaiss.v9i1.42926
Vancouver
Zhou P, Xu Z, Shi X, Wu J, Jiang Y, Chong D, et al. FinTruthQA: A Benchmark for AI-Driven Financial Disclosure Quality Assessment in Investor–Firm Interactions. Proceedings of the AAAI Symposium Series. 2026;9(1):204-212. doi:10.1609/aaaiss.v9i1.42926
BibTeX
@article{Zhou2026,
author = {Zhou, Peilin and Xu, Ziyue and Shi, Xinyu and Wu, Jiageng and Jiang, Yikang and Chong, Dading and Dong, Wang and Chen, Jun and Ke, Bin and Yang, Jie},
title = {FinTruthQA: A Benchmark for AI-Driven Financial Disclosure Quality Assessment in Investor–Firm Interactions},
journal = {Proceedings of the AAAI Symposium Series},
year = {2026},
volume = {9},
number = {1},
pages = {204--212},
doi = {10.1609/aaaiss.v9i1.42926}
}
EUVIMED