EUVIMEDEUVIMED entdecken
Crossref

FinTruthQA: A Benchmark for AI-Driven Financial Disclosure Quality Assessment in Investor–Firm Interactions

Peilin Zhou, Ziyue Xu, Xinyu Shi, Jiageng Wu, Yikang Jiang, Dading Chong, Wang Dong, Jun Chen, Bin Ke, Jie Yang

Proceedings of the AAAI Symposium Series · 23.06.2026 · 9 (1) · 204-212

DOI: 10.1609/aaaiss.v9i1.42926 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Symposium Series, online erschienen am 23.06.2026. Verfasst von Peilin Zhou und 9 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurate and transparent financial information disclosure is essential for market efficiency, investor decision-making, and corporate governance. Chinese stock exchanges’ investor interactive platforms provide a widely used channel through which listed firms respond to investor concerns, yet these responses are often limited or non-substantive, making disclosure quality difficult to assess at scale. To address this challenge, we introduce FinTruthQA, to our knowledge the first benchmark for AI-driven assessment of financial disclosure quality in investor–firm interactions. FinTruthQA comprises 6,000 real-world financial Q&A entries, each manually annotated based on four key evaluation criteria: question identification, question relevance, answer readability, and answer relevance. We benchmark statistical machine learning models, pre-trained language models and their fine-tuned variants, as well as large language models (LLMs), on FinTruthQA. Experiments show that existing models achieve strong performance on question identification and question relevance (F1>95%), but remain substantially weaker on answer readability (Micro F1∼88%) and especially answer relevance (Micro F1∼80%), highlighting the nontrivial difficulty of fine-grained disclosure quality assessment. Domainand task-adapted pre-trained language models consistently outperform general-purpose models and LLM-based prompting on the most challenging settings. These findings position FinTruthQA as a practical foundation for AI-driven disclosure monitoring in capital markets, with value for regulatory oversight, investor protection, and disclosure governance in real-world financial settings.

Zitieren

APA

Zhou, P., Xu, Z., Shi, X., Wu, J., Jiang, Y., Chong, D., Dong, W., Chen, J., Ke, B., & Yang, J. (2026). FinTruthQA: A Benchmark for AI-Driven Financial Disclosure Quality Assessment in Investor–Firm Interactions. Proceedings of the AAAI Symposium Series, 9(1), 204-212. https://doi.org/10.1609/aaaiss.v9i1.42926

Vancouver

Zhou P, Xu Z, Shi X, Wu J, Jiang Y, Chong D, et al. FinTruthQA: A Benchmark for AI-Driven Financial Disclosure Quality Assessment in Investor–Firm Interactions. Proceedings of the AAAI Symposium Series. 2026;9(1):204-212. doi:10.1609/aaaiss.v9i1.42926

BibTeX
@article{Zhou2026,
  author = {Zhou, Peilin and Xu, Ziyue and Shi, Xinyu and Wu, Jiageng and Jiang, Yikang and Chong, Dading and Dong, Wang and Chen, Jun and Ke, Bin and Yang, Jie},
  title = {FinTruthQA: A Benchmark for AI-Driven Financial Disclosure Quality Assessment in Investor–Firm Interactions},
  journal = {Proceedings of the AAAI Symposium Series},
  year = {2026},
  volume = {9},
  number = {1},
  pages = {204--212},
  doi = {10.1609/aaaiss.v9i1.42926}
}
Kostenlos starten →