EUVIMEDEUVIMED entdecken
Crossref

CCFQA: A Benchmark for Cross-Lingual and Cross-Modal Speech and Text Factuality Evaluation

Yexing Du, Kaiyuan Liu, Youcheng Pan, Zheng Chu, Bo Yang, Xiaocheng Feng, Ming Liu, Yang Xiang

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (36) · 30575-30583

DOI: 10.1609/aaai.v40i36.40312 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Yexing Du und 7 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As Large Language Models (LLMs) are increasingly popularized in the multilingual world, ensuring hallucination-free factuality becomes markedly crucial. However, existing benchmarks for evaluating the reliability of Multimodal Large Language Models (MLLMs) predominantly focus on textual or visual modalities with a primary emphasis on English, which creates a gap in evaluation when processing multilingual input, especially in speech. To bridge this gap, we propose a novel Cross-lingual and Cross-modal Factuality benchmark (CCFQA). Specifically, the CCFQA benchmark contains parallel speech-text factual questions across 8 languages, designed to systematically evaluate MLLMs' cross-lingual and cross-modal factuality capabilities. Our experimental results demonstrate that current MLLMs still face substantial challenges on the CCFQA benchmark. Furthermore, we propose a few-shot transfer learning strategy that effectively transfers the Question Answering (QA) capabilities of LLMs in English to multilingual Spoken Question Answering (SQA) tasks, achieving competitive performance with GPT-4o-mini-Audio using just 5-shot training. We release CCFQA as a foundational research resource to promote the development of MLLMs with more robust and reliable speech understanding capabilities.

Zitieren

APA

Du, Y., Liu, K., Pan, Y., Chu, Z., Yang, B., Feng, X., Liu, M., & Xiang, Y. (2026). CCFQA: A Benchmark for Cross-Lingual and Cross-Modal Speech and Text Factuality Evaluation. Proceedings of the AAAI Conference on Artificial Intelligence, 40(36), 30575-30583. https://doi.org/10.1609/aaai.v40i36.40312

Vancouver

Du Y, Liu K, Pan Y, Chu Z, Yang B, Feng X, et al. CCFQA: A Benchmark for Cross-Lingual and Cross-Modal Speech and Text Factuality Evaluation. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(36):30575-30583. doi:10.1609/aaai.v40i36.40312

BibTeX
@article{Du2026,
  author = {Du, Yexing and Liu, Kaiyuan and Pan, Youcheng and Chu, Zheng and Yang, Bo and Feng, Xiaocheng and Liu, Ming and Xiang, Yang},
  title = {CCFQA: A Benchmark for Cross-Lingual and Cross-Modal Speech and Text Factuality Evaluation},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {36},
  pages = {30575--30583},
  doi = {10.1609/aaai.v40i36.40312}
}
Kostenlos starten →