EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

No Shortcuts to Culture: Indonesian Multi-hop Question Answering for Complex Cultural Understanding

Vynska Amalia Permadi, Xingwei Tan, Nafise Sadat Moosavi, Nikolaos Aletras

Transactions of the Association for Computational Linguistics · 01.07.2026 · 14 · 1243-1265

DOI: 10.1162/tacl.a.726 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Transactions of the Association for Computational Linguistics, online erschienen am 01.07.2026. Verfasst von Vynska Amalia Permadi und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Understanding culture requires reasoning across context, tradition, and implicit social knowledge, far beyond recalling isolated facts. Yet most culturally focused question answering (QA) benchmarks rely on singlehop questions, which may allow models to exploit shallow cues rather than demonstrate genuine cultural reasoning. In this work, we introduce ID-MoCQA, the first large-scale multi-hop QA dataset for assessing the cultural understanding of large language models (LLMs), grounded in Indonesian traditions and available in both English and Indonesian. We present a new framework that systematically transforms single-hop cultural questions into multi-hop reasoning chains spanning six clue types (e.g., commonsense, temporal, geographical). Our multi-stage validation pipeline, combining expert review and LLM-as-a-judge filtering, ensures high-quality question-answer pairs. Our evaluation across state-of-the-art models reveals substantial gaps in cultural reasoning, particularly in tasks requiring nuanced inference. ID-MoCQA provides a challenging and essential benchmark for advancing the cultural competency of LLMs.1

Zitieren

APA

Permadi, V. A., Tan, X., Moosavi, N. S., & Aletras, N. (2026). No Shortcuts to Culture: Indonesian Multi-hop Question Answering for Complex Cultural Understanding. Transactions of the Association for Computational Linguistics, 14, 1243-1265. https://doi.org/10.1162/tacl.a.726

Vancouver

Permadi VA, Tan X, Moosavi NS, Aletras N. No Shortcuts to Culture: Indonesian Multi-hop Question Answering for Complex Cultural Understanding. Transactions of the Association for Computational Linguistics. 2026;14:1243-1265. doi:10.1162/tacl.a.726

BibTeX
@article{Permadi2026,
  author = {Permadi, Vynska Amalia and Tan, Xingwei and Moosavi, Nafise Sadat and Aletras, Nikolaos},
  title = {No Shortcuts to Culture: Indonesian Multi-hop Question Answering for Complex Cultural Understanding},
  journal = {Transactions of the Association for Computational Linguistics},
  year = {2026},
  volume = {14},
  pages = {1243--1265},
  doi = {10.1162/tacl.a.726}
}
Kostenlos starten →