QALD-10 – The 10th challenge on question answering over linked data
Semantic Web · 28.11.2023 · 1-15
DOI: 10.3233/sw-233471 ↗Kurz gefasst
Fachartikel in der Zeitschrift Semantic Web, erschienen am 28.11.2023. Verfasst von Ricardo Usbeck und 11 weiteren Autor:innen. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Knowledge Graph Question Answering (KGQA) has gained attention from both industry and academia over the past decade. Researchers proposed a substantial amount of benchmarking datasets with different properties, pushing the development in this field forward. Many of these benchmarks depend on Freebase, DBpedia, or Wikidata. However, KGQA benchmarks that depend on Freebase and DBpedia are gradually less studied and used, because Freebase is defunct and DBpedia lacks the structural validity of Wikidata. Therefore, research is gravitating toward Wikidata-based benchmarks. That is, new KGQA benchmarks are created on the basis of Wikidata and existing ones are migrated. We present a new, multilingual, complex KGQA benchmarking dataset as the 10th part of the Question Answering over Linked Data (QALD) benchmark series. This corpus formerly depended on DBpedia. Since QALD serves as a base for many machine-generated benchmarks, we increased the size and adjusted the benchmark to Wikidata and its ranking mechanism of properties. These measures foster novel KGQA developments by more demanding benchmarks. Creating a benchmark from scratch or migrating it from DBpedia to Wikidata is non-trivial due to the complexity of the Wikidata knowledge graph, mapping issues between different languages, and the ranking mechanism of properties using qualifiers. We present our creation strategy and the challenges we faced that will assist other researchers in their future work. Our case study, in the form of a conference challenge, is accompanied by an in-depth analysis of the created benchmark.
Zitieren
APA
Usbeck, R., Yan, X., Perevalov, A., Jiang, L., Schulz, J., Kraft, A., Möller, C., Huang, J., Reineke, J., Ngomo, A. N., Saleem, M., & Both, A. (2023). QALD-10 – The 10th challenge on question answering over linked data. Semantic Web, 1-15. https://doi.org/10.3233/sw-233471
Vancouver
Usbeck R, Yan X, Perevalov A, Jiang L, Schulz J, Kraft A, et al. QALD-10 – The 10th challenge on question answering over linked data. Semantic Web. 2023:1-15. doi:10.3233/sw-233471
BibTeX
@article{Usbeck2023,
author = {Usbeck, Ricardo and Yan, Xi and Perevalov, Aleksandr and Jiang, Longquan and Schulz, Julius and Kraft, Angelie and Möller, Cedric and Huang, Junbo and Reineke, Jan and Ngomo, Axel-Cyrille Ngonga and Saleem, Muhammad and Both, Andreas},
title = {QALD-10 – The 10th challenge on question answering over linked data},
journal = {Semantic Web},
year = {2023},
pages = {1--15},
doi = {10.3233/sw-233471}
}
EUVIMED