EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

QALD-10 – The 10th challenge on question answering over linked data

Ricardo Usbeck, Xi Yan, Aleksandr Perevalov, Longquan Jiang, Julius Schulz, Angelie Kraft, Cedric Möller, Junbo Huang, Jan Reineke, Axel-Cyrille Ngonga Ngomo, Muhammad Saleem, Andreas Both

Semantic Web · 28.11.2023 · 1-15

DOI: 10.3233/sw-233471 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Semantic Web, erschienen am 28.11.2023. Verfasst von Ricardo Usbeck und 11 weiteren Autor:innen. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Knowledge Graph Question Answering (KGQA) has gained attention from both industry and academia over the past decade. Researchers proposed a substantial amount of benchmarking datasets with different properties, pushing the development in this field forward. Many of these benchmarks depend on Freebase, DBpedia, or Wikidata. However, KGQA benchmarks that depend on Freebase and DBpedia are gradually less studied and used, because Freebase is defunct and DBpedia lacks the structural validity of Wikidata. Therefore, research is gravitating toward Wikidata-based benchmarks. That is, new KGQA benchmarks are created on the basis of Wikidata and existing ones are migrated. We present a new, multilingual, complex KGQA benchmarking dataset as the 10th part of the Question Answering over Linked Data (QALD) benchmark series. This corpus formerly depended on DBpedia. Since QALD serves as a base for many machine-generated benchmarks, we increased the size and adjusted the benchmark to Wikidata and its ranking mechanism of properties. These measures foster novel KGQA developments by more demanding benchmarks. Creating a benchmark from scratch or migrating it from DBpedia to Wikidata is non-trivial due to the complexity of the Wikidata knowledge graph, mapping issues between different languages, and the ranking mechanism of properties using qualifiers. We present our creation strategy and the challenges we faced that will assist other researchers in their future work. Our case study, in the form of a conference challenge, is accompanied by an in-depth analysis of the created benchmark.

Zitieren

APA

Usbeck, R., Yan, X., Perevalov, A., Jiang, L., Schulz, J., Kraft, A., Möller, C., Huang, J., Reineke, J., Ngomo, A. N., Saleem, M., & Both, A. (2023). QALD-10 – The 10th challenge on question answering over linked data. Semantic Web, 1-15. https://doi.org/10.3233/sw-233471

Vancouver

Usbeck R, Yan X, Perevalov A, Jiang L, Schulz J, Kraft A, et al. QALD-10 – The 10th challenge on question answering over linked data. Semantic Web. 2023:1-15. doi:10.3233/sw-233471

BibTeX
@article{Usbeck2023,
  author = {Usbeck, Ricardo and Yan, Xi and Perevalov, Aleksandr and Jiang, Longquan and Schulz, Julius and Kraft, Angelie and Möller, Cedric and Huang, Junbo and Reineke, Jan and Ngomo, Axel-Cyrille Ngonga and Saleem, Muhammad and Both, Andreas},
  title = {QALD-10 – The 10th challenge on question answering over linked data},
  journal = {Semantic Web},
  year = {2023},
  pages = {1--15},
  doi = {10.3233/sw-233471}
}
Kostenlos starten →