LLMs4OL 2024 Datasets: Toward Ontology Learning with Large Language Models
Open Conference Proceedings · 02.10.2024 · 4 · 17-30
DOI: 10.52825/ocp.v4i.2480 ↗Kurz gefasst
Fachartikel in der Zeitschrift Open Conference Proceedings, online erschienen am 02.10.2024. Verfasst von Hamed Babaei Giglou und 3 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Deutsche Forschungsgemeinschaft, Bundesministerium für Bildung und Forschung.
Abstract (Originalsprache)
Ontology learning (OL) from unstructured data has evolved significantly, with recent advancements integrating large language models (LLMs) to enhance various aspects of the process. The paper introduces the LLMs4OL 2024 datasets, developed to benchmark and advance research in OL using LLMs. The LLMs4OL 2024 dataset as a key component of the LLMs4OL Challenge, targets three primary OL tasks: Term Typing, Taxonomy Discovery, and Non-Taxonomic Relation Extraction. It encompasses seven domains, i.e. lexosemantics and biological functions, offering a comprehensive resource for evaluating LLM-based OL approaches Each task within the dataset is carefully crafted to facilitate both Few-Shot (FS) and Zero-Shot (ZS) evaluation scenarios, allowing for robust assessment of model performance across different knowledge domains to address a critical gap in the field by offering standardized benchmarks for fair comparison for evaluating LLM applications in OL.
Förderung
- Deutsche Forschungsgemeinschaft
- Bundesministerium für Bildung und Forschung
Zitieren
APA
Giglou, H. B., D’Souza, J., Sadruddin, S., & Auer, S. (2024). LLMs4OL 2024 Datasets: Toward Ontology Learning with Large Language Models. Open Conference Proceedings, 4, 17-30. https://doi.org/10.52825/ocp.v4i.2480
Vancouver
Giglou HB, D’Souza J, Sadruddin S, Auer S. LLMs4OL 2024 Datasets: Toward Ontology Learning with Large Language Models. Open Conference Proceedings. 2024;4:17-30. doi:10.52825/ocp.v4i.2480
BibTeX
@article{Giglou2024,
author = {Giglou, Hamed Babaei and D’Souza, Jennifer and Sadruddin, Sameer and Auer, Sören},
title = {LLMs4OL 2024 Datasets: Toward Ontology Learning with Large Language Models},
journal = {Open Conference Proceedings},
year = {2024},
volume = {4},
pages = {17--30},
doi = {10.52825/ocp.v4i.2480}
}
EUVIMED