EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

LLMs4OL 2024 Datasets: Toward Ontology Learning with Large Language Models

Hamed Babaei Giglou, Jennifer D’Souza, Sameer Sadruddin, Sören Auer

Open Conference Proceedings · 02.10.2024 · 4 · 17-30

DOI: 10.52825/ocp.v4i.2480 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Open Conference Proceedings, online erschienen am 02.10.2024. Verfasst von Hamed Babaei Giglou und 3 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Deutsche Forschungsgemeinschaft, Bundesministerium für Bildung und Forschung.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Ontology learning (OL) from unstructured data has evolved significantly, with recent advancements integrating large language models (LLMs) to enhance various aspects of the process. The paper introduces the LLMs4OL 2024 datasets, developed to benchmark and advance research in OL using LLMs. The LLMs4OL 2024 dataset as a key component of the LLMs4OL Challenge, targets three primary OL tasks: Term Typing, Taxonomy Discovery, and Non-Taxonomic Relation Extraction. It encompasses seven domains, i.e. lexosemantics and biological functions, offering a comprehensive resource for evaluating LLM-based OL approaches Each task within the dataset is carefully crafted to facilitate both Few-Shot (FS) and Zero-Shot (ZS) evaluation scenarios, allowing for robust assessment of model performance across different knowledge domains to address a critical gap in the field by offering standardized benchmarks for fair comparison for evaluating LLM applications in OL.

Förderung

  • Deutsche Forschungsgemeinschaft
  • Bundesministerium für Bildung und Forschung

Zitieren

APA

Giglou, H. B., D’Souza, J., Sadruddin, S., & Auer, S. (2024). LLMs4OL 2024 Datasets: Toward Ontology Learning with Large Language Models. Open Conference Proceedings, 4, 17-30. https://doi.org/10.52825/ocp.v4i.2480

Vancouver

Giglou HB, D’Souza J, Sadruddin S, Auer S. LLMs4OL 2024 Datasets: Toward Ontology Learning with Large Language Models. Open Conference Proceedings. 2024;4:17-30. doi:10.52825/ocp.v4i.2480

BibTeX
@article{Giglou2024,
  author = {Giglou, Hamed Babaei and D’Souza, Jennifer and Sadruddin, Sameer and Auer, Sören},
  title = {LLMs4OL 2024 Datasets: Toward Ontology Learning with Large Language Models},
  journal = {Open Conference Proceedings},
  year = {2024},
  volume = {4},
  pages = {17--30},
  doi = {10.52825/ocp.v4i.2480}
}
Kostenlos starten →