EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

LLMs4OL 2025 Overview: The 2nd Large Language Models for Ontology Learning Challenge

Hamed Babaei Giglou, Jennifer D'Souza, Nandana Mihindukulasooriya, Sören Auer

Open Conference Proceedings · 01.10.2025 · 6

DOI: 10.52825/ocp.v6i.2913 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Open Conference Proceedings, online erschienen am 01.10.2025. Verfasst von Hamed Babaei Giglou und 3 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bundesministerium für Bildung und Forschung, Deutsche Forschungsgemeinschaft.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We present the results of the 2nd LLMs4OL 2025 Challenge, a shared task designed to evaluate the effectiveness of large language models (LLMs) for ontology learning. The challenge attracted a diverse set of participants who leveraged a broad spectrum of models, including general-purpose LLMs, domain-specific models, and embedding-based systems. Submissions covered multiple subtasks such as Text2Onto, term typing, taxonomy discovery, and non-taxonomic relationship extractions. The results highlight that hybrid pipelines integrating commercial LLMs with domain-tuned embeddings and fine-tuning approaches achieved the strongest overall performance, while specialized domain models improved results in biomedical and technical datasets. Key insights include the importance of prompt engineering, retrieval-augmented generation (RAG), and ensemble learning. This paper presents the second benchmark of LLM-driven ontology learning, serving as an overview of the participants’ contributions to the challenge. Building on this, this overview presents findings, highlights emerging strategies, and offers practical insights for researchers and practitioners seeking to align unstructured language with structured knowledge.

Förderung

  • Bundesministerium für Bildung und Forschung
  • Deutsche Forschungsgemeinschaft

Zitieren

APA

Giglou, H. B., D'Souza, J., Mihindukulasooriya, N., & Auer, S. (2025). LLMs4OL 2025 Overview: The 2nd Large Language Models for Ontology Learning Challenge. Open Conference Proceedings, 6. https://doi.org/10.52825/ocp.v6i.2913

Vancouver

Giglou HB, D'Souza J, Mihindukulasooriya N, Auer S. LLMs4OL 2025 Overview: The 2nd Large Language Models for Ontology Learning Challenge. Open Conference Proceedings. 2025;6. doi:10.52825/ocp.v6i.2913

BibTeX
@article{Giglou2025,
  author = {Giglou, Hamed Babaei and D'Souza, Jennifer and Mihindukulasooriya, Nandana and Auer, Sören},
  title = {LLMs4OL 2025 Overview: The 2nd Large Language Models for Ontology Learning Challenge},
  journal = {Open Conference Proceedings},
  year = {2025},
  volume = {6},
  doi = {10.52825/ocp.v6i.2913}
}
Kostenlos starten →