LLMs4OL 2025 Overview: The 2nd Large Language Models for Ontology Learning Challenge
Open Conference Proceedings · 01.10.2025 · 6
DOI: 10.52825/ocp.v6i.2913 ↗Kurz gefasst
Fachartikel in der Zeitschrift Open Conference Proceedings, online erschienen am 01.10.2025. Verfasst von Hamed Babaei Giglou und 3 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bundesministerium für Bildung und Forschung, Deutsche Forschungsgemeinschaft.
Abstract (Originalsprache)
We present the results of the 2nd LLMs4OL 2025 Challenge, a shared task designed to evaluate the effectiveness of large language models (LLMs) for ontology learning. The challenge attracted a diverse set of participants who leveraged a broad spectrum of models, including general-purpose LLMs, domain-specific models, and embedding-based systems. Submissions covered multiple subtasks such as Text2Onto, term typing, taxonomy discovery, and non-taxonomic relationship extractions. The results highlight that hybrid pipelines integrating commercial LLMs with domain-tuned embeddings and fine-tuning approaches achieved the strongest overall performance, while specialized domain models improved results in biomedical and technical datasets. Key insights include the importance of prompt engineering, retrieval-augmented generation (RAG), and ensemble learning. This paper presents the second benchmark of LLM-driven ontology learning, serving as an overview of the participants’ contributions to the challenge. Building on this, this overview presents findings, highlights emerging strategies, and offers practical insights for researchers and practitioners seeking to align unstructured language with structured knowledge.
Förderung
- Bundesministerium für Bildung und Forschung
- Deutsche Forschungsgemeinschaft
Zitieren
APA
Giglou, H. B., D'Souza, J., Mihindukulasooriya, N., & Auer, S. (2025). LLMs4OL 2025 Overview: The 2nd Large Language Models for Ontology Learning Challenge. Open Conference Proceedings, 6. https://doi.org/10.52825/ocp.v6i.2913
Vancouver
Giglou HB, D'Souza J, Mihindukulasooriya N, Auer S. LLMs4OL 2025 Overview: The 2nd Large Language Models for Ontology Learning Challenge. Open Conference Proceedings. 2025;6. doi:10.52825/ocp.v6i.2913
BibTeX
@article{Giglou2025,
author = {Giglou, Hamed Babaei and D'Souza, Jennifer and Mihindukulasooriya, Nandana and Auer, Sören},
title = {LLMs4OL 2025 Overview: The 2nd Large Language Models for Ontology Learning Challenge},
journal = {Open Conference Proceedings},
year = {2025},
volume = {6},
doi = {10.52825/ocp.v6i.2913}
}
EUVIMED