RWTH-DBIS at LLMs4OL 2024 Tasks A and B
Open Conference Proceedings · 02.10.2024 · 4 · 49-63
DOI: 10.52825/ocp.v4i.2491 ↗Kurz gefasst
Fachartikel in der Zeitschrift Open Conference Proceedings, online erschienen am 02.10.2024. Verfasst von Yixin Peng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bundesministerium für Bildung und Forschung.
Abstract (Originalsprache)
The increasing capabilities of Large Language Models (LLMs) have opened new opportunities for enhancing Ontology Learning (OL), a process crucial for structuring domain knowledge in a machine-readable format. This paper reports on the participation of the RWTH-DBIS team in the LLMs4OL Challenge at ISWC 2024, addressing two primary tasks: term typing and taxonomy discovery. We used LLaMA-3-8B and GPT-3.5-Turbo models to find the performance gaps between open-source and commercial LLMs. For open-source LLMs, our methods included domain-specific continual training, fine-tuning, and knowledge-enhanced prompt-tuning. These approaches were evaluated on the benchmark datasets from the challenge, i.e., GeoNames, UMLS, Schema.org, and the Gene Ontology (GO), among others. The results indicate that domain-specific continual training followed by task-specific fine-tuning enhances the performance of open-source LLMs in these tasks. However, performance gaps remain when compared to commercial LLMs. Additionally, the developed prompting strategies demonstrate substantial utility. This research highlights the potential of LLMs to automate and improve the OL process, offering insights into effective methodologies for future developments in this field.
Förderung
- Bundesministerium für Bildung und Forschung
Zitieren
APA
Peng, Y., Mou, Y., Zhu, B., Sowe, S., & Decker, S. (2024). RWTH-DBIS at LLMs4OL 2024 Tasks A and B. Open Conference Proceedings, 4, 49-63. https://doi.org/10.52825/ocp.v4i.2491
Vancouver
Peng Y, Mou Y, Zhu B, Sowe S, Decker S. RWTH-DBIS at LLMs4OL 2024 Tasks A and B. Open Conference Proceedings. 2024;4:49-63. doi:10.52825/ocp.v4i.2491
BibTeX
@article{Peng2024,
author = {Peng, Yixin and Mou, Yongli and Zhu, Bozhen and Sowe, Sulayman and Decker, Stefan},
title = {RWTH-DBIS at LLMs4OL 2024 Tasks A and B},
journal = {Open Conference Proceedings},
year = {2024},
volume = {4},
pages = {49--63},
doi = {10.52825/ocp.v4i.2491}
}
EUVIMED