SKH-NLP at LLMs4OL 2024 Task B: Taxonomy Discovery in Ontologies Using BERT and LLaMA 3
Open Conference Proceedings · 02.10.2024 · 4 · 103-111
DOI: 10.52825/ocp.v4i.2483 ↗Kurz gefasst
Fachartikel in der Zeitschrift Open Conference Proceedings, online erschienen am 02.10.2024. Verfasst von Seyed Mohammad Hossein Hashemi und 2 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 5 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Taxonomy discovery in ontologies refers to extracting the parent class from the child class. By modeling this task as a classification problem, we addressed it using two different approaches. The first approach involved fine-tuning the “BERT-Large” model with various prompts and using it in a classification system. In the second approach, we utilized the “LLaMA 3 70B” model, experimenting with different prompts and modifying them to achieve the best results. Additionally, we evaluated the correctness of the answers using substring and Levenshtein distance functions. The results indicate that, with appropriate fine-tuning, the BERT model can achieve performance levels comparable to those of more recent and significantly larger language models, such as LLaMA 3 70B. However, with appropriate prompts, LLaMA 3 70B performs slightly better than BERT, highlighting the importance of prompt quality. Ultimately, further experiments on different settings for fine-tuning BERT, few-shot learning, and using knowledge graphs for validating the model's answers for LLaMA are recommended to improve the results. Additionally, testing other models and examining the results of various encoder-based and decoder-based models can be employed.
Zitieren
APA
Hashemi, S. M. H., Manesh, M. K., & Shamsfard, M. (2024). SKH-NLP at LLMs4OL 2024 Task B: Taxonomy Discovery in Ontologies Using BERT and LLaMA 3. Open Conference Proceedings, 4, 103-111. https://doi.org/10.52825/ocp.v4i.2483
Vancouver
Hashemi SMH, Manesh MK, Shamsfard M. SKH-NLP at LLMs4OL 2024 Task B: Taxonomy Discovery in Ontologies Using BERT and LLaMA 3. Open Conference Proceedings. 2024;4:103-111. doi:10.52825/ocp.v4i.2483
BibTeX
@article{Hashemi2024,
author = {Hashemi, Seyed Mohammad Hossein and Manesh, Mostafa Karimi and Shamsfard, Mehrnoush},
title = {SKH-NLP at LLMs4OL 2024 Task B: Taxonomy Discovery in Ontologies Using BERT and LLaMA 3},
journal = {Open Conference Proceedings},
year = {2024},
volume = {4},
pages = {103--111},
doi = {10.52825/ocp.v4i.2483}
}
EUVIMED