SEMA at LLMs4OL 2025 Task C: Prompt-Decoupled Fine-Tuning on MatOnto with LLaMA
Open Conference Proceedings · 01.10.2025 · 6
DOI: 10.52825/ocp.v6i.2901 ↗Kurz gefasst
Fachartikel in der Zeitschrift Open Conference Proceedings, online erschienen am 01.10.2025. Verfasst von Miquel Canal und 2 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 6 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
This paper presents our submission to Task C (Relation Extraction) of the LLMs4OL 2025 Challenge, which investigates the ability of Large Language Models (LLMs) to identify semantic and taxonomic relations between ontology types. Focusing on the MatOnto subtask—selected for its manageable size—we explore the performance of open-source models under resource constraints. We fine-tune LLaMA 3.1–8B using LoRA adapters and evaluate various strategies including contrastive negative sampling, prompt inversion, and system prompt variation. Inspired by recent findings on prompt sensitivity, we adopt a cross-template setup where the model is trained with one prompt format and tested with another semantically equivalent variant. Our experiments suggest that prompt-decoupling can improve generalization and mitigate overfitting to specific phrasings. While our results are modest, they offer insights into the challenges of adapting LLMs to structured relation extraction tasks and highlight practical considerations for tuning under constrained resources.
Zitieren
APA
Canal, M., Abreu, J. I., & Gutiérrez, Y. (2025). SEMA at LLMs4OL 2025 Task C: Prompt-Decoupled Fine-Tuning on MatOnto with LLaMA. Open Conference Proceedings, 6. https://doi.org/10.52825/ocp.v6i.2901
Vancouver
Canal M, Abreu JI, Gutiérrez Y. SEMA at LLMs4OL 2025 Task C: Prompt-Decoupled Fine-Tuning on MatOnto with LLaMA. Open Conference Proceedings. 2025;6. doi:10.52825/ocp.v6i.2901
BibTeX
@article{Canal2025,
author = {Canal, Miquel and Abreu, José Ignacio and Gutiérrez, Yoan},
title = {SEMA at LLMs4OL 2025 Task C: Prompt-Decoupled Fine-Tuning on MatOnto with LLaMA},
journal = {Open Conference Proceedings},
year = {2025},
volume = {6},
doi = {10.52825/ocp.v6i.2901}
}
EUVIMED