EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

SEMA at LLMs4OL 2025 Task C: Prompt-Decoupled Fine-Tuning on MatOnto with LLaMA

Miquel Canal, José Ignacio Abreu, Yoan Gutiérrez

Open Conference Proceedings · 01.10.2025 · 6

DOI: 10.52825/ocp.v6i.2901 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Open Conference Proceedings, online erschienen am 01.10.2025. Verfasst von Miquel Canal und 2 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 6 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper presents our submission to Task C (Relation Extraction) of the LLMs4OL 2025 Challenge, which investigates the ability of Large Language Models (LLMs) to identify semantic and taxonomic relations between ontology types. Focusing on the MatOnto subtask—selected for its manageable size—we explore the performance of open-source models under resource constraints. We fine-tune LLaMA 3.1–8B using LoRA adapters and evaluate various strategies including contrastive negative sampling, prompt inversion, and system prompt variation. Inspired by recent findings on prompt sensitivity, we adopt a cross-template setup where the model is trained with one prompt format and tested with another semantically equivalent variant. Our experiments suggest that prompt-decoupling can improve generalization and mitigate overfitting to specific phrasings. While our results are modest, they offer insights into the challenges of adapting LLMs to structured relation extraction tasks and highlight practical considerations for tuning under constrained resources.

Zitieren

APA

Canal, M., Abreu, J. I., & Gutiérrez, Y. (2025). SEMA at LLMs4OL 2025 Task C: Prompt-Decoupled Fine-Tuning on MatOnto with LLaMA. Open Conference Proceedings, 6. https://doi.org/10.52825/ocp.v6i.2901

Vancouver

Canal M, Abreu JI, Gutiérrez Y. SEMA at LLMs4OL 2025 Task C: Prompt-Decoupled Fine-Tuning on MatOnto with LLaMA. Open Conference Proceedings. 2025;6. doi:10.52825/ocp.v6i.2901

BibTeX
@article{Canal2025,
  author = {Canal, Miquel and Abreu, José Ignacio and Gutiérrez, Yoan},
  title = {SEMA at LLMs4OL 2025 Task C: Prompt-Decoupled Fine-Tuning on MatOnto with LLaMA},
  journal = {Open Conference Proceedings},
  year = {2025},
  volume = {6},
  doi = {10.52825/ocp.v6i.2901}
}
Kostenlos starten →