T-GreC at LLMs4OL 2025 Task B: A Report on Term-Typing Task of OBI dataset using LLM with k-Nearest Neighbors
Open Conference Proceedings · 01.10.2025 · 6
DOI: 10.52825/ocp.v6i.2898 ↗Kurz gefasst
Fachartikel in der Zeitschrift Open Conference Proceedings, online erschienen am 01.10.2025. Verfasst von Chavakan Yimmark und 1 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 12 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
This report presents an approach that combines large language models' (LLMs) embedding with k-nearest neighbors (k-NN) for the term-typing task on the OBI (Ontology for Biomedical Investigations) dataset. We investigate the effectiveness of transformer models namely PubMedBERT, BioBERT, DeBERTa-v3, and RoBERTa with k-NN classification using the embedding of each respective model. Our experimental results demonstrate that fine-tuned LLMs not only have the capability to do term typing on their own but also can learn effective embeddings that are exploitable by k-NN for solving the task, with RoBERTa achieving the highest F1 score of 0.827 and k-NN using embedding from the model with score of 0.862. The study reveals that embeddings from transformer models, when used as semantic representations for similarity-based method, improve classification accuracy in this specific case.
Zitieren
APA
Yimmark, C., & Racharak, T. (2025). T-GreC at LLMs4OL 2025 Task B: A Report on Term-Typing Task of OBI dataset using LLM with k-Nearest Neighbors. Open Conference Proceedings, 6. https://doi.org/10.52825/ocp.v6i.2898
Vancouver
Yimmark C, Racharak T. T-GreC at LLMs4OL 2025 Task B: A Report on Term-Typing Task of OBI dataset using LLM with k-Nearest Neighbors. Open Conference Proceedings. 2025;6. doi:10.52825/ocp.v6i.2898
BibTeX
@article{Yimmark2025,
author = {Yimmark, Chavakan and Racharak, Teeradaj},
title = {T-GreC at LLMs4OL 2025 Task B: A Report on Term-Typing Task of OBI dataset using LLM with k-Nearest Neighbors},
journal = {Open Conference Proceedings},
year = {2025},
volume = {6},
doi = {10.52825/ocp.v6i.2898}
}
EUVIMED