EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

pro-team at LLMs4OL 2026 Tasks Flagship and Reuse: Retrieval-Augmented Generation and Vocabulary-Constrained Filtering for Ontology Learning

Shivam Mishra, Dhannu Ram Meena, Muneendra Ojha, Krishna Pratap Singh, Kuldeep Singh

Open Conference Proceedings · 04.11.2026 · 11

DOI: 10.52825/ocp.v11i.3663 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Open Conference Proceedings, online erschienen am 04.11.2026. Verfasst von Shivam Mishra und 4 weiteren Autor:innen. Die Arbeit nennt 14 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Ontology learning from text remains challenging despite significant progress in Large Language Models (LLMs), which can hallucinate domain terms, produce inconsistent formats, and favor hierarchical over associative relations. In the LLMs4OL 2026 Challenge, we address both the End-to-End Flagship Task (Task A) and Ontology Extension Reuse Task (Task B) using an offline retrieval-augmented few-shot prompting pipeline. Our system employs Qwen2.5-14B-Instruct with all-MiniLM-L6-v2 for demonstration retrieval, selecting the top-5 examples for Task A and top-2 for Task B. A left-truncated context-windowing strategy preserves task instructions within long prompts. For Task B, generated triples undergo deterministic vocabulary-constrained filtering, retaining triples when at least one endpoint belongs to the sample’s closed term/type vocabulary and removing duplicates of the initial ontology. The approach achieves Semantic Graph Similarity of 0.8692, Term-Typing F1 of 0.9200, and Taxonomy Discovery F1 of 0.8540 on Task B, while Task A achieves 0.7416 Semantic Graph Similarity. However, no non-taxonomic relations are extracted, highlighting limitations of closed, taxonomy-oriented relation vocabularies.

Zitieren

APA

Mishra, S., Meena, D. R., Ojha, M., Singh, K. P., & Singh, K. (2026). pro-team at LLMs4OL 2026 Tasks Flagship and Reuse: Retrieval-Augmented Generation and Vocabulary-Constrained Filtering for Ontology Learning. Open Conference Proceedings, 11. https://doi.org/10.52825/ocp.v11i.3663

Vancouver

Mishra S, Meena DR, Ojha M, Singh KP, Singh K. pro-team at LLMs4OL 2026 Tasks Flagship and Reuse: Retrieval-Augmented Generation and Vocabulary-Constrained Filtering for Ontology Learning. Open Conference Proceedings. 2026;11. doi:10.52825/ocp.v11i.3663

BibTeX
@article{Mishra2026,
  author = {Mishra, Shivam and Meena, Dhannu Ram and Ojha, Muneendra and Singh, Krishna Pratap and Singh, Kuldeep},
  title = {pro-team at LLMs4OL 2026 Tasks Flagship and Reuse: Retrieval-Augmented Generation and Vocabulary-Constrained Filtering for Ontology Learning},
  journal = {Open Conference Proceedings},
  year = {2026},
  volume = {11},
  doi = {10.52825/ocp.v11i.3663}
}
Kostenlos starten →