EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Enhancing Ontology Engineering with Large Language Models: A Stage-Wise Human-in-the-Loop Study

Xuefei Ding, Omid Pournik, Saadullah Farooq Abbasi, Linxue Bai, Gregory Epiphaniou, Nicholas Matragkas, Stuart Harrison, Carlos Luis Parra-Calderón, Theodoros Arvanitis

Studies in Health Technology and Informatics · 21.05.2026

DOI: 10.3233/shti260304 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, erschienen am 21.05.2026. Verfasst von Xuefei Ding und 8 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electronic, Electrical and Systems Engineering, University of Birmingham, UK. Hauptthemen laut MEDLINE: Large Language Models, Biological Ontologies. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Ontology engineering plays a critical role in modelling structured knowledge and ensuring semantic interoperability in digital healthcare. However, manually developing ontologies is time-consuming and dependent on human expertise. This study investigates the utility of large language models (LLMs) on enhancing ontology development with a human-in-the-loop workflow. LLMs were integrated at three checkpoints: (1) term extraction, (2) class and hierarchy definition, and (3) relation specification. Two experimental settings were tested, including LLM-only generation and LLM with additional manual inputs. Results were compared against the stage-wise outputs from a manually constructed ontology using precision, recall, and F1 metrics. Findings showed that human-in-the-loop input consistently improves output quality, while LLMs perform better in early conceptualisation stages than later formalisation stages. This study highlights the complementary strengths of transformer-based reasoning and human validation and presents a reproducible framework for stage-wise evaluation of LLM-assisted ontology engineering. The findings offer practical guidance for integrating generative AI into ontology-driven health data modelling and standardisation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Large Language ModelsBiological OntologiesHumansSemanticsDigital HealthGenerative Artificial Intelligence

Stichwörter der Autor:innen

Ontology engineeringdigital healthcarehuman-in-the-looplarge language modelssemantic interoperability

Autor:innen und Institutionen

  • Department of Electronic, Electrical and Systems Engineering, University of Birmingham, UK.
  • University of Warwick, UK.
  • CEA, List, Université Paris-Saclay, France.
  • ETHOS Digital Health, UK.
  • European Federation for Medical Informatics, Switzerland.

Zitieren

APA

Ding, X., Pournik, O., Abbasi, S. F., Bai, L., Epiphaniou, G., Matragkas, N., Harrison, S., Parra-Calderón, C. L., & Arvanitis, T. (2026). Enhancing Ontology Engineering with Large Language Models: A Stage-Wise Human-in-the-Loop Study. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti260304

Vancouver

Ding X, Pournik O, Abbasi SF, Bai L, Epiphaniou G, Matragkas N, et al. Enhancing Ontology Engineering with Large Language Models: A Stage-Wise Human-in-the-Loop Study. Studies in Health Technology and Informatics. 2026. doi:10.3233/shti260304

BibTeX
@article{Ding2026,
  author = {Ding, Xuefei and Pournik, Omid and Abbasi, Saadullah Farooq and Bai, Linxue and Epiphaniou, Gregory and Matragkas, Nicholas and Harrison, Stuart and Parra-Calderón, Carlos Luis and Arvanitis, Theodoros},
  title = {Enhancing Ontology Engineering with Large Language Models: A Stage-Wise Human-in-the-Loop Study},
  journal = {Studies in Health Technology and Informatics},
  year = {2026},
  doi = {10.3233/shti260304}
}
Kostenlos starten →