Enhancing Ontology Engineering with Large Language Models: A Stage-Wise Human-in-the-Loop Study
Studies in Health Technology and Informatics · 21.05.2026
DOI: 10.3233/shti260304 ↗Kurz gefasst
Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, erschienen am 21.05.2026. Verfasst von Xuefei Ding und 8 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electronic, Electrical and Systems Engineering, University of Birmingham, UK. Hauptthemen laut MEDLINE: Large Language Models, Biological Ontologies. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Ontology engineering plays a critical role in modelling structured knowledge and ensuring semantic interoperability in digital healthcare. However, manually developing ontologies is time-consuming and dependent on human expertise. This study investigates the utility of large language models (LLMs) on enhancing ontology development with a human-in-the-loop workflow. LLMs were integrated at three checkpoints: (1) term extraction, (2) class and hierarchy definition, and (3) relation specification. Two experimental settings were tested, including LLM-only generation and LLM with additional manual inputs. Results were compared against the stage-wise outputs from a manually constructed ontology using precision, recall, and F1 metrics. Findings showed that human-in-the-loop input consistently improves output quality, while LLMs perform better in early conceptualisation stages than later formalisation stages. This study highlights the complementary strengths of transformer-based reasoning and human validation and presents a reproducible framework for stage-wise evaluation of LLM-assisted ontology engineering. The findings offer practical guidance for integrating generative AI into ontology-driven health data modelling and standardisation.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electronic, Electrical and Systems Engineering, University of Birmingham, UK.
- University of Warwick, UK.
- CEA, List, Université Paris-Saclay, France.
- ETHOS Digital Health, UK.
- European Federation for Medical Informatics, Switzerland.
Zitieren
APA
Ding, X., Pournik, O., Abbasi, S. F., Bai, L., Epiphaniou, G., Matragkas, N., Harrison, S., Parra-Calderón, C. L., & Arvanitis, T. (2026). Enhancing Ontology Engineering with Large Language Models: A Stage-Wise Human-in-the-Loop Study. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti260304
Vancouver
Ding X, Pournik O, Abbasi SF, Bai L, Epiphaniou G, Matragkas N, et al. Enhancing Ontology Engineering with Large Language Models: A Stage-Wise Human-in-the-Loop Study. Studies in Health Technology and Informatics. 2026. doi:10.3233/shti260304
BibTeX
@article{Ding2026,
author = {Ding, Xuefei and Pournik, Omid and Abbasi, Saadullah Farooq and Bai, Linxue and Epiphaniou, Gregory and Matragkas, Nicholas and Harrison, Stuart and Parra-Calderón, Carlos Luis and Arvanitis, Theodoros},
title = {Enhancing Ontology Engineering with Large Language Models: A Stage-Wise Human-in-the-Loop Study},
journal = {Studies in Health Technology and Informatics},
year = {2026},
doi = {10.3233/shti260304}
}
EUVIMED