EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Checking Medical Process Conformance by Exploiting LLMs

Giorgio Leonardi, Stefania Montani, Manuel Striani

Applied Sciences · 18.09.2025 · 15 (18) · 10184

DOI: 10.3390/app151810184 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 18.09.2025. Verfasst von Giorgio Leonardi und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Clinical guidelines, which represent the normative process models for healthcare organizations, are typically available in a textual, unstructured form. This issue hampers the application of classical conformance-checking algorithms to the medical domain, which take in input of a formalized and computer-interpretable description of the process. In this paper, (i) we propose overcoming this problem by taking advantage of a Large Language Model (LLM), in order to extract normative rules from textual guidelines; (ii) we then check and quantify the conformance of the patient event log with respect to such rules. Additionally, (iii) we adopt the approach as a means for evaluating the quality of the models mined by different process discovery algorithms from the event log, by comparing their conformance to the rules. We have tested our work in the domain of stroke. As regards conformance checking, we have proved the compliance of four Northern Italy hospitals to a general rule for diagnosis timing and to two rules that refer to thrombolysis treatment, and have identified some issues related to other rules, which involve the availability of magnetic resonance instruments. As regards process model discovery evaluation, we have assessed the superiority of Heuristic Miner with respect to other mining algorithms on our dataset. It is worth noting that the easy extraction of rules in our LLM-assisted approach would make it quickly applicable to other fields as well.

Zitieren

APA

Leonardi, G., Montani, S., & Striani, M. (2025). Checking Medical Process Conformance by Exploiting LLMs. Applied Sciences, 15(18), 10184. https://doi.org/10.3390/app151810184

Vancouver

Leonardi G, Montani S, Striani M. Checking Medical Process Conformance by Exploiting LLMs. Applied Sciences. 2025;15(18):10184. doi:10.3390/app151810184

BibTeX
@article{Leonardi2025,
  author = {Leonardi, Giorgio and Montani, Stefania and Striani, Manuel},
  title = {Checking Medical Process Conformance by Exploiting LLMs},
  journal = {Applied Sciences},
  year = {2025},
  volume = {15},
  number = {18},
  pages = {10184},
  doi = {10.3390/app151810184}
}
Kostenlos starten →