Headache Diagnosis with Open Language Models on German Vignettes: Study Protocol
Studies in Health Technology and Informatics · 21.05.2026
DOI: 10.3233/shti260170 ↗Kurz gefasst
Multizentrische Studie in der Zeitschrift Studies in Health Technology and Informatics, erschienen am 21.05.2026. Verfasst von Dorian Zwanzig und 2 weiteren Autor:innen. Beteiligte Einrichtung: Eberswalde University for Sustainable Development, Eberswalde, Germany. Hauptthemen laut MEDLINE: Headache, Headache Disorders. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Headache disorders present diagnostic challenges due to their clinical heterogeneity and the extensive taxonomy of the ICHD-3 classification. While large language models (LLMs) have recently demonstrated impressive diagnostic reasoning capabilities, systematic evaluation for headache disorders remains elusive. This study protocol presents a retrospective, multicentre study designed to investigate whether anonymized clinical vignettes from specialized headache centres can be accurately classified according to the ICHD-3 by LLMs. Open-weight models selected for this study will operate in a GDPR-compliant environment and generate classifications that will be compared with expert diagnoses (the gold standard) using top-k accuracy, micro/macro precision, recall, F1 score and Cohen’s κ. Secondary analyses will assess differences between centres and non-specialist raters. Preliminary pilot data (n = 50) already demonstrated exact accuracy of up to 62% and group-level accuracy of up to 92%. The study aims to confirm substantial agreement (κ > 0.6) and provide evidence of the usefulness of LLMs as diagnostic support tools in headache medicine.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Eberswalde University for Sustainable Development, Eberswalde, Germany.
- Department of Neurology, University Medicine Greifswald, Greifswald, Germany.
Zitieren
APA
Zwanzig, D., Zahn, A., & Strauss, S. (2026). Headache Diagnosis with Open Language Models on German Vignettes: Study Protocol. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti260170
Vancouver
Zwanzig D, Zahn A, Strauss S. Headache Diagnosis with Open Language Models on German Vignettes: Study Protocol. Studies in Health Technology and Informatics. 2026. doi:10.3233/shti260170
BibTeX
@article{Zwanzig2026,
author = {Zwanzig, Dorian and Zahn, Anika and Strauss, Sebastian},
title = {Headache Diagnosis with Open Language Models on German Vignettes: Study Protocol},
journal = {Studies in Health Technology and Informatics},
year = {2026},
doi = {10.3233/shti260170}
}
EUVIMED