EUVIMEDEUVIMED entdecken
Multizentrische StudieStudienprotokollOpen Access · CC BY-NC 4.0

Headache Diagnosis with Open Language Models on German Vignettes: Study Protocol

Dorian Zwanzig, Anika Zahn, Sebastian Strauss

Studies in Health Technology and Informatics · 21.05.2026

DOI: 10.3233/shti260170 ↗

Kurz gefasst

Multizentrische Studie in der Zeitschrift Studies in Health Technology and Informatics, erschienen am 21.05.2026. Verfasst von Dorian Zwanzig und 2 weiteren Autor:innen. Beteiligte Einrichtung: Eberswalde University for Sustainable Development, Eberswalde, Germany. Hauptthemen laut MEDLINE: Headache, Headache Disorders. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Headache disorders present diagnostic challenges due to their clinical heterogeneity and the extensive taxonomy of the ICHD-3 classification. While large language models (LLMs) have recently demonstrated impressive diagnostic reasoning capabilities, systematic evaluation for headache disorders remains elusive. This study protocol presents a retrospective, multicentre study designed to investigate whether anonymized clinical vignettes from specialized headache centres can be accurately classified according to the ICHD-3 by LLMs. Open-weight models selected for this study will operate in a GDPR-compliant environment and generate classifications that will be compared with expert diagnoses (the gold standard) using top-k accuracy, micro/macro precision, recall, F1 score and Cohen’s κ. Secondary analyses will assess differences between centres and non-specialist raters. Preliminary pilot data (n = 50) already demonstrated exact accuracy of up to 62% and group-level accuracy of up to 92%. The study aims to confirm substantial agreement (κ > 0.6) and provide evidence of the usefulness of LLMs as diagnostic support tools in headache medicine.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

HeadacheHeadache DisordersHumansLarge Language ModelsGermanyRetrospective Studies

Stichwörter der Autor:innen

ICHD-3diagnostic accuracydiagnostic supportheadache disorderslarge language models

Autor:innen und Institutionen

  • Eberswalde University for Sustainable Development, Eberswalde, Germany.
  • Department of Neurology, University Medicine Greifswald, Greifswald, Germany.

Zitieren

APA

Zwanzig, D., Zahn, A., & Strauss, S. (2026). Headache Diagnosis with Open Language Models on German Vignettes: Study Protocol. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti260170

Vancouver

Zwanzig D, Zahn A, Strauss S. Headache Diagnosis with Open Language Models on German Vignettes: Study Protocol. Studies in Health Technology and Informatics. 2026. doi:10.3233/shti260170

BibTeX
@article{Zwanzig2026,
  author = {Zwanzig, Dorian and Zahn, Anika and Strauss, Sebastian},
  title = {Headache Diagnosis with Open Language Models on German Vignettes: Study Protocol},
  journal = {Studies in Health Technology and Informatics},
  year = {2026},
  doi = {10.3233/shti260170}
}
Kostenlos starten →