Challenges in applying generative artificial intelligence for ankle fracture classification: Insights from AO/OTA and Lauge-Hansen systems
DIGITAL HEALTH · 2026-02 · 12
DOI: 10.1177/20552076261499688 ↗Kurz gefasst
Fachartikel in der Zeitschrift DIGITAL HEALTH, online erschienen am 29.10.2026. Verfasst von Zhiyong Cui und 6 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Science and Technology Commission of Shanghai Municipality, National Key R&D Program of China, Ministry of Science and Technology, National Natural Science Foundation of China.
Abstract (Originalsprache)
Aim
To evaluate the diagnostic performance and radiology report quality of generative artificial intelligence (AI) models in classifying acute ankle fractures using the AO/OTA and Lauge-Hansen systems.
Methods
A study of 529 acute ankle fracture cases was conducted. Expert consensus was used as the reference for AO/OTA and Lauge-Hansen classifications. Global multi-class and subtype-level metrics were used to quantify diagnostic performance, and five-dimensional blinded scoring was performed to evaluate AI-generated report quality.
Results
ChatGPT-5.1 achieved the highest accuracy (62.0% for AO/OTA, 64.1% for Lauge-Hansen). All models performed below the majority-class baseline for both classification tasks (73.5% for AO/OTA and 76.8% for Lauge-Hansen). Higher weighted-averaged F1 (weighted_F1) scores overestimated model performance. Near-zero Matthews correlation coefficient (MCC) and low macro-averaged F1 (macro_F1) reflected poor global multi-class classification performance, while one-versus-rest subtype-level balanced accuracy around 0.5 confirmed random-level discrimination for each subtype in binary one-versus-rest testing. All models tended to misclassify rare fractures as common AO/OTA and Lauge-Hansen subtypes, showing high specificity but poor sensitivity for rare and high-risk fractures. Quality evaluation revealed significant inter-model differences (all p
Förderung
- Science and Technology Commission of Shanghai Municipality
- National Key R&D Program of China, Ministry of Science and Technology
- National Natural Science Foundation of China
Zitieren
APA
Cui, Z., Wang, B., Li, B., Yang, C., Zhu, Y., Liu, J., & Yang, Y. (2026). Challenges in applying generative artificial intelligence for ankle fracture classification: Insights from AO/OTA and Lauge-Hansen systems. DIGITAL HEALTH, 12. https://doi.org/10.1177/20552076261499688
Vancouver
Cui Z, Wang B, Li B, Yang C, Zhu Y, Liu J, et al. Challenges in applying generative artificial intelligence for ankle fracture classification: Insights from AO/OTA and Lauge-Hansen systems. DIGITAL HEALTH. 2026;12. doi:10.1177/20552076261499688
BibTeX
@article{Cui2026,
author = {Cui, Zhiyong and Wang, Bibo and Li, Bing and Yang, Chonglin and Zhu, Yuan and Liu, Jinhao and Yang, Yunfeng},
title = {Challenges in applying generative artificial intelligence for ankle fracture classification: Insights from AO/OTA and Lauge-Hansen systems},
journal = {DIGITAL HEALTH},
year = {2026},
volume = {12},
doi = {10.1177/20552076261499688}
}
EUVIMED