EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Challenges in applying generative artificial intelligence for ankle fracture classification: Insights from AO/OTA and Lauge-Hansen systems

Zhiyong Cui, Bibo Wang, Bing Li, Chonglin Yang, Yuan Zhu, Jinhao Liu, Yunfeng Yang

DIGITAL HEALTH · 2026-02 · 12

DOI: 10.1177/20552076261499688 ↗

Kurz gefasst

Fachartikel in der Zeitschrift DIGITAL HEALTH, online erschienen am 29.10.2026. Verfasst von Zhiyong Cui und 6 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Science and Technology Commission of Shanghai Municipality, National Key R&D Program of China, Ministry of Science and Technology, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Aim

To evaluate the diagnostic performance and radiology report quality of generative artificial intelligence (AI) models in classifying acute ankle fractures using the AO/OTA and Lauge-Hansen systems.

Methods

A study of 529 acute ankle fracture cases was conducted. Expert consensus was used as the reference for AO/OTA and Lauge-Hansen classifications. Global multi-class and subtype-level metrics were used to quantify diagnostic performance, and five-dimensional blinded scoring was performed to evaluate AI-generated report quality.

Results

ChatGPT-5.1 achieved the highest accuracy (62.0% for AO/OTA, 64.1% for Lauge-Hansen). All models performed below the majority-class baseline for both classification tasks (73.5% for AO/OTA and 76.8% for Lauge-Hansen). Higher weighted-averaged F1 (weighted_F1) scores overestimated model performance. Near-zero Matthews correlation coefficient (MCC) and low macro-averaged F1 (macro_F1) reflected poor global multi-class classification performance, while one-versus-rest subtype-level balanced accuracy around 0.5 confirmed random-level discrimination for each subtype in binary one-versus-rest testing. All models tended to misclassify rare fractures as common AO/OTA and Lauge-Hansen subtypes, showing high specificity but poor sensitivity for rare and high-risk fractures. Quality evaluation revealed significant inter-model differences (all p

Förderung

  • Science and Technology Commission of Shanghai Municipality
  • National Key R&D Program of China, Ministry of Science and Technology
  • National Natural Science Foundation of China

Zitieren

APA

Cui, Z., Wang, B., Li, B., Yang, C., Zhu, Y., Liu, J., & Yang, Y. (2026). Challenges in applying generative artificial intelligence for ankle fracture classification: Insights from AO/OTA and Lauge-Hansen systems. DIGITAL HEALTH, 12. https://doi.org/10.1177/20552076261499688

Vancouver

Cui Z, Wang B, Li B, Yang C, Zhu Y, Liu J, et al. Challenges in applying generative artificial intelligence for ankle fracture classification: Insights from AO/OTA and Lauge-Hansen systems. DIGITAL HEALTH. 2026;12. doi:10.1177/20552076261499688

BibTeX
@article{Cui2026,
  author = {Cui, Zhiyong and Wang, Bibo and Li, Bing and Yang, Chonglin and Zhu, Yuan and Liu, Jinhao and Yang, Yunfeng},
  title = {Challenges in applying generative artificial intelligence for ankle fracture classification: Insights from AO/OTA and Lauge-Hansen systems},
  journal = {DIGITAL HEALTH},
  year = {2026},
  volume = {12},
  doi = {10.1177/20552076261499688}
}
Kostenlos starten →