External Validation of an Upgraded AI Model for Screening Ileocolic Intussusception Using Pediatric Abdominal Radiographs: Multicenter Retrospective Study
Journal of Medical Internet Research · 2025
DOI: 10.2196/72097 ↗Kurz gefasst
Multizentrische Studie in der Zeitschrift Journal of Medical Internet Research, 2025. Verfasst von Jeong Hoon Lee und 11 weiteren Autor:innen. Beteiligte Einrichtung: Department of Radiology, Stanford Medicine, Stanford, CA, United States. Hauptthemen laut MEDLINE: Intussusception, Artificial Intelligence, Ileal Diseases, Radiography, Abdominal. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Artificial intelligence (AI) is increasingly used in radiology, but its development in pediatric imaging remains limited, particularly for emergent conditions. Ileocolic intussusception is an important cause of acute abdominal pain in infants and toddlers and requires timely diagnosis to prevent complications such as bowel ischemia or perforation. While ultrasonography is the diagnostic standard due to its high sensitivity and specificity, its accessibility may be limited, especially outside tertiary centers. Abdominal radiographs (AXRs), despite their limited sensitivity, are often the first-line imaging modality in clinical practice. In this context, AI could support early screening and triage by analyzing AXRs and identifying patients who require further ultrasonography evaluation.
Objective
This study aimed to upgrade and externally validate an AI model for screening ileocolic intussusception using pediatric AXRs with multicenter data and to assess the diagnostic performance of the model in comparison with radiologists of varying experience levels with and without AI assistance.
Methods
This retrospective study included pediatric patients (≤5 years) who underwent both AXRs and ultrasonography for suspected intussusception. Based on the preliminary study from hospital A, the AI model was retrained using data from hospital B and validated with external datasets from hospitals C and D. Diagnostic performance of the upgraded AI model was evaluated using sensitivity, specificity, and the area under the receiver operating characteristic curve (AUC). A reader study was conducted with 3 radiologists, including 2 trainees and 1 pediatric radiologist, to evaluate diagnostic performance with and without AI assistance.
Results
Based on the previously developed AI model trained on 746 patients from hospital A, an additional 431 patients from hospital B (including 143 intussusception cases) were used for further training to develop an upgraded AI model. External validation was conducted using data from hospital C (n=68; 19 intussusception cases) and hospital D (n=90; 30 intussusception cases). The upgraded AI model achieved a sensitivity of 81.7% (95% CI 68.6%‐90%) and a specificity of 81.7% (95% CI 73.3%‐87.8%), with an AUC of 86.2% (95% CI 79.2%‐92.1%) in the external validation set. Without AI assistance, radiologists showed lower performance (overall AUC 64%; sensitivity 49.7%; specificity 77.1%). With AI assistance, radiologists’ specificity improved to 93% (difference +15.9%; P
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Radiology, Stanford Medicine, Stanford, CA, United States.
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea.
- Department of Statistics, Keimyung University, Daegu, Republic of Korea.
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Severance Hospital, Seoul, Republic of Korea.
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Yongin Severance Hospital, 363, Dongbaekjukjeon-daero, Giheung-gu,…
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Gangnam Severance Hospital, Seoul, Republic of Korea.
Zitieren
APA
Lee, J. H., Kim, P. H., Son, N. H., Han, K., Kang, Y., Jeong, S., Kim, E. K., Yoon, H., Gatidis, S., Vasanawala, S., Yoon, H. M., & Shin, H. J. (2025). External Validation of an Upgraded AI Model for Screening Ileocolic Intussusception Using Pediatric Abdominal Radiographs: Multicenter Retrospective Study. Journal of Medical Internet Research. https://doi.org/10.2196/72097
Vancouver
Lee JH, Kim PH, Son NH, Han K, Kang Y, Jeong S, et al. External Validation of an Upgraded AI Model for Screening Ileocolic Intussusception Using Pediatric Abdominal Radiographs: Multicenter Retrospective Study. Journal of Medical Internet Research. 2025. doi:10.2196/72097
BibTeX
@article{Lee2025,
author = {Lee, Jeong Hoon and Kim, Pyeong Hwa and Son, Nak-Hoon and Han, Kyunghwa and Kang, Yeseul and Jeong, Sejin and Kim, Eun-Kyung and Yoon, Haesung and Gatidis, Sergios and Vasanawala, Shreyas and Yoon, Hee Mang and Shin, Hyun Joo},
title = {External Validation of an Upgraded AI Model for Screening Ileocolic Intussusception Using Pediatric Abdominal Radiographs: Multicenter Retrospective Study},
journal = {Journal of Medical Internet Research},
year = {2025},
doi = {10.2196/72097}
}
EUVIMED