Training and deploying a deep learning model for endoscopic severity grading in ulcerative colitis using multicenter clinical trial data
Therapeutic Advances in Gastrointestinal Endoscopy · 2021-01 · 14
DOI: 10.1177/2631774521990623 ↗Kurz gefasst
Fachartikel in der Zeitschrift Therapeutic Advances in Gastrointestinal Endoscopy, online erschienen am 25.02.2021. Verfasst von Benjamin Gutierrez Becker und 7 weiteren Autor:innen. Beteiligte Einrichtung: Roche Pharma Research and Early Development Informatics, Roche Innovation Center Basel, Basel, Switzerland. Die Arbeit wurde bisher 49-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Introduction
The Mayo Clinic Endoscopic Subscore is a commonly used grading system to assess the severity of ulcerative colitis. Correctly grading colonoscopies using the Mayo Clinic Endoscopic Subscore is a challenging task, with suboptimal rates of interrater and intrarater variability observed even among experienced and sufficiently trained experts. In recent years, several machine learning algorithms have been proposed in an effort to improve the standardization and reproducibility of Mayo Clinic Endoscopic Subscore grading.
Methods
Here we propose an end-to-end fully automated system based on deep learning to predict a binary version of the Mayo Clinic Endoscopic Subscore directly from raw colonoscopy videos. Differently from previous studies, the proposed method mimics the assessment done in practice by a gastroenterologist, that is, traversing the whole colonoscopy video, identifying visually informative regions and computing an overall Mayo Clinic Endoscopic Subscore. The proposed deep learning–based system has been trained and deployed on raw colonoscopies using Mayo Clinic Endoscopic Subscore ground truth provided only at the colon section level, without manually selecting frames driving the severity scoring of ulcerative colitis. Results and Conclusion: Our evaluation on 1672 endoscopic videos obtained from a multisite data set obtained from the etrolizumab Phase II Eucalyptus and Phase III Hickory and Laurel clinical trials, show that our proposed methodology can grade endoscopic videos with a high degree of accuracy and robustness (Area Under the Receiver Operating Characteristic Curve = 0.84 for Mayo Clinic Endoscopic Subscore ⩾ 1, 0.85 for Mayo Clinic Endoscopic Subscore ⩾ 2 and 0.85 for Mayo Clinic Endoscopic Subscore ⩾ 3) and reduced amounts of manual annotation. Plain language summary Patient, caregiver and provider thoughts on educational materials about prescribing and medication safety Artificial intelligence can be used to automatically assess full endoscopic videos and estimate the severity of ulcerative colitis. In this work, we present an artificial intelligence algorithm for the automatic grading of ulcerative colitis in full endoscopic videos. Our artificial intelligence models were trained and evaluated on a large and diverse set of colonoscopy videos obtained from concluded clinical trials. We demonstrate not only that artificial intelligence is able to accurately grade full endoscopic videos, but also that using diverse data sets obtained from multiple sites is critical to train robust AI models that could potentially be deployed on real-world data.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Roche Pharma Research and Early Development Informatics, Roche Innovation Center Basel, Basel, Switzerland.
- Roche Personalized Healthcare, Genentech, Inc., South San Francisco, CA, USA.
- Product Development, Genentech, Inc., 1 DNA Way, South San Francisco, CA, USA.
- School of Pharmaceutical Sciences, Institute of Pharmaceutical Sciences of Western Switzerland, University of Geneva, Rue Michel-Servet 1, 1211 Geneva 4, Switzerland. Immunology, Infectious Disease & Ophthalmology, Roch…
ORCID-Profile: Benjamin Gutierrez Becker, Andreas Thalhammer
Zitieren
APA
Gutierrez Becker, B., Arcadu, F., Thalhammer, A., Gamez Serna, C., Feehan, O., Drawnel, F., Oh, Y. S., & Prunotto, M. (2021). Training and deploying a deep learning model for endoscopic severity grading in ulcerative colitis using multicenter clinical trial data. Therapeutic Advances in Gastrointestinal Endoscopy, 14. https://doi.org/10.1177/2631774521990623
Vancouver
Gutierrez Becker B, Arcadu F, Thalhammer A, Gamez Serna C, Feehan O, Drawnel F, et al. Training and deploying a deep learning model for endoscopic severity grading in ulcerative colitis using multicenter clinical trial data. Therapeutic Advances in Gastrointestinal Endoscopy. 2021;14. doi:10.1177/2631774521990623
BibTeX
@article{GutierrezBecker2021,
author = {Gutierrez Becker, Benjamin and Arcadu, Filippo and Thalhammer, Andreas and Gamez Serna, Citlalli and Feehan, Owen and Drawnel, Faye and Oh, Young S and Prunotto, Marco},
title = {Training and deploying a deep learning model for endoscopic severity grading in ulcerative colitis using multicenter clinical trial data},
journal = {Therapeutic Advances in Gastrointestinal Endoscopy},
year = {2021},
volume = {14},
doi = {10.1177/2631774521990623}
}
EUVIMED