Intergrader Agreement on Qualitative and Quantitative Assessment of Diabetic Retinopathy Severity Using Ultra-Widefield Imaging: INSPIRED Study Report 1
Diagnostics · 21.07.2025 · 15 (14) · 1831
DOI: 10.3390/diagnostics15141831 ↗Kurz gefasst
Fachartikel in der Zeitschrift Diagnostics, online erschienen am 21.07.2025. Verfasst von Eleonora Riotto und 6 weiteren Autor:innen. Beteiligte Einrichtung: Moorfields Eye Hospital NHS Foundation Trust, 162 City Road, London EC1V 2PD, UK. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Boehringer Ingelheim International GmbH.
Abstract (Originalsprache)
Background/Objectives: Discrepancies in diabetic retinopathy (DR) grading are well-documented, with retinal non-perfusion (RNP) quantification posing greater challenges. This study assessed intergrader agreement in DR evaluation, focusing on qualitative severity grading and quantitative RNP measurement. We aimed to improve agreement through structured consensus meetings.
Methods
A retrospective analysis of 100 comparisons from 50 eyes (36 patients) was conducted. Two paired medical retina fellows graded ultra-widefield color fundus photographs (CFP) and fundus fluorescein angiography (FFA) images. CFP assessments included DR severity using the International Clinical Diabetic Retinopathy (ICDR) grading system, DR Severity Scale (DRSS), and predominantly peripheral lesions (PPL). FFA-based RNP was defined as capillary loss with grayscale matching the foveal avascular zone. Weekly adjudication by a senior specialist resolved discrepancies. Intergrader agreement was evaluated using Cohen’s kappa (qualitative DRSS) and intraclass correlation coefficients (ICC) (quantitative RNP). Bland–Altman analysis assessed bias and variability.
Results
After eight consensus meetings, CFP grading agreement improved to excellent: kappa = 91% (ICDR DR severity), 89% (DRSS), and 89% (PPL). FFA-based PPL agreement reached 100%. For RNP, the non-perfusion index (NPI) showed moderate overall ICC (0.49), with regional ICCs ranging from 0.40 to 0.57 (highest in the nasal region, ICC = 0.57). Bland–Altman analysis revealed a mean NPI difference of 0.12 (limits: −0.11 to 0.35), indicating acceptable variability despite outliers.
Conclusions
Structured consensus training achieved excellent intergrader agreement for DR severity and PPL grading, supporting the clinical reliability of ultra-widefield imaging. However, RNP measurement variability underscores the need for standardized protocols and automated tools to enhance reproducibility. This process is critical for developing robust AI-based screening systems.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Moorfields Eye Hospital NHS Foundation Trust, 162 City Road, London EC1V 2PD, UK.
- Hampshire Hospitals NHS Foundation Trust, Aldermaston Road, Basingstoke RG24 9NA, UK.
- Boehringer Ingelheim International GmbH, Birkendorfer Str. 65, 88397 Biberach, Germany.
- Leicester Medical School, George Davies Centre, Lancaster Rd, Leicester LE1 7HA, UK.
ORCID-Profile: Francesca Lamanna, Sobha Sivaprasad
Förderung
- Boehringer Ingelheim International GmbH
Zitieren
APA
Riotto, E., Tsai, W. S., Khalid, H., Lamanna, F., Roch, L., Manoj, M., & Sivaprasad, S. (2025). Intergrader Agreement on Qualitative and Quantitative Assessment of Diabetic Retinopathy Severity Using Ultra-Widefield Imaging: INSPIRED Study Report 1. Diagnostics, 15(14), 1831. https://doi.org/10.3390/diagnostics15141831
Vancouver
Riotto E, Tsai WS, Khalid H, Lamanna F, Roch L, Manoj M, et al. Intergrader Agreement on Qualitative and Quantitative Assessment of Diabetic Retinopathy Severity Using Ultra-Widefield Imaging: INSPIRED Study Report 1. Diagnostics. 2025;15(14):1831. doi:10.3390/diagnostics15141831
BibTeX
@article{Riotto2025,
author = {Riotto, Eleonora and Tsai, Wei-Shan and Khalid, Hagar and Lamanna, Francesca and Roch, Louise and Manoj, Medha and Sivaprasad, Sobha},
title = {Intergrader Agreement on Qualitative and Quantitative Assessment of Diabetic Retinopathy Severity Using Ultra-Widefield Imaging: INSPIRED Study Report 1},
journal = {Diagnostics},
year = {2025},
volume = {15},
number = {14},
pages = {1831},
doi = {10.3390/diagnostics15141831}
}
EUVIMED