EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Intergrader Agreement on Qualitative and Quantitative Assessment of Diabetic Retinopathy Severity Using Ultra-Widefield Imaging: INSPIRED Study Report 1

Eleonora Riotto, Wei-Shan Tsai, Hagar Khalid, Francesca Lamanna iD, Louise Roch, Medha Manoj, Sobha Sivaprasad iD

Diagnostics · 21.07.2025 · 15 (14) · 1831

DOI: 10.3390/diagnostics15141831 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Diagnostics, online erschienen am 21.07.2025. Verfasst von Eleonora Riotto und 6 weiteren Autor:innen. Beteiligte Einrichtung: Moorfields Eye Hospital NHS Foundation Trust, 162 City Road, London EC1V 2PD, UK. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Boehringer Ingelheim International GmbH.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background/Objectives: Discrepancies in diabetic retinopathy (DR) grading are well-documented, with retinal non-perfusion (RNP) quantification posing greater challenges. This study assessed intergrader agreement in DR evaluation, focusing on qualitative severity grading and quantitative RNP measurement. We aimed to improve agreement through structured consensus meetings.

Methods

A retrospective analysis of 100 comparisons from 50 eyes (36 patients) was conducted. Two paired medical retina fellows graded ultra-widefield color fundus photographs (CFP) and fundus fluorescein angiography (FFA) images. CFP assessments included DR severity using the International Clinical Diabetic Retinopathy (ICDR) grading system, DR Severity Scale (DRSS), and predominantly peripheral lesions (PPL). FFA-based RNP was defined as capillary loss with grayscale matching the foveal avascular zone. Weekly adjudication by a senior specialist resolved discrepancies. Intergrader agreement was evaluated using Cohen’s kappa (qualitative DRSS) and intraclass correlation coefficients (ICC) (quantitative RNP). Bland–Altman analysis assessed bias and variability.

Results

After eight consensus meetings, CFP grading agreement improved to excellent: kappa = 91% (ICDR DR severity), 89% (DRSS), and 89% (PPL). FFA-based PPL agreement reached 100%. For RNP, the non-perfusion index (NPI) showed moderate overall ICC (0.49), with regional ICCs ranging from 0.40 to 0.57 (highest in the nasal region, ICC = 0.57). Bland–Altman analysis revealed a mean NPI difference of 0.12 (limits: −0.11 to 0.35), indicating acceptable variability despite outliers.

Conclusions

Structured consensus training achieved excellent intergrader agreement for DR severity and PPL grading, supporting the clinical reliability of ultra-widefield imaging. However, RNP measurement variability underscores the need for standardized protocols and automated tools to enhance reproducibility. This process is critical for developing robust AI-based screening systems.

Schlagwörter

Stichwörter der Autor:innen

diabetic retinopathyintergrader agreementpredominant peripheral lesionsretinal non-perfusionultra-widefield fluorescein angiography

Autor:innen und Institutionen

  • Moorfields Eye Hospital NHS Foundation Trust, 162 City Road, London EC1V 2PD, UK.
  • Hampshire Hospitals NHS Foundation Trust, Aldermaston Road, Basingstoke RG24 9NA, UK.
  • Boehringer Ingelheim International GmbH, Birkendorfer Str. 65, 88397 Biberach, Germany.
  • Leicester Medical School, George Davies Centre, Lancaster Rd, Leicester LE1 7HA, UK.

ORCID-Profile: Francesca Lamanna, Sobha Sivaprasad

Förderung

  • Boehringer Ingelheim International GmbH

Zitieren

APA

Riotto, E., Tsai, W. S., Khalid, H., Lamanna, F., Roch, L., Manoj, M., & Sivaprasad, S. (2025). Intergrader Agreement on Qualitative and Quantitative Assessment of Diabetic Retinopathy Severity Using Ultra-Widefield Imaging: INSPIRED Study Report 1. Diagnostics, 15(14), 1831. https://doi.org/10.3390/diagnostics15141831

Vancouver

Riotto E, Tsai WS, Khalid H, Lamanna F, Roch L, Manoj M, et al. Intergrader Agreement on Qualitative and Quantitative Assessment of Diabetic Retinopathy Severity Using Ultra-Widefield Imaging: INSPIRED Study Report 1. Diagnostics. 2025;15(14):1831. doi:10.3390/diagnostics15141831

BibTeX
@article{Riotto2025,
  author = {Riotto, Eleonora and Tsai, Wei-Shan and Khalid, Hagar and Lamanna, Francesca and Roch, Louise and Manoj, Medha and Sivaprasad, Sobha},
  title = {Intergrader Agreement on Qualitative and Quantitative Assessment of Diabetic Retinopathy Severity Using Ultra-Widefield Imaging: INSPIRED Study Report 1},
  journal = {Diagnostics},
  year = {2025},
  volume = {15},
  number = {14},
  pages = {1831},
  doi = {10.3390/diagnostics15141831}
}
Kostenlos starten →