Interobserver variability in LOCS III cataract grading across experience levels: implications for AI training label quality
International Journal of Ophthalmology · 18.12.2026 · 19 (12) · 2313-2320
DOI: 10.18240/ijo.2026.12.01 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Ophthalmology, erschienen am 18.12.2026. Verfasst von Zhen-Yu Wang und 9 weiteren Autor:innen.
Abstract (Originalsprache)
AIM: To evaluate the variability in cataract grading based on the Lens Opacities Classification System III (LOCS III) among ophthalmologists with different experience levels, and identify which type of annotated data may serve as high-quality labels for artificial intelligence (AI) model development. METHODS: Ophthalmologists were grouped by clinical experience (resident, senior, expert) and independently graded nuclear, cortical, and posterior subcapsular cataract (PSC) according to LOCS III. Consistency was analyzed at multiple levels: label consistency (presence/absence of opacity), grading consistency (strict and tolerant), and cross-subtype consistency using presence scores (agreement on cataract detection) and pairwise exact-match proportions (agreement on identical LOCS III grade). Intragroup reliability was assessed using intraclass correlation coefficients (ICCs), while intergroup and cross-subtype comparisons were conducted using Friedman and Kruskal-Wallis tests with Bonferroni-corrected post-hoc analyses. RESULTS: A total of 138 participants with a mean age of 66.64±10.09y (77 females) diagnosed with cataracts were included in the study, yielding 644 anterior segment slit-lamp photographs under mydriatic conditions. Each image was annotated independently by six ophthalmologists, including two residents, two attending-level seniors, and two experts. Experts achieved the highest intragroup agreement (ICC=0.780), while senior ophthalmologists and residents showed comparable moderate agreement. Intergroup comparison showed significantly higher label and grading consistency between senior-expert pairs than between resident-senior or resident-expert pairs, especially for cortical cataracts and PSC (P
Zitieren
APA
Wang, Z., Wu, X., Zhang, R., Jia, Y., Li, E., Ding, X., Yue, P., Tao, J., Wang, J., & Song, X. (2026). Interobserver variability in LOCS III cataract grading across experience levels: implications for AI training label quality. International Journal of Ophthalmology, 19(12), 2313-2320. https://doi.org/10.18240/ijo.2026.12.01
Vancouver
Wang Z, Wu X, Zhang R, Jia Y, Li E, Ding X, et al. Interobserver variability in LOCS III cataract grading across experience levels: implications for AI training label quality. International Journal of Ophthalmology. 2026;19(12):2313-2320. doi:10.18240/ijo.2026.12.01
BibTeX
@article{Wang2026,
author = {Wang, Zhen-Yu and Wu, Xi-Jin and Zhang, Ran and Jia, Yu-Xuan and Li, En-Jie and Ding, Xue-Fei and Yue, Pei-Lin and Tao, Jing and Wang, Jin-Da and Song, Xu-Dong},
title = {Interobserver variability in LOCS III cataract grading across experience levels: implications for AI training label quality},
journal = {International Journal of Ophthalmology},
year = {2026},
volume = {19},
number = {12},
pages = {2313--2320},
doi = {10.18240/ijo.2026.12.01}
}
EUVIMED