EUVIMEDEUVIMED entdecken
ValidierungsstudieOpen Access

Deep Learning–Based Precision Cropping of Eye Regions in Strabismus Photographs: Algorithm Development and Validation Study for Workflow Optimization

Dawen Wu, Yanfei Li, Zeyi Yang, Teng Yin, Xiaohang Chen, Jingyu Liu, Wenyi Shang, Bin Xie, Guoyuan Yang, Haixian Zhang, Longqian Liu

Journal of Medical Internet Research · 2025

DOI: 10.2196/74402 ↗

Kurz gefasst

Validierungsstudie in der Zeitschrift Journal of Medical Internet Research, 2025. Verfasst von Dawen Wu und 10 weiteren Autor:innen. Beteiligte Einrichtung: Department of Ophthalmology, West China Hospital, Sichuan University, 37 Guoxue Xiang (Alley), Chengdu, Sichuan Province, 610041, China, 86 189806017…. Hauptthemen laut MEDLINE: Deep Learning, Strabismus, Photography, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Traditional ocular gaze photograph preprocessing, relying on manual cropping and head tilt correction, is time-consuming and inconsistent, limiting artificial intelligence (AI) model development and clinical application.

Objective

This study aimed to address these challenges using an advanced preprocessing algorithm to enhance the accuracy, efficiency, and standardization of eye region cropping for clinical workflows and AI data preprocessing.

Methods

This retrospective and prospective cross-sectional study utilized 5832 images from 648 inpatients and outpatients, capturing 3 gaze positions under diverse conditions, including obstructions and varying distances. The preprocessing algorithm, based on a rotating bounding box detection framework, was trained and evaluated using precision, recall, and mean average precision (mAP) at various intersections over union thresholds. A 5-fold cross-validation was performed on an inpatient dataset, with additional testing on an independent outpatient dataset and an external cross-population dataset of 500 images from the IMDB-WIKI collection, representing diverse ethnicities and ages. Expert validation confirmed alignment with clinical standards across 96 images (48 images from a Chinese dataset of patients with strabismus and 48 images from IMDB-WIKI). Gradient-weighted class activation mapping heatmaps were used to assess model interpretability. A control experiment with 5 optometry specialists compared manual and automated cropping efficiency. Downstream task validation involved preprocessing 1000 primary gaze photographs using the Dlib toolkit, faster region-based convolutional neural network (R-CNN; both without head tilt correction), and our model (with correction), evaluating the impact of head tilt correction via the vision transformer strabismus screening network through 5-fold cross-validation.

Results

The model achieved exceptional performance across datasets: on the 5-fold cross-validation set, it recorded a mean precision of 1.000 (95% CI 1.000‐1.000), recall of 1.000 (95% CI 1.000‐1.000), mAP50 of 0.995 (95% CI 0.995‐0.995), and mAP95 of 0.893 (95% CI 0.870‐0.918); on the internal independent test set, precision and recall were 1.000, with mAP50 of 0.995 and mAP95 of 0.801; and on the external cross-population test set, precision and recall were 1.000, with mAP50 of 0.937 and mAP95 of 0.792. The control experiment reduced image preparation time from 10 hours for manual cropping of 900 photos to 30 seconds with the automated model. Downstream strabismus screening task validation showed our model (with head tilt correction) achieving an area under the curve of 0.917 (95% CI 0.901‐0.933), surpassing Dlib-toolkit and faster R-CNN (both without head tilt correction) with an area under the curve of 0.856 ( P =.02) and 0.884 ( P =.05), respectively. Heatmaps highlighted core ocular focus, aligning with head tilt directions.

Conclusions

This study delivers an AI-driven platform featuring a preprocessing algorithm that automates eye region cropping, correcting head tilt variations to improve image quality for AI development and clinical use. Integrated with electronic archives and patient-physician interaction, it enhances workflow efficiency, ensures telemedicine privacy, and supports ophthalmological research and strabismus care.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Deep LearningStrabismusPhotographyImage Processing, Computer-AssistedEyeHumansWorkflowCross-Sectional StudiesAlgorithmsRetrospective StudiesProspective StudiesMaleFemaleAdultMiddle Aged

Stichwörter der Autor:innen

AI management systemartificial intelligenceclinical workflowimage preprocessingocular alignment

Autor:innen und Institutionen

  • Department of Ophthalmology, West China Hospital, Sichuan University, 37 Guoxue Xiang (Alley), Chengdu, Sichuan Province, 610041, China, 86 18980601759.
  • Machine Intelligence Laboratory, College of Computer Science, Sichuan University, Chengdu, 610041, China.

Zitieren

APA

Wu, D., Li, Y., Yang, Z., Yin, T., Chen, X., Liu, J., Shang, W., Xie, B., Yang, G., Zhang, H., & Liu, L. (2025). Deep Learning–Based Precision Cropping of Eye Regions in Strabismus Photographs: Algorithm Development and Validation Study for Workflow Optimization. Journal of Medical Internet Research. https://doi.org/10.2196/74402

Vancouver

Wu D, Li Y, Yang Z, Yin T, Chen X, Liu J, et al. Deep Learning–Based Precision Cropping of Eye Regions in Strabismus Photographs: Algorithm Development and Validation Study for Workflow Optimization. Journal of Medical Internet Research. 2025. doi:10.2196/74402

BibTeX
@article{Wu2025,
  author = {Wu, Dawen and Li, Yanfei and Yang, Zeyi and Yin, Teng and Chen, Xiaohang and Liu, Jingyu and Shang, Wenyi and Xie, Bin and Yang, Guoyuan and Zhang, Haixian and Liu, Longqian},
  title = {Deep Learning–Based Precision Cropping of Eye Regions in Strabismus Photographs: Algorithm Development and Validation Study for Workflow Optimization},
  journal = {Journal of Medical Internet Research},
  year = {2025},
  doi = {10.2196/74402}
}
Kostenlos starten →