Adaptive Optics Image Analysis Using Generative AI (GPT-4) Scripting: Exploratory Study
JMIR Formative Research · 2026
DOI: 10.2196/94906 ↗Kurz gefasst
Fachartikel in der Zeitschrift JMIR Formative Research, 2026. Verfasst von Jeroen Aah Pas und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Ophthalmology, Radboud University Medical Center, Nijmegen, Gelderland, The Netherlands. Hauptthemen laut MEDLINE: Image Processing, Computer-Assisted, Ophthalmoscopy, Optics and Photonics. Die Arbeit nennt 35 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
The availability of dedicated image analysis scripts for adaptive optics (AO)–flood illumination ophthalmoscopy (FIO) is limited, especially for large-scale measurements and analyses of nonhealthy images. This limitation highlights the need for alternative approaches to facilitate automated and scalable analysis. Large language models may help develop such scripts.
Objective
This study aimed to generate an analysis script for AO-FIO images in the R programming language using a widely available generative AI (GenAI; specifically, GPT-4) as a proof of principle for generating a functional but nonvalidated script.
Methods
GPT-4 was used to generate an R script for the analysis of AO-FIO images. The code generated by GPT-4 was fine-tuned iteratively based on trial and error, testing the script for image preprocessing and analysis using images from 4 participants, including 1 healthy individual and 3 patients with Stargardt disease. The script code was subsequently checked for errors by another researcher who was naive to previous coding, using a different test set of AO-FIO images from 4 other participants (n=1 healthy individual and n=3 patients with Stargardt disease). The cone counts from 5 AO image snippets were compared with the counts independently recorded by 2 human graders and those generated by pre-existing AO analysis software that was trained on healthy participants.
Results
After 54 iterations of instructions, a functional R script for the analysis of AO-FIO images was generated. The script identified and quantified blobs.
Conclusions
We developed a preliminary nonvalidated script for cone detection in retinal AO images with support from GPT-4. Before such a script can be used in clinical research, it should undergo more fine-tuning and extensive testing. Future work should enhance the image analysis capabilities of the script and validate its results to assess the potential of AO-based cone counts as biomarkers in clinical trials.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Ophthalmology, Radboud University Medical Center, Nijmegen, Gelderland, The Netherlands.
- Donders Institute for Brain, Cognition and Behaviour, Nijmegen, Gelderland, The Netherlands.
ORCID-Profile: Jeroen Aah Pas, Ludo C van der Zanden, Yoeri van Leeuwen, Yara Te Lechanteur, Carel B Hoyng, Thomas Theelen
Zitieren
APA
Pas, J. A., van der Zanden, L. C., van Leeuwen, Y., Lechanteur, Y. T., Hoyng, C. B., & Theelen, T. (2026). Adaptive Optics Image Analysis Using Generative AI (GPT-4) Scripting: Exploratory Study. JMIR Formative Research. https://doi.org/10.2196/94906
Vancouver
Pas JA, van der Zanden LC, van Leeuwen Y, Lechanteur YT, Hoyng CB, Theelen T. Adaptive Optics Image Analysis Using Generative AI (GPT-4) Scripting: Exploratory Study. JMIR Formative Research. 2026. doi:10.2196/94906
BibTeX
@article{Pas2026,
author = {Pas, Jeroen Aah and van der Zanden, Ludo C and van Leeuwen, Yoeri and Lechanteur, Yara Te and Hoyng, Carel B and Theelen, Thomas},
title = {Adaptive Optics Image Analysis Using Generative AI (GPT-4) Scripting: Exploratory Study},
journal = {JMIR Formative Research},
year = {2026},
doi = {10.2196/94906}
}
EUVIMED