EUVIMEDScopri EUVIMED
Open access

Adaptive Optics Image Analysis Using Generative AI (GPT-4) Scripting: Exploratory Study

Jeroen Aah Pas iD, Ludo C van der Zanden iD, Yoeri van Leeuwen iD, Yara Te Lechanteur iD, Carel B Hoyng iD, Thomas Theelen iD

JMIR Formative Research · 2026

DOI: 10.2196/94906 ↗

At a glance

Journal article in JMIR Formative Research, 2026. Written by Jeroen Aah Pas and 5 co-authors. Institution: Department of Ophthalmology, Radboud University Medical Center, Nijmegen, Gelderland, The Netherlands. Major MEDLINE topics: Image Processing, Computer-Assisted, Ophthalmoscopy, Optics and Photonics. 35 references. The full text is freely available in PubMed Central.

AbstractSubjectsDati bibliograficiCiteRelated studies

Abstract (original language)

Background

The availability of dedicated image analysis scripts for adaptive optics (AO)–flood illumination ophthalmoscopy (FIO) is limited, especially for large-scale measurements and analyses of nonhealthy images. This limitation highlights the need for alternative approaches to facilitate automated and scalable analysis. Large language models may help develop such scripts.

Objective

This study aimed to generate an analysis script for AO-FIO images in the R programming language using a widely available generative AI (GenAI; specifically, GPT-4) as a proof of principle for generating a functional but nonvalidated script.

Methods

GPT-4 was used to generate an R script for the analysis of AO-FIO images. The code generated by GPT-4 was fine-tuned iteratively based on trial and error, testing the script for image preprocessing and analysis using images from 4 participants, including 1 healthy individual and 3 patients with Stargardt disease. The script code was subsequently checked for errors by another researcher who was naive to previous coding, using a different test set of AO-FIO images from 4 other participants (n=1 healthy individual and n=3 patients with Stargardt disease). The cone counts from 5 AO image snippets were compared with the counts independently recorded by 2 human graders and those generated by pre-existing AO analysis software that was trained on healthy participants.

Results

After 54 iterations of instructions, a functional R script for the analysis of AO-FIO images was generated. The script identified and quantified blobs.

Conclusions

We developed a preliminary nonvalidated script for cone detection in retinal AO images with support from GPT-4. Before such a script can be used in clinical research, it should undergo more fine-tuning and extensive testing. Future work should enhance the image analysis capabilities of the script and validate its results to assess the potential of AO-based cone counts as biomarkers in clinical trials.

Subjects

MeSH terms (MEDLINE)

Image Processing, Computer-AssistedOphthalmoscopyOptics and PhotonicsHumansGenerative Artificial IntelligenceLarge Language ModelsStargardt Disease

Author keywords

Stargardt diseaseadaptive opticsgenerative AIgenerative artificial intelligenceimagingretina

Authors and institutions

  • Department of Ophthalmology, Radboud University Medical Center, Nijmegen, Gelderland, The Netherlands.
  • Donders Institute for Brain, Cognition and Behaviour, Nijmegen, Gelderland, The Netherlands.

ORCID profiles: Jeroen Aah Pas, Ludo C van der Zanden, Yoeri van Leeuwen, Yara Te Lechanteur, Carel B Hoyng, Thomas Theelen

Cite

APA

Pas, J. A., van der Zanden, L. C., van Leeuwen, Y., Lechanteur, Y. T., Hoyng, C. B., & Theelen, T. (2026). Adaptive Optics Image Analysis Using Generative AI (GPT-4) Scripting: Exploratory Study. JMIR Formative Research. https://doi.org/10.2196/94906

Vancouver

Pas JA, van der Zanden LC, van Leeuwen Y, Lechanteur YT, Hoyng CB, Theelen T. Adaptive Optics Image Analysis Using Generative AI (GPT-4) Scripting: Exploratory Study. JMIR Formative Research. 2026. doi:10.2196/94906

BibTeX
@article{Pas2026,
  author = {Pas, Jeroen Aah and van der Zanden, Ludo C and van Leeuwen, Yoeri and Lechanteur, Yara Te and Hoyng, Carel B and Theelen, Thomas},
  title = {Adaptive Optics Image Analysis Using Generative AI (GPT-4) Scripting: Exploratory Study},
  journal = {JMIR Formative Research},
  year = {2026},
  doi = {10.2196/94906}
}
Start for free →