EUVIMEDEUVIMED entdecken
Open Access

OPT‐former: A transformer‐based approach for eye motion tracking in ocular proton therapy

Celeste Pinori, Gabriele Ariata, Maksym Hladchuk, Andrea Pella, Maria Rosaria Fiore, Giuseppe Magro, Chiara Paganelli, Agnieszka Chalaszczyk, Marco Rotondi, Mario Ciocca, Guido Baron

Medical Physics · 2026-08 · 53 (8)

DOI: 10.1002/mp.70526 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Medical Physics, online erschienen am 13.08.2026. Verfasst von Celeste Pinori und 10 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electronics, Information and Bioengineering, Politecnico di Milano University, Milan, Italy. Hauptthemen laut MEDLINE: Proton Therapy, Eye-Tracking Technology, Eye Movements, Image Processing, Computer-Assisted. Die Arbeit nennt 26 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: CNAO Foundation (Pavia, Italy).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Ocular proton therapy (OPT) is the main conservative treatment option for ocular melanoma but requires precise gaze stability monitoring during irradiation. In current clinical workflows at the Centro Nazionale di Adroterapia Oncologica (CNAO) in Pavia, this task is performed manually by trained operators, which can introduce reaction delays and human error.

Purpose

To propose and assess the performance of OPT‐former , a transformer‐based method for real‐time segmentation of the iris and pupil, designed for integration into automated safety interlock systems.

Methods

The model, inspired by the MedFormer architecture, performs direct three‐class segmentation (background, iris, pupil) on 256 × 256 images acquired by CNAO's Eye Tracking System. A dataset of 1683 frames from 173 patients was split into independent training (1349 frames), validation (110 frames), and testing (224 frames) sets. Data augmentation was applied to increase variability, resulting in 3902 training images. Performance was evaluated using Intersection over Union (IoU), Dice coefficient, and Szymkiewicz–Simpson coefficient (SSC), assessing the OPT‐former performance and comparing them with a previously proposed 3‐step U‐Net and manual expert segmentations. Patient‐specific fine‐tuning was implemented using pre‐treatment dry‐run session videos.

Results

The OPT‐former achieved segmentation accuracy comparable to the 3‐step U‐Net , but with substantially lower inference times (8.62 Hz on GPU vs. 3.26 Hz), enabling near frame‐by‐frame real‐time analysis. Patient‐specific fine‐tuning significantly improved all metrics for both structures ( p < 0.05), with the largest gains for the iris. After fine‐tuning, the model outperformed manual annotations from two experts under simulated clinical conditions.

Conclusions

The proposed OPT‐former achieves high segmentation accuracy, with reduced pipeline complexity and inference time suitable for clinical application. These results endorse its role as a robust support tool in clinical practice, seamlessly integrating into established workflows without impacting the consolidated routine, and enabling automated gaze monitoring and real‐time safety interlock activation in OPT.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Proton TherapyEye-Tracking TechnologyEye MovementsImage Processing, Computer-AssistedEye NeoplasmsHumansMelanoma

Stichwörter der Autor:innen

eye segmentationeye‐tracking systemmedical image segmentationocular proton therapyvision transformers

Autor:innen und Institutionen

  • Department of Electronics, Information and Bioengineering, Politecnico di Milano University, Milan, Italy.
  • Bioengineering Unit, Clinical Department, National Center for Oncological Hadrontherapy (CNAO), Pavia, Italy.
  • Radiotherapy Unit, Clinical Department, National Center for Oncological Hadrontherapy (CNAO), Pavia, Italy.
  • Medical Physics Unit, Clinical Department, National Center for Oncological Hadrontherapy (CNAO), Pavia, Italy.

Förderung

  • CNAO Foundation (Pavia, Italy)

Zitieren

APA

Pinori, C., Ariata, G., Hladchuk, M., Pella, A., Fiore, M. R., Magro, G., Paganelli, C., Chalaszczyk, A., Rotondi, M., Ciocca, M., & Baron, G. (2026). OPT‐former: A transformer‐based approach for eye motion tracking in ocular proton therapy. Medical Physics, 53(8). https://doi.org/10.1002/mp.70526

Vancouver

Pinori C, Ariata G, Hladchuk M, Pella A, Fiore MR, Magro G, et al. OPT‐former: A transformer‐based approach for eye motion tracking in ocular proton therapy. Medical Physics. 2026;53(8). doi:10.1002/mp.70526

BibTeX
@article{Pinori2026,
  author = {Pinori, Celeste and Ariata, Gabriele and Hladchuk, Maksym and Pella, Andrea and Fiore, Maria Rosaria and Magro, Giuseppe and Paganelli, Chiara and Chalaszczyk, Agnieszka and Rotondi, Marco and Ciocca, Mario and Baron, Guido},
  title = {OPT‐former: A transformer‐based approach for eye motion tracking in ocular proton therapy},
  journal = {Medical Physics},
  year = {2026},
  volume = {53},
  number = {8},
  doi = {10.1002/mp.70526}
}
Kostenlos starten →