OPT‐former: A transformer‐based approach for eye motion tracking in ocular proton therapy
Medical Physics · 2026-08 · 53 (8)
DOI: 10.1002/mp.70526 ↗Kurz gefasst
Fachartikel in der Zeitschrift Medical Physics, online erschienen am 13.08.2026. Verfasst von Celeste Pinori und 10 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electronics, Information and Bioengineering, Politecnico di Milano University, Milan, Italy. Hauptthemen laut MEDLINE: Proton Therapy, Eye-Tracking Technology, Eye Movements, Image Processing, Computer-Assisted. Die Arbeit nennt 26 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: CNAO Foundation (Pavia, Italy).
Abstract (Originalsprache)
Background
Ocular proton therapy (OPT) is the main conservative treatment option for ocular melanoma but requires precise gaze stability monitoring during irradiation. In current clinical workflows at the Centro Nazionale di Adroterapia Oncologica (CNAO) in Pavia, this task is performed manually by trained operators, which can introduce reaction delays and human error.
Purpose
To propose and assess the performance of OPT‐former , a transformer‐based method for real‐time segmentation of the iris and pupil, designed for integration into automated safety interlock systems.
Methods
The model, inspired by the MedFormer architecture, performs direct three‐class segmentation (background, iris, pupil) on 256 × 256 images acquired by CNAO's Eye Tracking System. A dataset of 1683 frames from 173 patients was split into independent training (1349 frames), validation (110 frames), and testing (224 frames) sets. Data augmentation was applied to increase variability, resulting in 3902 training images. Performance was evaluated using Intersection over Union (IoU), Dice coefficient, and Szymkiewicz–Simpson coefficient (SSC), assessing the OPT‐former performance and comparing them with a previously proposed 3‐step U‐Net and manual expert segmentations. Patient‐specific fine‐tuning was implemented using pre‐treatment dry‐run session videos.
Results
The OPT‐former achieved segmentation accuracy comparable to the 3‐step U‐Net , but with substantially lower inference times (8.62 Hz on GPU vs. 3.26 Hz), enabling near frame‐by‐frame real‐time analysis. Patient‐specific fine‐tuning significantly improved all metrics for both structures ( p < 0.05), with the largest gains for the iris. After fine‐tuning, the model outperformed manual annotations from two experts under simulated clinical conditions.
Conclusions
The proposed OPT‐former achieves high segmentation accuracy, with reduced pipeline complexity and inference time suitable for clinical application. These results endorse its role as a robust support tool in clinical practice, seamlessly integrating into established workflows without impacting the consolidated routine, and enabling automated gaze monitoring and real‐time safety interlock activation in OPT.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electronics, Information and Bioengineering, Politecnico di Milano University, Milan, Italy.
- Bioengineering Unit, Clinical Department, National Center for Oncological Hadrontherapy (CNAO), Pavia, Italy.
- Radiotherapy Unit, Clinical Department, National Center for Oncological Hadrontherapy (CNAO), Pavia, Italy.
- Medical Physics Unit, Clinical Department, National Center for Oncological Hadrontherapy (CNAO), Pavia, Italy.
Förderung
- CNAO Foundation (Pavia, Italy)
Zitieren
APA
Pinori, C., Ariata, G., Hladchuk, M., Pella, A., Fiore, M. R., Magro, G., Paganelli, C., Chalaszczyk, A., Rotondi, M., Ciocca, M., & Baron, G. (2026). OPT‐former: A transformer‐based approach for eye motion tracking in ocular proton therapy. Medical Physics, 53(8). https://doi.org/10.1002/mp.70526
Vancouver
Pinori C, Ariata G, Hladchuk M, Pella A, Fiore MR, Magro G, et al. OPT‐former: A transformer‐based approach for eye motion tracking in ocular proton therapy. Medical Physics. 2026;53(8). doi:10.1002/mp.70526
BibTeX
@article{Pinori2026,
author = {Pinori, Celeste and Ariata, Gabriele and Hladchuk, Maksym and Pella, Andrea and Fiore, Maria Rosaria and Magro, Giuseppe and Paganelli, Chiara and Chalaszczyk, Agnieszka and Rotondi, Marco and Ciocca, Mario and Baron, Guido},
title = {OPT‐former: A transformer‐based approach for eye motion tracking in ocular proton therapy},
journal = {Medical Physics},
year = {2026},
volume = {53},
number = {8},
doi = {10.1002/mp.70526}
}
EUVIMED