A transformer‐based patient‐agnostic tumor motion tracking model (TransTracking): A feasibility study in radiotherapy for lung cancer
Medical Physics · 2026
DOI: 10.1002/mp.70449 ↗At a glance
Journal article in Medical Physics, 2026. Written by Maidina Abuduxiku and 10 co-authors. Institution: Institute of Modern Physics, Chinese Academy of Sciences, Lanzhou, China. Major MEDLINE topics: Lung Neoplasms, Radiotherapy, Image-Guided, Image Processing, Computer-Assisted. 40 references. Funded by: National Natural Science Foundation of China, Key Research and Development Program of Gansu Province, Natural Science Foundation of Gansu Province.
Abstract (original language)
Background
Accurate and real‐time localization of thoracic tumor targets is essential for effective radiation therapy. Recently, Transformer architectures have demonstrated strong global reasoning capabilities across multiple frames by leveraging both self‐attention and cross‐attention mechanisms. Transformers have therefore been applied to object tracking with great success. By combining Image Guided Radiation Therapy (IGRT) technologies and deep learning‐based object tracking architecture, it is possible to deliver radiation doses to the target area with high accuracy.
Purpose
This study develops a transformer‐based patient‐agnostic tracking model (TransTracking) for surface and markerless internal target tracking in thoracic tumor radiotherapy.
Methods
We trained the TransTracking model using the training splits of publicly available object tracking datasets. Subsequently, for internal target tracking, the model is fine‐tuned using 10,000 digitally reconstructed radiograph (DRR) images generated from the actual 4DCT datasets of 25 patients. The DRR images are annotated with bounding boxes of the moving tumor. Our method learns to directly predict the target classification and bounding‐box regression weights through end‐to‐end training, enabling accurate target localization in each frame for both surface and internal target tracking sequences. The tracking performance of the trained model was evaluated in 20 volunteers for surface tracking and using DRR images generated from 20 4DCT datasets for internal tumor tracking. To address the limited availability of medical images for training, we conducted the data augmentation procedure to 4DCT datasets and expanded the data scale 40‐fold in total.
Results
For the surface marker tracking, the mean absolute deviation (MAD) ± standard deviation (SD) between the model‐predicted and the actual positions for 20 volunteers was 0.07 ± 0.06 mm, 0.12 ± 0.13 mm, and 0.29 ± 0.20 mm in left‐right, superior‐inferior, and anterior‐posterior directions, respectively. In each directional axis, over 85% of frames exhibited a model‐predicted target position within 0.5 mm of the corresponding ground‐truth position. For the internal tumor tracking, the MAD ± SD between the predicted and annotated center positions of the tumor bounding boxes is 1.49 ± 1.39 mm, with a mean Intersection over Union (IoU) value of 0.83 and an area under curve (AUC) score of 82% for 20 patients. Additionally, our transformer‐based model can extract the target position in 81 ms after an image is acquired.
Conclusions
This study proposed a novel Transformer‐based deep learning method aimed at training a patient‐agnostic tumor motion tracking model in radiotherapy. The model enables real‐time, high‐precision tracking of surface markers using vision cameras, offering a cost‐effective and compact solution. Additionally, we demonstrated that our method can accurately locate tumor target areas in DRR images with high precision, without the need for individualized training or the implantation of fiducial markers. This feasibility study demonstrates the strong potential of our strategy as a clinically viable solution for moving tumor IGRT.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Institute of Modern Physics, Chinese Academy of Sciences, Lanzhou, China.
- Key Laboratory of Heavy Ion Radiation Biology and Medicine of Chinese Academy of Sciences, Lanzhou, China.
- Key Laboratory of Basic Research on Heavy Ion Radiation Application in Medicine, Gansu Province, Lanzhou, China.
- University of Chinese Academy of Sciences, Beijing, China.
- Department of Nuclear Medicine, Xijing Hospital, Fourth Military Medical University, Xi'an, China.
- College of Future Technology, Xi'an Jiaotong University, Xian, China.
Funding
- National Natural Science Foundation of China
- Key Research and Development Program of Gansu Province
- Natural Science Foundation of Gansu Province
- Youth Innovation Promotion Association, Chinese Academy of Sciences
- Youth Innovation Promotion Association of the Chinese Academy of Sciences
Cite
APA
Abuduxiku, M., Chai, N., An, X., Li, Y., Wang, J., Luo, Y., Wu, W., Liu, Y., Hu, Y., Li, Q., & He, P. (2026). A transformer‐based patient‐agnostic tumor motion tracking model (TransTracking): A feasibility study in radiotherapy for lung cancer. Medical Physics. https://doi.org/10.1002/mp.70449
Vancouver
Abuduxiku M, Chai N, An X, Li Y, Wang J, Luo Y, et al. A transformer‐based patient‐agnostic tumor motion tracking model (TransTracking): A feasibility study in radiotherapy for lung cancer. Medical Physics. 2026. doi:10.1002/mp.70449
BibTeX
@article{Abuduxiku2026,
author = {Abuduxiku, Maidina and Chai, Ningning and An, Xiaoyan and Li, Yazhou and Wang, Jian and Luo, Ying and Wu, Wei and Liu, Yinuo and Hu, Yang and Li, Qiang and He, Pengbo},
title = {A transformer‐based patient‐agnostic tumor motion tracking model (TransTracking): A feasibility study in radiotherapy for lung cancer},
journal = {Medical Physics},
year = {2026},
doi = {10.1002/mp.70449}
}
EUVIMED