EUVIMEDScopri EUVIMED
Crossref

A transformer‐based patient‐agnostic tumor motion tracking model (TransTracking): A feasibility study in radiotherapy for lung cancer

Maidina Abuduxiku, Ningning Chai, Xiaoyan An, Yazhou Li, Jian Wang, Ying Luo, Wei Wu, Yinuo Liu, Yang Hu, Qiang Li, Pengbo He

Medical Physics · 2026

DOI: 10.1002/mp.70449 ↗

At a glance

Journal article in Medical Physics, 2026. Written by Maidina Abuduxiku and 10 co-authors. Institution: Institute of Modern Physics, Chinese Academy of Sciences, Lanzhou, China. Major MEDLINE topics: Lung Neoplasms, Radiotherapy, Image-Guided, Image Processing, Computer-Assisted. 40 references. Funded by: National Natural Science Foundation of China, Key Research and Development Program of Gansu Province, Natural Science Foundation of Gansu Province.

AbstractSubjectsDati bibliograficiCiteRelated studies

Abstract (original language)

Background

Accurate and real‐time localization of thoracic tumor targets is essential for effective radiation therapy. Recently, Transformer architectures have demonstrated strong global reasoning capabilities across multiple frames by leveraging both self‐attention and cross‐attention mechanisms. Transformers have therefore been applied to object tracking with great success. By combining Image Guided Radiation Therapy (IGRT) technologies and deep learning‐based object tracking architecture, it is possible to deliver radiation doses to the target area with high accuracy.

Purpose

This study develops a transformer‐based patient‐agnostic tracking model (TransTracking) for surface and markerless internal target tracking in thoracic tumor radiotherapy.

Methods

We trained the TransTracking model using the training splits of publicly available object tracking datasets. Subsequently, for internal target tracking, the model is fine‐tuned using 10,000 digitally reconstructed radiograph (DRR) images generated from the actual 4DCT datasets of 25 patients. The DRR images are annotated with bounding boxes of the moving tumor. Our method learns to directly predict the target classification and bounding‐box regression weights through end‐to‐end training, enabling accurate target localization in each frame for both surface and internal target tracking sequences. The tracking performance of the trained model was evaluated in 20 volunteers for surface tracking and using DRR images generated from 20 4DCT datasets for internal tumor tracking. To address the limited availability of medical images for training, we conducted the data augmentation procedure to 4DCT datasets and expanded the data scale 40‐fold in total.

Results

For the surface marker tracking, the mean absolute deviation (MAD) ± standard deviation (SD) between the model‐predicted and the actual positions for 20 volunteers was 0.07 ± 0.06 mm, 0.12 ± 0.13 mm, and 0.29 ± 0.20 mm in left‐right, superior‐inferior, and anterior‐posterior directions, respectively. In each directional axis, over 85% of frames exhibited a model‐predicted target position within 0.5 mm of the corresponding ground‐truth position. For the internal tumor tracking, the MAD ± SD between the predicted and annotated center positions of the tumor bounding boxes is 1.49 ± 1.39 mm, with a mean Intersection over Union (IoU) value of 0.83 and an area under curve (AUC) score of 82% for 20 patients. Additionally, our transformer‐based model can extract the target position in 81 ms after an image is acquired.

Conclusions

This study proposed a novel Transformer‐based deep learning method aimed at training a patient‐agnostic tumor motion tracking model in radiotherapy. The model enables real‐time, high‐precision tracking of surface markers using vision cameras, offering a cost‐effective and compact solution. Additionally, we demonstrated that our method can accurately locate tumor target areas in DRR images with high precision, without the need for individualized training or the implantation of fiducial markers. This feasibility study demonstrates the strong potential of our strategy as a clinically viable solution for moving tumor IGRT.

Subjects

MeSH terms (MEDLINE)

Lung NeoplasmsRadiotherapy, Image-GuidedImage Processing, Computer-AssistedHumansFeasibility StudiesMovementFour-Dimensional Computed TomographyDeep LearningMotion Capture

Author keywords

deep learningmarker‐less trackingmotion monitoringradiotherapysurface tracking

Authors and institutions

  • Institute of Modern Physics, Chinese Academy of Sciences, Lanzhou, China.
  • Key Laboratory of Heavy Ion Radiation Biology and Medicine of Chinese Academy of Sciences, Lanzhou, China.
  • Key Laboratory of Basic Research on Heavy Ion Radiation Application in Medicine, Gansu Province, Lanzhou, China.
  • University of Chinese Academy of Sciences, Beijing, China.
  • Department of Nuclear Medicine, Xijing Hospital, Fourth Military Medical University, Xi'an, China.
  • College of Future Technology, Xi'an Jiaotong University, Xian, China.

Funding

  • National Natural Science Foundation of China
  • Key Research and Development Program of Gansu Province
  • Natural Science Foundation of Gansu Province
  • Youth Innovation Promotion Association, Chinese Academy of Sciences
  • Youth Innovation Promotion Association of the Chinese Academy of Sciences

Cite

APA

Abuduxiku, M., Chai, N., An, X., Li, Y., Wang, J., Luo, Y., Wu, W., Liu, Y., Hu, Y., Li, Q., & He, P. (2026). A transformer‐based patient‐agnostic tumor motion tracking model (TransTracking): A feasibility study in radiotherapy for lung cancer. Medical Physics. https://doi.org/10.1002/mp.70449

Vancouver

Abuduxiku M, Chai N, An X, Li Y, Wang J, Luo Y, et al. A transformer‐based patient‐agnostic tumor motion tracking model (TransTracking): A feasibility study in radiotherapy for lung cancer. Medical Physics. 2026. doi:10.1002/mp.70449

BibTeX
@article{Abuduxiku2026,
  author = {Abuduxiku, Maidina and Chai, Ningning and An, Xiaoyan and Li, Yazhou and Wang, Jian and Luo, Ying and Wu, Wei and Liu, Yinuo and Hu, Yang and Li, Qiang and He, Pengbo},
  title = {A transformer‐based patient‐agnostic tumor motion tracking model (TransTracking): A feasibility study in radiotherapy for lung cancer},
  journal = {Medical Physics},
  year = {2026},
  doi = {10.1002/mp.70449}
}
Start for free →