EUVIMEDEUVIMED entdecken
Crossref

TTAGaze: Self-Supervised Test-Time Adaptation for Personalized Gaze Estimation

Yong Wu, Guang CHen, Linwei Ye, Yuanning Jia, Zhi Liu, Yang Wang

IEEE Transactions on Circuits and Systems for Video Technology · 2024-11 · 34 (11) · 10959-10971

DOI: 10.1109/tcsvt.2024.3412243 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-11. Verfasst von Yong Wu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 61 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Shanghai Rising Star Program, Natural Science Foundation of Zhejiang Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this paper, we address the problem of personalized gaze estimation. Due to the anatomical differences between individuals, current personalized gaze models often rely on fine-tuning or fully-supervised methods with labeled calibration samples, which may not be practical in real-world applications. To tackle this limitation, we propose an approach called Self-Supervised Test-Time Adaptation for Personalized Gaze Estimation (TTAGaze), which enables adaptation with small unlabeled data at test time. Our goal is to develop a gaze estimation model specifically adapted to a target person using only a few unlabeled images. We call this setting as unsupervised few-shot personalized adaptation in gaze estimation, which is more aligned with real-world scenarios compared to existing approaches. Additionally, Our approach leverages self-supervised learning and meta-learning. The model consists of the main task (gaze estimation) and a self-supervised auxiliary task. During training, the two task are trained using a coupled method. At test time, adaptation is achieved by optimizing the self-supervised loss adapted to an unseen person with a few unlabeled data. The model parameters are learned via model-agnostic meta-learning (MAML) to facilitate effective unsupervised few-shot personalized adaptation in gaze estimation. Experimental results demonstrate that the proposed method outperforms alternative approaches on several widely-used benchmark datasets.

Förderung

  • National Natural Science Foundation of China
  • Shanghai Rising Star Program
  • Natural Science Foundation of Zhejiang Province

Zitieren

APA

Wu, Y., CHen, G., Ye, L., Jia, Y., Liu, Z., & Wang, Y. (2024). TTAGaze: Self-Supervised Test-Time Adaptation for Personalized Gaze Estimation. IEEE Transactions on Circuits and Systems for Video Technology, 34(11), 10959-10971. https://doi.org/10.1109/tcsvt.2024.3412243

Vancouver

Wu Y, CHen G, Ye L, Jia Y, Liu Z, Wang Y. TTAGaze: Self-Supervised Test-Time Adaptation for Personalized Gaze Estimation. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(11):10959-10971. doi:10.1109/tcsvt.2024.3412243

BibTeX
@article{Wu2024,
  author = {Wu, Yong and CHen, Guang and Ye, Linwei and Jia, Yuanning and Liu, Zhi and Wang, Yang},
  title = {TTAGaze: Self-Supervised Test-Time Adaptation for Personalized Gaze Estimation},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2024},
  volume = {34},
  number = {11},
  pages = {10959--10971},
  doi = {10.1109/tcsvt.2024.3412243}
}
Kostenlos starten →