GazeSymCAT: A symmetric cross-attention transformer for robust gaze estimation under extreme head poses and gaze variations
Journal of Computational Design and Engineering · 03.03.2025 · 12 (3) · 115-129
DOI: 10.1093/jcde/qwaf017 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Computational Design and Engineering, online erschienen am 06.02.2025. Verfasst von Yupeng Zhong und 1 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: National Research Foundation of Korea, MSIT.
Abstract (Originalsprache)
With the rapid advancement of artificial intelligence, research on deep neural networks for estimating gaze from facial images captured by cameras has grown significantly. However, gaze estimation remains challenging due to the diversity of facial features, variability in head posture, partial occlusion, varying lighting conditions, eye image quality, complex eye movements, and a lack of large-scale, diverse data sets. Particularly, estimating a driver's gaze while driving a vehicle is difficult due to occlusion of the eyes when checking mirrors or turning the head to view blind spots and surroundings. To address these issues, we developed an appearance-based gaze estimation neural network based on attention, called GazeSymCAT (symmetric cross-attention transformer for gaze estimation). The proposed GazeSymCAT obtains contextual information that reflects the relationships among the extracted facial and eye image features through an encoder–decoder structure composed of self- and cross-attention layers of the transformer. This structure is followed by adding fully connected layers that estimate the gaze direction. The model proposed in this study was tested on the ETH-XGaze data set, a large-scale, state-of-the-art (SOTA) data set that includes extreme head postures, achieving SOTA performance. Additionally, it demonstrated SOTA-comparable performance on existing general gaze estimation-related data sets, MPIIFaceGaze and EYEDIAP.
Förderung
- National Research Foundation of Korea
- MSIT
Zitieren
APA
Zhong, Y., & Lee, S. H. (2025). GazeSymCAT: A symmetric cross-attention transformer for robust gaze estimation under extreme head poses and gaze variations. Journal of Computational Design and Engineering, 12(3), 115-129. https://doi.org/10.1093/jcde/qwaf017
Vancouver
Zhong Y, Lee SH. GazeSymCAT: A symmetric cross-attention transformer for robust gaze estimation under extreme head poses and gaze variations. Journal of Computational Design and Engineering. 2025;12(3):115-129. doi:10.1093/jcde/qwaf017
BibTeX
@article{Zhong2025,
author = {Zhong, Yupeng and Lee, Sang Hun},
title = {GazeSymCAT: A symmetric cross-attention transformer for robust gaze estimation under extreme head poses and gaze variations},
journal = {Journal of Computational Design and Engineering},
year = {2025},
volume = {12},
number = {3},
pages = {115--129},
doi = {10.1093/jcde/qwaf017}
}
EUVIMED