Quantifying dwell time with location-based augmented reality: Dynamic AOI analysis on mobile eye tracking data with vision transformer
Journal of Eye Movement Research · 29.04.2024 · 17 (3)
DOI: 10.16910/jemr.17.3.3 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Eye Movement Research, online erschienen am 29.04.2024. Verfasst von Julien Mercier und 2 weiteren Autor:innen. Beteiligte Einrichtung: MEI, School of Engineering and Management Vaud, HES-SO, Switzerland. Die Arbeit wurde bisher 18-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Mobile eye tracking captures egocentric vision and is well-suited for naturalistic studies. However, its data is noisy, especially when acquired outdoor with multiple participants over several sessions. Area of interest analysis on moving targets is difficult because A) camera and objects move nonlinearly and may disappear/reappear from the scene; and B) off-the-shelf analysis tools are limited to linearly moving objects. As a result, researchers resort to time-consuming manual annotation, which limits the use of mobile eye tracking in naturalistic studies. We introduce a method based on a fine-tuned Vision Transformer (ViT) model for classifying frames with overlaying gaze markers. After fine-tuning a model on a manually labelled training set made of 1.98% (=7845 frames) of our entire data for three epochs, our model reached 99.34% accuracy as evaluated on hold-out data. We used the method to quantify participants’ dwell time on a tablet during the outdoor user test of a mobile augmented reality application for biodiversity education. We discuss the benefits and limitations of our approach and its potential to be applied to other contexts.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- MEI, School of Engineering and Management Vaud, HES-SO, Switzerland.
- Lab-STICC, UMR 6285, CNRS, Université Bretagne Sud, Vannes, France.
Zitieren
APA
Mercier, J., Ertz, O., & Bocher, E. (2024). Quantifying dwell time with location-based augmented reality: Dynamic AOI analysis on mobile eye tracking data with vision transformer. Journal of Eye Movement Research, 17(3). https://doi.org/10.16910/jemr.17.3.3
Vancouver
Mercier J, Ertz O, Bocher E. Quantifying dwell time with location-based augmented reality: Dynamic AOI analysis on mobile eye tracking data with vision transformer. Journal of Eye Movement Research. 2024;17(3). doi:10.16910/jemr.17.3.3
BibTeX
@article{Mercier2024,
author = {Mercier, Julien and Ertz, Olivier and Bocher, Erwan},
title = {Quantifying dwell time with location-based augmented reality: Dynamic AOI analysis on mobile eye tracking data with vision transformer},
journal = {Journal of Eye Movement Research},
year = {2024},
volume = {17},
number = {3},
doi = {10.16910/jemr.17.3.3}
}
EUVIMED