EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Quantifying dwell time with location-based augmented reality: Dynamic AOI analysis on mobile eye tracking data with vision transformer

Julien Mercier, Olivier Ertz, Erwan Bocher

Journal of Eye Movement Research · 29.04.2024 · 17 (3)

DOI: 10.16910/jemr.17.3.3 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Eye Movement Research, online erschienen am 29.04.2024. Verfasst von Julien Mercier und 2 weiteren Autor:innen. Beteiligte Einrichtung: MEI, School of Engineering and Management Vaud, HES-SO, Switzerland. Die Arbeit wurde bisher 18-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Mobile eye tracking captures egocentric vision and is well-suited for naturalistic studies. However, its data is noisy, especially when acquired outdoor with multiple participants over several sessions. Area of interest analysis on moving targets is difficult because A) camera and objects move nonlinearly and may disappear/reappear from the scene; and B) off-the-shelf analysis tools are limited to linearly moving objects. As a result, researchers resort to time-consuming manual annotation, which limits the use of mobile eye tracking in naturalistic studies. We introduce a method based on a fine-tuned Vision Transformer (ViT) model for classifying frames with overlaying gaze markers. After fine-tuning a model on a manually labelled training set made of 1.98% (=7845 frames) of our entire data for three epochs, our model reached 99.34% accuracy as evaluated on hold-out data. We used the method to quantify participants’ dwell time on a tablet during the outdoor user test of a mobile augmented reality application for biodiversity education. We discuss the benefits and limitations of our approach and its potential to be applied to other contexts.

Schlagwörter

Stichwörter der Autor:innen

Dwell TimeDynamic Area of InterestEducational TechnologyFrame-byframe analysisLocation-based Augmented RealityMobile Eye Tracking MethodologyVision Transformer

Autor:innen und Institutionen

  • MEI, School of Engineering and Management Vaud, HES-SO, Switzerland.
  • Lab-STICC, UMR 6285, CNRS, Université Bretagne Sud, Vannes, France.

Zitieren

APA

Mercier, J., Ertz, O., & Bocher, E. (2024). Quantifying dwell time with location-based augmented reality: Dynamic AOI analysis on mobile eye tracking data with vision transformer. Journal of Eye Movement Research, 17(3). https://doi.org/10.16910/jemr.17.3.3

Vancouver

Mercier J, Ertz O, Bocher E. Quantifying dwell time with location-based augmented reality: Dynamic AOI analysis on mobile eye tracking data with vision transformer. Journal of Eye Movement Research. 2024;17(3). doi:10.16910/jemr.17.3.3

BibTeX
@article{Mercier2024,
  author = {Mercier, Julien and Ertz, Olivier and Bocher, Erwan},
  title = {Quantifying dwell time with location-based augmented reality: Dynamic AOI analysis on mobile eye tracking data with vision transformer},
  journal = {Journal of Eye Movement Research},
  year = {2024},
  volume = {17},
  number = {3},
  doi = {10.16910/jemr.17.3.3}
}
Kostenlos starten →