EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

eyeNotate: Interactive Annotation of Mobile Eye Tracking Data Based on Few-Shot Image Classification

Michael Barz iD, Omair Shahzad Bhatti iD, Hasan Md Tusfiqur Alam iD, Duy Minh Ho Nguyen iD, Kristin Altmeyer iD, Sarah Malone iD, Daniel Sonntag iD

Journal of Eye Movement Research · 07.07.2025 · 18 (4) · 27

DOI: 10.3390/jemr18040027 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Eye Movement Research, online erschienen am 07.07.2025. Verfasst von Michael Barz und 6 weiteren Autor:innen. Beteiligte Einrichtung: Interactive Machine Learning, German Research Center for Artificial Intelligence (DFKI), 66123 Saarbrücken, Germany; omair_shahzad.bhatti@dfki.de (O.…. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 87 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Union, German Federal Ministry of Education and Research (BMBF).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Mobile eye tracking is an important tool in psychology and human-centered interaction design for understanding how people process visual scenes and user interfaces. However, analyzing recordings from head-mounted eye trackers, which typically include an egocentric video of the scene and a gaze signal, is a time-consuming and largely manual process. To address this challenge, we develop eyeNotate, a web-based annotation tool that enables semi-automatic data annotation and learns to improve from corrective user feedback. Users can manually map fixation events to areas of interest (AOIs) in a video-editing-style interface (baseline version). Further, our tool can generate fixation-to-AOI mapping suggestions based on a few-shot image classification model (IML-support version). We conduct an expert study with trained annotators (n = 3) to compare the baseline and IML-support versions. We measure the perceived usability, annotations’ validity and reliability, and efficiency during a data annotation task. We asked our participants to re-annotate data from a single individual using an existing dataset (n = 48). Further, we conducted a semi-structured interview to understand how participants used the provided IML features and assessed our design decisions. In a post hoc experiment, we investigate the performance of three image classification models in annotating data of the remaining 47 individuals.

Schlagwörter

Stichwörter der Autor:innen

area of interest (AOI)eye trackingeye tracking data analysisfixation-to-AOI mappinginteractive machine learningmobile eye trackingvisual attention

Autor:innen und Institutionen

  • Interactive Machine Learning, German Research Center for Artificial Intelligence (DFKI), 66123 Saarbrücken, Germany; omair_shahzad.bhatti@dfki.de (O.S.B.); hasan_md_tusfiqur.alam@dfki.de (H.M.T.A.); ho_minh_duy.nguyen@d…
  • Applied Artificial Intelligence, University of Oldenburg, 26129 Oldenburg, Germany.
  • Machine Learning and Simulation Science Department, University of Stuttgart, 70569 Stuttgart, Germany.
  • Max Planck Research School for Intelligent Systems (IMPRS-IS), 70569 Stuttgart, Germany.
  • Department of Education, Saarland University, 66123 Saarbrücken, Germany; kristin.altmeyer@uni-saarland.de (K.A.); s.malone@mx.uni-saarland.de (S.M.).

ORCID-Profile: Michael Barz, Omair Shahzad Bhatti, Hasan Md Tusfiqur Alam, Duy Minh Ho Nguyen, Kristin Altmeyer, Sarah Malone, Daniel Sonntag

Förderung

  • European Union
  • German Federal Ministry of Education and Research (BMBF)

Zitieren

APA

Barz, M., Bhatti, O. S., Alam, H. M. T., Nguyen, D. M. H., Altmeyer, K., Malone, S., & Sonntag, D. (2025). eyeNotate: Interactive Annotation of Mobile Eye Tracking Data Based on Few-Shot Image Classification. Journal of Eye Movement Research, 18(4), 27. https://doi.org/10.3390/jemr18040027

Vancouver

Barz M, Bhatti OS, Alam HMT, Nguyen DMH, Altmeyer K, Malone S, et al. eyeNotate: Interactive Annotation of Mobile Eye Tracking Data Based on Few-Shot Image Classification. Journal of Eye Movement Research. 2025;18(4):27. doi:10.3390/jemr18040027

BibTeX
@article{Barz2025,
  author = {Barz, Michael and Bhatti, Omair Shahzad and Alam, Hasan Md Tusfiqur and Nguyen, Duy Minh Ho and Altmeyer, Kristin and Malone, Sarah and Sonntag, Daniel},
  title = {eyeNotate: Interactive Annotation of Mobile Eye Tracking Data Based on Few-Shot Image Classification},
  journal = {Journal of Eye Movement Research},
  year = {2025},
  volume = {18},
  number = {4},
  pages = {27},
  doi = {10.3390/jemr18040027}
}
Kostenlos starten →