eyeNotate: Interactive Annotation of Mobile Eye Tracking Data Based on Few-Shot Image Classification
Journal of Eye Movement Research · 07.07.2025 · 18 (4) · 27
DOI: 10.3390/jemr18040027 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Eye Movement Research, online erschienen am 07.07.2025. Verfasst von Michael Barz und 6 weiteren Autor:innen. Beteiligte Einrichtung: Interactive Machine Learning, German Research Center for Artificial Intelligence (DFKI), 66123 Saarbrücken, Germany; omair_shahzad.bhatti@dfki.de (O.…. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 87 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Union, German Federal Ministry of Education and Research (BMBF).
Abstract (Originalsprache)
Mobile eye tracking is an important tool in psychology and human-centered interaction design for understanding how people process visual scenes and user interfaces. However, analyzing recordings from head-mounted eye trackers, which typically include an egocentric video of the scene and a gaze signal, is a time-consuming and largely manual process. To address this challenge, we develop eyeNotate, a web-based annotation tool that enables semi-automatic data annotation and learns to improve from corrective user feedback. Users can manually map fixation events to areas of interest (AOIs) in a video-editing-style interface (baseline version). Further, our tool can generate fixation-to-AOI mapping suggestions based on a few-shot image classification model (IML-support version). We conduct an expert study with trained annotators (n = 3) to compare the baseline and IML-support versions. We measure the perceived usability, annotations’ validity and reliability, and efficiency during a data annotation task. We asked our participants to re-annotate data from a single individual using an existing dataset (n = 48). Further, we conducted a semi-structured interview to understand how participants used the provided IML features and assessed our design decisions. In a post hoc experiment, we investigate the performance of three image classification models in annotating data of the remaining 47 individuals.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Interactive Machine Learning, German Research Center for Artificial Intelligence (DFKI), 66123 Saarbrücken, Germany; omair_shahzad.bhatti@dfki.de (O.S.B.); hasan_md_tusfiqur.alam@dfki.de (H.M.T.A.); ho_minh_duy.nguyen@d…
- Applied Artificial Intelligence, University of Oldenburg, 26129 Oldenburg, Germany.
- Machine Learning and Simulation Science Department, University of Stuttgart, 70569 Stuttgart, Germany.
- Max Planck Research School for Intelligent Systems (IMPRS-IS), 70569 Stuttgart, Germany.
- Department of Education, Saarland University, 66123 Saarbrücken, Germany; kristin.altmeyer@uni-saarland.de (K.A.); s.malone@mx.uni-saarland.de (S.M.).
ORCID-Profile: Michael Barz, Omair Shahzad Bhatti, Hasan Md Tusfiqur Alam, Duy Minh Ho Nguyen, Kristin Altmeyer, Sarah Malone, Daniel Sonntag
Förderung
- European Union
- German Federal Ministry of Education and Research (BMBF)
Zitieren
APA
Barz, M., Bhatti, O. S., Alam, H. M. T., Nguyen, D. M. H., Altmeyer, K., Malone, S., & Sonntag, D. (2025). eyeNotate: Interactive Annotation of Mobile Eye Tracking Data Based on Few-Shot Image Classification. Journal of Eye Movement Research, 18(4), 27. https://doi.org/10.3390/jemr18040027
Vancouver
Barz M, Bhatti OS, Alam HMT, Nguyen DMH, Altmeyer K, Malone S, et al. eyeNotate: Interactive Annotation of Mobile Eye Tracking Data Based on Few-Shot Image Classification. Journal of Eye Movement Research. 2025;18(4):27. doi:10.3390/jemr18040027
BibTeX
@article{Barz2025,
author = {Barz, Michael and Bhatti, Omair Shahzad and Alam, Hasan Md Tusfiqur and Nguyen, Duy Minh Ho and Altmeyer, Kristin and Malone, Sarah and Sonntag, Daniel},
title = {eyeNotate: Interactive Annotation of Mobile Eye Tracking Data Based on Few-Shot Image Classification},
journal = {Journal of Eye Movement Research},
year = {2025},
volume = {18},
number = {4},
pages = {27},
doi = {10.3390/jemr18040027}
}
EUVIMED