EUVIMEDEUVIMED entdecken
Crossref

Learning User Embeddings from Human Gaze for Personalised Saliency Prediction

Florian Strohm, Mihai Bâce, Andreas Bulling

Proceedings of the ACM on Human-Computer Interaction · 20.05.2024 · 8 (ETRA) · 1-16

DOI: 10.1145/3655603 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Human-Computer Interaction, online erschienen am 28.05.2024. Verfasst von Florian Strohm und 2 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 65 Literaturangaben. Gefördert von: European Research Council, Postdoc.Mobility Fellowship.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Reusable embeddings of user behaviour have shown significant performance improvements for the personalised saliency prediction task. However, prior works require explicit user characteristics and preferences as input, which are often difficult to obtain. We present a novel method to extract user embeddings from pairs of natural images and corresponding saliency maps generated from a small amount of user-specific eye tracking data. At the core of our method is a Siamese convolutional neural encoder that learns the user embeddings by contrasting the image and personal saliency map pairs of different users. Evaluations on two public saliency datasets show that the generated embeddings have high discriminative power, are effective at refining universal saliency maps to the individual users, and generalise well across users and images. Finally, based on our model's ability to encode individual user characteristics, our work points towards other applications that can benefit from reusable embeddings of gaze behaviour.

Förderung

  • European Research Council
  • Postdoc.Mobility Fellowship

Zitieren

APA

Strohm, F., Bâce, M., & Bulling, A. (2024). Learning User Embeddings from Human Gaze for Personalised Saliency Prediction. Proceedings of the ACM on Human-Computer Interaction, 8(ETRA), 1-16. https://doi.org/10.1145/3655603

Vancouver

Strohm F, Bâce M, Bulling A. Learning User Embeddings from Human Gaze for Personalised Saliency Prediction. Proceedings of the ACM on Human-Computer Interaction. 2024;8(ETRA):1-16. doi:10.1145/3655603

BibTeX
@article{Strohm2024,
  author = {Strohm, Florian and Bâce, Mihai and Bulling, Andreas},
  title = {Learning User Embeddings from Human Gaze for Personalised Saliency Prediction},
  journal = {Proceedings of the ACM on Human-Computer Interaction},
  year = {2024},
  volume = {8},
  number = {ETRA},
  pages = {1--16},
  doi = {10.1145/3655603}
}
Kostenlos starten →