Exploration of factors affecting webcam-based automated gaze coding
Behavior Research Methods · 2024
DOI: 10.3758/s13428-024-02424-1 ↗Kurz gefasst
Fachartikel in der Zeitschrift Behavior Research Methods, 2024. Verfasst von Hiromichi Hagihara und 4 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Human Sciences, Osaka University 1-2 Yamadaoka, Suita-shi Osaka, 565-0871, Japan. hiromichi.h@gmail.com. Hauptthemen laut MEDLINE: Fixation, Ocular. Die Arbeit nennt 65 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Society for the Promotion of Science, ERC, HORIZON EUROPE Marie Sklodowska-Curie Actions.
Abstract (Originalsprache)
Online experiments have been transforming the field of behavioral research, enabling researchers to increase sample sizes, access diverse populations, lower the costs of data collection, and promote reproducibility. The field of developmental psychology increasingly exploits such online testing approaches. Since infants cannot give explicit behavioral responses, one key outcome measure is infants’ gaze behavior. In the absence of automated eyetrackers in participants’ homes, automatic gaze classification from webcam data would make it possible to avoid painstaking manual coding. However, the lack of a controlled experimental environment may lead to various noise factors impeding automatic face detection or gaze classification. We created an adult webcam dataset that systematically reproduced noise factors from infant webcam studies which might affect automated gaze coding accuracy. We varied participants’ left-right offset, distance to the camera, facial rotation, and the direction of the lighting source. Running two state-of-the-art classification algorithms (iCatcher+ and OWLET) revealed that facial detection performance was particularly affected by the lighting source, while gaze coding accuracy was consistently affected by the distance to the camera and lighting source. Morphing participants’ faces to be unidentifiable did not generally affect the results, suggesting facial anonymization could be used when making online video data publicly available, for purposes of further study and transparency. Our findings will guide improving study design for infant and adult participants during online experiments. Moreover, training algorithms using our dataset will allow researchers to improve robustness and allow developmental psychologists to leverage online testing more efficiently.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Graduate School of Human Sciences, Osaka University 1-2 Yamadaoka, Suita-shi Osaka, 565-0871, Japan. hiromichi.h@gmail.com.
- International Research Center for Neurointelligence (WPI-IRCN), The University of Tokyo Institutes for Advanced Study, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-0033, Japan. hiromichi.h@gmail.com.
- Japan Society for the Promotion of Science, 5-3-1 Kojimachi, Chiyoda-ku, Tokyo, 102-0083, Japan. hiromichi.h@gmail.com.
- The Institute for AI and Beyond, The University of Tokyo, 2-11-16, Yayoi, Bunkyo-ku, Tokyo, 113-0032, Japan. hiromichi.h@gmail.com.
- Trinity College Institute of Neuroscience and School of Psychology, Trinity College Dublin, College Green, Dublin 2, Ireland.
- Graduate School of Engineering, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8656, Japan.
Förderung
- Japan Society for the Promotion of Science
- ERC
- HORIZON EUROPE Marie Sklodowska-Curie Actions
- Jacobs Foundation
- Institute for AI and Beyond
- Japan Science and Technology Corporation
- Osaka University
Zitieren
APA
Hagihara, H., Zaadnoordijk, L., Cusack, R., Kimura, N., & Tsuji, S. (2024). Exploration of factors affecting webcam-based automated gaze coding. Behavior Research Methods. https://doi.org/10.3758/s13428-024-02424-1
Vancouver
Hagihara H, Zaadnoordijk L, Cusack R, Kimura N, Tsuji S. Exploration of factors affecting webcam-based automated gaze coding. Behavior Research Methods. 2024. doi:10.3758/s13428-024-02424-1
BibTeX
@article{Hagihara2024,
author = {Hagihara, Hiromichi and Zaadnoordijk, Lorijn and Cusack, Rhodri and Kimura, Nanako and Tsuji, Sho},
title = {Exploration of factors affecting webcam-based automated gaze coding},
journal = {Behavior Research Methods},
year = {2024},
doi = {10.3758/s13428-024-02424-1}
}
EUVIMED