Automated integration of spatial location and eye gaze tracking: An extensible multimodal system for developmental data
Infant Behavior and Development · 2026-12 · 85 · 102250
DOI: 10.1016/j.infbeh.2026.102250 ↗Kurz gefasst
Fachartikel in der Zeitschrift Infant Behavior and Development, 2026-12. Verfasst von Bastian Rothenburger und 4 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Computer Science, Goethe University Frankfurt, Robert-Mayer-Str. 11-15, 60325 Frankfurt am Main, Germany. Electronic address: rothenburg…. Die Arbeit nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Deutsche Forschungsgemeinschaft, Bundesministerium für Forschung, Technologie und Raumfahrt.
Abstract (Originalsprache)
Advances in computer vision and mobile sensing enable the study of development in naturalistic environments, yet existing motion tracking systems lack the integration of automated analysis and accessibility needed in developmental research. Current approaches force trade-offs between precision and ecological validity, requiring structured protocols that constrain spontaneous interactions or manual coding that cannot scale for large-scale studies of individual differences. We present an integrated system combining high-density data collection with machine learning-supported analysis using off-the-shelf components. The architecture integrates ceiling-mounted cameras, Pupil Labs eye trackers, and recording hardware, synchronized via Lab Streaming Layer (LSL) protocol with millisecond precision. The modular architecture supports deployment in freely designed environments and can be extended with additional LSL-compatible sensors. Ceiling-mounted cameras operate unobtrusively without requiring wearables, addressing key feasibility challenges in infant and toddler research. The automated pipeline employs off-the-shelf computer vision models for person detection and tracking, with vision-language models distinguishing children from caregivers without manual annotation. The system integrates spatial positioning with eye tracking data, and prototype-based object detection identifies researcher-specific stimuli through reference photographs rather than custom model training. We demonstrate deployment feasibility with toddler-caregiver dyads (from 24 months of age) in free play and validate system accuracy across an extended age range (24 to 63 months). Children tolerated the equipment well, and the pipeline extracted high-density behavioral metrics without manual coding. This system enables scalable measurement of unconstrained early behavior, addressing a methodological gap constraining developmental research.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Institute of Computer Science, Goethe University Frankfurt, Robert-Mayer-Str. 11-15, 60325 Frankfurt am Main, Germany. Electronic address: rothenburger@em.uni-frankfurt.de.
- Institute of Psychology, Goethe University Frankfurt, Theodor-W.-Adorno-Platz 6, 60323 Frankfurt am Main, Germany; IDeA Centre, Leibniz Institute for Research and Information in Education, Rostocker Str. 6, 60323 Frankf…
- Institute of Computer Science, Goethe University Frankfurt, Robert-Mayer-Str. 11-15, 60325 Frankfurt am Main, Germany. Electronic address: schaumloeffel@em.uni-frankfurt.de.
- Institute of Computer Science, Goethe University Frankfurt, Robert-Mayer-Str. 11-15, 60325 Frankfurt am Main, Germany. Electronic address: roignoguera@em.uni-frankfurt.de.
Förderung
- Deutsche Forschungsgemeinschaft
- Bundesministerium für Forschung, Technologie und Raumfahrt
Zitieren
APA
Rothenburger, B., Liang, Y., Schaumlöffel, T., Roig, G., & Shing, Y. L. (2026). Automated integration of spatial location and eye gaze tracking: An extensible multimodal system for developmental data. Infant Behavior and Development, 85, 102250. https://doi.org/10.1016/j.infbeh.2026.102250
Vancouver
Rothenburger B, Liang Y, Schaumlöffel T, Roig G, Shing YL. Automated integration of spatial location and eye gaze tracking: An extensible multimodal system for developmental data. Infant Behavior and Development. 2026;85:102250. doi:10.1016/j.infbeh.2026.102250
BibTeX
@article{Rothenburger2026,
author = {Rothenburger, Bastian and Liang, Yibiao and Schaumlöffel, Timothy and Roig, Gemma and Shing, Yee Lee},
title = {Automated integration of spatial location and eye gaze tracking: An extensible multimodal system for developmental data},
journal = {Infant Behavior and Development},
year = {2026},
volume = {85},
pages = {102250},
doi = {10.1016/j.infbeh.2026.102250}
}
EUVIMED