EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Applying a Transformer-based machine-learning model to classify caregiver and infant behaviours during dyadic interactions

Alexander Turner, Aly Magassouba, Sobanawartiny Wijeakumar

Infant Behavior and Development · 2026

DOI: 10.1016/j.infbeh.2025.102175 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Infant Behavior and Development, 2026. Verfasst von Alexander Turner und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Science, University of Nottingham, Nottingham, United Kingdom. Electronic address: alexander.turner@nottingham.ac.uk. Hauptthemen laut MEDLINE: Machine Learning, Caregivers, Infant Behavior. Die Arbeit nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Leverhulme Trust.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal caregiver-infant interactions have both concurrent and long-term impacts on child attention, cognitive and social skills. These behaviours are typically manually coded by human researchers, making this approach susceptible to observer bias, dependent on inter-rater reliability, and substantial demands on time and resources. In this study, we aimed to develop a multimodal machine-learning model that could be capable of automatically detecting and classifying multimodal behaviours from video recordings of caregivers and their infants (N = 81; infant mean age = 251.3 ± 34.9 days) engaging with objects. We focused on caregiver scaffolding, caregiver intrusiveness, infant object engagement and infant distractibility. Low-level features from audio, video, and pose data were extracted using specific AI models, and input into a Transformer-based architecture capable of learning temporal patterns across modalities. Our findings revealed a significant contrast in model performance depending on how the data was partitioned. Following previous research, when the dataset was split such that data from all dyads contributed to the training, validation, and test sets - the models achieved notably high classification accuracy of over 98 %. However, when tested on entirely unseen dyads, the performance dropped markedly to around 55 %. These results suggest that the models did not learn behaviors of interest but instead relied on video-specific or dyad-specific details - underscoring key generalizability challenges in applying Transformer-based models to complex, multimodal behavioral data. Nonetheless, this work lays a foundation for future research aimed at refining these models and extending their applicability across diverse caregiving contexts.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Machine LearningCaregiversInfant BehaviorHumansInfantFemaleMaleVideo RecordingAdultReproducibility of Results

Stichwörter der Autor:innen

Caregiver-Infant InteractionsHolistic behavioursMachine-learning

Autor:innen und Institutionen

  • School of Computer Science, University of Nottingham, Nottingham, United Kingdom. Electronic address: alexander.turner@nottingham.ac.uk.
  • School of Computer Science, University of Nottingham, Nottingham, United Kingdom.
  • School of Psychology, University of Nottingham, Nottingham, United Kingdom. Electronic address: sobanawartiny.wijeakumar@nottingham.ac.uk.

Förderung

  • Leverhulme Trust

Zitieren

APA

Turner, A., Magassouba, A., & Wijeakumar, S. (2026). Applying a Transformer-based machine-learning model to classify caregiver and infant behaviours during dyadic interactions. Infant Behavior and Development. https://doi.org/10.1016/j.infbeh.2025.102175

Vancouver

Turner A, Magassouba A, Wijeakumar S. Applying a Transformer-based machine-learning model to classify caregiver and infant behaviours during dyadic interactions. Infant Behavior and Development. 2026. doi:10.1016/j.infbeh.2025.102175

BibTeX
@article{Turner2026,
  author = {Turner, Alexander and Magassouba, Aly and Wijeakumar, Sobanawartiny},
  title = {Applying a Transformer-based machine-learning model to classify caregiver and infant behaviours during dyadic interactions},
  journal = {Infant Behavior and Development},
  year = {2026},
  doi = {10.1016/j.infbeh.2025.102175}
}
Kostenlos starten →