EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Quantifying Facial Gestures Using Deep Learning in a New World Monkey

Filippo Carugati iD, Dayanna Curagi Gorio iD, Chiara De Gregorio iD, Daria Valente iD, Valeria Ferrario iD, Brice Lefaux, Olivier Friard iD, Marco Gamba iD

American Journal of Primatology · 2025

DOI: 10.1002/ajp.70013 ↗

Kurz gefasst

Fachartikel in der Zeitschrift American Journal of Primatology, 2025. Verfasst von Filippo Carugati und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Life Sciences and Systems Biology, Università di Torino, Torino, Italy. Hauptthemen laut MEDLINE: Gestures, Deep Learning, Saguinus, Face. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 84 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial gestures are a crucial component of primate multimodal communication. However, current methodologies for extracting facial data from video recordings are labor‐intensive and prone to human subjectivity. Although automatic tools for this task are still in their infancy, deep learning techniques are revolutionizing animal behavior research. This study explores the distinctiveness of facial gestures in cotton‐top tamarins, quantified using markerless pose estimation algorithms. From footage of captive individuals, we extracted and manually labeled frames to develop a model that can recognize a custom set of landmarks positioned on the face of the target species. The trained model predicted landmark positions and subsequently transformed them into distance matrices representing landmarks' spatial distributions within each frame. We employed three competitive machine learning classifiers to assess the ability to automatically discriminate facial configurations that cooccur with vocal emissions and are associated with different behavioral contexts. Initial analysis showed correct classification rates exceeding 80%, suggesting that voiced facial configurations are highly distinctive from unvoiced ones. Our findings also demonstrated varying context specificity of facial gestures, with the highest classification accuracy observed during yawning, social activity, and resting. This study highlights the potential of markerless pose estimation for advancing the study of primate multimodal communication, even in challenging species such as cotton‐top tamarins. The ability to automatically distinguish facial gestures in different behavioral contexts represents a critical step in developing automated tools for extracting behavioral cues from raw video data.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

GesturesDeep LearningSaguinusFaceAnimal CommunicationAnimalsMaleFemaleVideo Recording

Stichwörter der Autor:innen

DeepLabCutSaguinus oedipuscotton‐top tamarinmarkerless pose estimationprimate face

Autor:innen und Institutionen

  • Department of Life Sciences and Systems Biology, Università di Torino, Torino, Italy.
  • Department of Psychology, University of Warwick, Coventry, UK.
  • Parco Natura Viva Garda Zoological Park, Bussolengo, Italy.
  • Chester Zoo, Chester, UK.
  • Zoo de Mulhouse, Mulhouse, France.

ORCID-Profile: Filippo Carugati, Dayanna Curagi Gorio, Chiara De Gregorio, Daria Valente, Valeria Ferrario, Olivier Friard, Marco Gamba

Zitieren

APA

Carugati, F., Gorio, D. C., De Gregorio, C., Valente, D., Ferrario, V., Lefaux, B., Friard, O., & Gamba, M. (2025). Quantifying Facial Gestures Using Deep Learning in a New World Monkey. American Journal of Primatology. https://doi.org/10.1002/ajp.70013

Vancouver

Carugati F, Gorio DC, De Gregorio C, Valente D, Ferrario V, Lefaux B, et al. Quantifying Facial Gestures Using Deep Learning in a New World Monkey. American Journal of Primatology. 2025. doi:10.1002/ajp.70013

BibTeX
@article{Carugati2025,
  author = {Carugati, Filippo and Gorio, Dayanna Curagi and De Gregorio, Chiara and Valente, Daria and Ferrario, Valeria and Lefaux, Brice and Friard, Olivier and Gamba, Marco},
  title = {Quantifying Facial Gestures Using Deep Learning in a New World Monkey},
  journal = {American Journal of Primatology},
  year = {2025},
  doi = {10.1002/ajp.70013}
}
Kostenlos starten →