EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Exploring facial expressions and action unit domains for Parkinson detection

Luis F Gomez iD, Aythami Morales, Julian Fierrez, Juan Rafael Orozco-Arroyave

PLOS ONE · 02.02.2023 · 18 (2) · e0281248

DOI: 10.1371/journal.pone.0281248 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, online erschienen am 02.02.2023. Verfasst von Luis F Gomez und 3 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Engineering, Universidad de Antioquia, Medellín, Antioquia, Colombia. Hauptthemen laut MEDLINE: Parkinson Disease, Facial Recognition. Die Arbeit wurde bisher 37-mal zitiert (Crossref) und nennt 66 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministerio de Asuntos Económicos y Transformación Digital, Gobierno de España, H2020 Excellent Science, H2020 Societal Challenges.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background and objective Patients suffering from Parkinson’s disease (PD) present a reduction in facial movements called hypomimia. In this work, we propose to use machine learning facial expression analysis from face images based on action unit domains to improve PD detection. We propose different domain adaptation techniques to exploit the latest advances in automatic face analysis and face action unit detection.

Methods

Three different approaches are explored to model facial expressions of PD patients: (i) face analysis using single frame images and also using sequences of images, (ii) transfer learning from face analysis to action units recognition, and (iii) triplet-loss functions to improve the automatic classification between patients and healthy subjects.

Results

Real face images from PD patients show that it is possible to properly model elicited facial expressions using image sequences (neutral, onset-transition, apex, offset-transition, and neutral) with accuracy improvements of up to 5.5% (from 72.9% to 78.4%) with respect to single-image PD detection. We also show that our proposed action unit domain adaptation provides improvements of up to 8.9% (from 78.4% to 87.3%) with respect to face analysis. Finally, we also show that triplet-loss functions provide improvements of up to 3.6% (from 78.8% to 82.4%) with respect to action unit domain adaptation applied upon models created from scratch. The code of the experiments is available at https://github.com/luisf-gomez/Explorer-FE-AU-in-PD .

Conclusions

Domain adaptation via transfer learning methods seem to be a promising strategy to model hypomimia in PD patients. Considering the good results and also the fact that only up to five images per participant are considered in each sequence, we believe that this work is a step forward in the development of inexpensive computational systems suitable to model and quantify problems of PD patients in their facial expressions.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Parkinson DiseaseFacial RecognitionHumansFacial ExpressionMovementMachine LearningRecognition, Psychology

Autor:innen und Institutionen

  • Faculty of Engineering, Universidad de Antioquia, Medellín, Antioquia, Colombia.
  • School of Engineering, Universidad Autónoma de Madrid, Madrid, Madrid, España.
  • Pattern Recognition Lab, Friedrich-Alexander-Univertität Erlangen-Nürnberg, Erlangen, Germany.

ORCID-Profile: Luis F Gomez

Förderung

  • Ministerio de Asuntos Económicos y Transformación Digital, Gobierno de España
  • H2020 Excellent Science
  • H2020 Societal Challenges
  • Universidad de Antioquia

Zitieren

APA

Gomez, L. F., Morales, A., Fierrez, J., & Orozco-Arroyave, J. R. (2023). Exploring facial expressions and action unit domains for Parkinson detection. PLOS ONE, 18(2), e0281248. https://doi.org/10.1371/journal.pone.0281248

Vancouver

Gomez LF, Morales A, Fierrez J, Orozco-Arroyave JR. Exploring facial expressions and action unit domains for Parkinson detection. PLOS ONE. 2023;18(2):e0281248. doi:10.1371/journal.pone.0281248

BibTeX
@article{Gomez2023,
  author = {Gomez, Luis F and Morales, Aythami and Fierrez, Julian and Orozco-Arroyave, Juan Rafael},
  title = {Exploring facial expressions and action unit domains for Parkinson detection},
  journal = {PLOS ONE},
  year = {2023},
  volume = {18},
  number = {2},
  pages = {e0281248},
  doi = {10.1371/journal.pone.0281248}
}
Kostenlos starten →