Head poses and grimaces: Challenges for automated face identification algorithms?
Science & Justice · 2024
DOI: 10.1016/j.scijus.2024.06.002 ↗Kurz gefasst
Fachartikel in der Zeitschrift Science & Justice, 2024. Verfasst von Petra Urbanova und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Anthropology, Faculty of Science, Masaryk University, Czech Republic. Electronic address: urbanova@sci.muni.cz. Hauptthemen laut MEDLINE: Facial Expression, Algorithms, Automated Facial Recognition. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 104 Literaturangaben. Gefördert von: Ministry of the Interior of the Czech Republic.
Abstract (Originalsprache)
In today's biometric and commercial settings, state-of-the-art image processing relies solely on artificial intelligence and machine learning which provides a high level of accuracy. However, these principles are deeply rooted in abstract, complex "black-box systems". When applied to forensic image identification, concerns about transparency and accountability emerge. This study explores the impact of two challenging factors in automated facial identification: facial expressions and head poses. The sample comprised 3D faces with nine prototype expressions, collected from 41 participants (13 males, 28 females) of European descent aged 19.96 to 50.89 years. Pre-processing involved converting 3D models to 2D color images (256 × 256 px). Probes included a set of 9 images per individual with head poses varying by 5° in both left-to-right (yaw) and up-and-down (pitch) directions for neutral expressions. A second set of 3,610 images per individual covered viewpoints in 5° increments from -45° to 45° for head movements and different facial expressions, forming the targets. Pair-wise comparisons using ArcFace, a state-of-the-art face identification algorithm yielded 54,615,690 dissimilarity scores. Results indicate that minor head deviations in probes have minimal impact. However, the performance diminished as targets deviated from the frontal position. Right-to-left movements were less influential than up and down, with downward pitch showing less impact than upward movements. The lowest accuracy was for upward pitch at 45°. Dissimilarity scores were consistently higher for males than for females across all studied factors. The performance particularly diverged in upward movements, starting at 15°. Among tested facial expressions, happiness and contempt performed best, while disgust exhibited the lowest AUC values.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Anthropology, Faculty of Science, Masaryk University, Czech Republic. Electronic address: urbanova@sci.muni.cz.
- Department of Intelligent Systems, Faculty of Information Technology, Brno University of Technology, Brno, Czech Republic.
- Department of Anthropology, Faculty of Science, Masaryk University, Czech Republic.
Förderung
- Ministry of the Interior of the Czech Republic
Zitieren
APA
Urbanova, P., Goldmann, T., Cerny, D., & Drahansky, M. (2024). Head poses and grimaces: Challenges for automated face identification algorithms?. Science & Justice. https://doi.org/10.1016/j.scijus.2024.06.002
Vancouver
Urbanova P, Goldmann T, Cerny D, Drahansky M. Head poses and grimaces: Challenges for automated face identification algorithms?. Science & Justice. 2024. doi:10.1016/j.scijus.2024.06.002
BibTeX
@article{Urbanova2024,
author = {Urbanova, Petra and Goldmann, Tomas and Cerny, Dominik and Drahansky, Martin},
title = {Head poses and grimaces: Challenges for automated face identification algorithms?},
journal = {Science & Justice},
year = {2024},
doi = {10.1016/j.scijus.2024.06.002}
}
EUVIMED