EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

blenderFaceUV: Toward Marker‐Based Precision and Flexibility in Facial Tracking With “Invisible” Markers

Axel Zinkernagel iD, Rainer W Alexandrowicz iD, Dennis Küster iD, Manfred Schmitt iD, Tanja Lischetzke iD

Psychophysiology · 2026

DOI: 10.1111/psyp.70394 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Psychophysiology, 2026. Verfasst von Axel Zinkernagel und 4 weiteren Autor:innen. Beteiligte Einrichtung: University of Wuppertal, Wuppertal, Germany. Hauptthemen laut MEDLINE: Facial Expression, Facial Recognition, Automated Facial Recognition. Die Arbeit nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Deutsche Forschungsgemeinschaft.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

blenderFace is a highly precise marker‐based approach for measuring facial activity. Unlike most camera‐based automated facial expression recognition (AFER) systems, which rely on fixed natural landmarks, blenderFace flexibly tracks virtually any point of interest using painted markers. However, visible markers, like EMG electrodes, may alter appearance, increase self‐awareness, and affect spontaneous responding in face‐to‐face interactions. To address these limitations, we introduce blenderFaceUV, which uses sunscreen‐based markers that are visible only under ultraviolet (UV) light (365 nm). In Study 1, we assessed UV‐marker tracking accuracy using parallel visible‐light and UV recordings from two participants. In Study 2, we examined the scalability of blenderFaceUV in N = 18 lay participants prompted to produce a broad range of facial movements using common emotion terms. We also compared identical facial movements measured with blenderFaceUV and OpenFace, a widely used AFER system based on a point distribution model (PDM). Study 1 showed that UV markers could be tracked with similarly high accuracy as visible markers (reprojection/solve error < 0.3 pixels). Across 10 markers and two participants, with more than 3800 measurement occasions per participant, the mean correlation between visible and UV marker movements across the x‐ and y‐coordinates was r = 0.957, while centered RMSE values indicated average deviations of approximately 1 mm. Study 2 demonstrated the scalability of the method and revealed PDM‐related artifacts in OpenFace measurements, particularly during eye blinks and large mouth movements. PDM‐interpolated landmarks, such as upper‐lip markers, also deviated substantially from marker‐based blenderFaceUV measurements. Practical challenges remain, including the complexity of applying invisible markers and the relatively high cost of UV cameras (≈$2000–$6000). We discuss technical requirements, limitations, and a recommended workflow for implementing blenderFaceUV.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Facial ExpressionFacial RecognitionAutomated Facial RecognitionHumansFemaleMaleAdultYoung AdultMotion CaptureUltraviolet RaysEmotionsFace

Stichwörter der Autor:innen

UV recordingblenderFacefacial movement measurementultraviolet lightvideo recording

Autor:innen und Institutionen

  • University of Wuppertal, Wuppertal, Germany.
  • RPTU University of Kaiserslautern-Landau, Landau, Germany.
  • University of Klagenfurt, Klagenfurt, Austria.
  • University of Bremen, Bremen, Germany.

ORCID-Profile: Axel Zinkernagel, Rainer W Alexandrowicz, Dennis Küster, Manfred Schmitt, Tanja Lischetzke

Förderung

  • Deutsche Forschungsgemeinschaft

Zitieren

APA

Zinkernagel, A., Alexandrowicz, R. W., Küster, D., Schmitt, M., & Lischetzke, T. (2026). blenderFaceUV: Toward Marker‐Based Precision and Flexibility in Facial Tracking With “Invisible” Markers. Psychophysiology. https://doi.org/10.1111/psyp.70394

Vancouver

Zinkernagel A, Alexandrowicz RW, Küster D, Schmitt M, Lischetzke T. blenderFaceUV: Toward Marker‐Based Precision and Flexibility in Facial Tracking With “Invisible” Markers. Psychophysiology. 2026. doi:10.1111/psyp.70394

BibTeX
@article{Zinkernagel2026,
  author = {Zinkernagel, Axel and Alexandrowicz, Rainer W and Küster, Dennis and Schmitt, Manfred and Lischetzke, Tanja},
  title = {blenderFaceUV: Toward Marker‐Based Precision and Flexibility in Facial Tracking With “Invisible” Markers},
  journal = {Psychophysiology},
  year = {2026},
  doi = {10.1111/psyp.70394}
}
Kostenlos starten →