EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Facial attribute-aware DeepFake detection through semi-supervised facial attribute labeling

Vittorio Stile, Roberto Caldelli, Sara Balderas-Díaz, Gabriel Guerrero-Contreras, Inmaculada Medina-Bulo

Frontiers in Imaging · 24.06.2026 · 5

DOI: 10.3389/fimag.2026.1846377 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Imaging, online erschienen am 24.06.2026. Verfasst von Vittorio Stile und 4 weiteren Autor:innen. Die Arbeit nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study investigates the correlation between misclassifications in DeepFake detection and high-level facial attributes. A pre-trained frame-level classifier is used to distinguish manipulated from authentic video content, and its wrong predictions are analyzed in detail. To enrich the dataset, we automatically annotate each video with additional labels, including gender, hair color, hair length, ear visibility, and ethnicity, using a semi-supervised facial-attribute recognition pipeline. We extend this analysis with controlled training-time exclusions on FaceForensics++, keeping a unified test set to isolate generalization bias. Compared to the no-exclusion baseline (Accuracy = 0.806, AUC = 0.823), excluding samples with ears visible yields the largest degradation (Accuracy = 0.741, AUC = 0.763), while excluding non-visible ears has a milder effect (Accuracy = 0.813, AUC = 0.832). Hair length shows a moderate but consistent impact that interacts with ear visibility. We also explain the observed confusion-matrix asymmetry as a consequence of fixed score thresholds and video-level k-of-n aggregation. The results demonstrate that ear visibility is a critical factor for robust FAKE vs. REAL discrimination and motivate attribute-aware training, including targeted data curation, attribute-specific augmentation, and threshold calibration. The proposed framework provides actionable guidance for bias-aware training strategies and supports the development of more interpretable and operationally reliable DeepFake detection systems.

Zitieren

APA

Stile, V., Caldelli, R., Balderas-Díaz, S., Guerrero-Contreras, G., & Medina-Bulo, I. (2026). Facial attribute-aware DeepFake detection through semi-supervised facial attribute labeling. Frontiers in Imaging, 5. https://doi.org/10.3389/fimag.2026.1846377

Vancouver

Stile V, Caldelli R, Balderas-Díaz S, Guerrero-Contreras G, Medina-Bulo I. Facial attribute-aware DeepFake detection through semi-supervised facial attribute labeling. Frontiers in Imaging. 2026;5. doi:10.3389/fimag.2026.1846377

BibTeX
@article{Stile2026,
  author = {Stile, Vittorio and Caldelli, Roberto and Balderas-Díaz, Sara and Guerrero-Contreras, Gabriel and Medina-Bulo, Inmaculada},
  title = {Facial attribute-aware DeepFake detection through semi-supervised facial attribute labeling},
  journal = {Frontiers in Imaging},
  year = {2026},
  volume = {5},
  doi = {10.3389/fimag.2026.1846377}
}
Kostenlos starten →