EUVIMEDEUVIMED entdecken
Crossref

A Dataset-Centric Analysis of Evaluation Protocols in Face Morph Attack Detection

Sheerko R. HmaSalah, Abdulbasit K. Al-Talabani, Aras T. Asaad

Polytechnic Journal · 01.01.2026 · 16 (2)

DOI: 10.59341/2707-7799.1885 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Polytechnic Journal, online erschienen am 01.01.2026. Verfasst von Sheerko R. HmaSalah und 2 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Face morph attack detection (MAD) is often evaluated using datasets collected from diverse sources, created for different purposes, and acquired under varying conditions. This heterogeneity raises questions about how evaluation protocols and dataset characteristics influence reported performance. This work adopts a dataset-centric perspective to analyze the effects of evaluation protocol and dataset composition, including visual quality and morph-to-genuine imbalance, on MAD performance. Experiments are conducted on eight datasets and four morphing techniques using a fixed pipeline evaluated across six backbones, including Vision Transformer (ViT) and five CNN architectures, and ten evaluation scenarios covering homogeneous and heterogeneous cross-morph generalization. Performance is analyzed using threshold-independent and threshold-dependent measures, including Equal Error Rate (EER), Bona Fide Presentation Classification Error Rate (BPCER) at fixed Attack Presentation Classification Error Rate (APCER) operating points of 1% and 5%, and Detection Error Trade-off (DET) curves. Across datasets and architectures, heterogeneous testing yields higher error rates, revealing a generalization gap when models encounter unseen morphing techniques. Moreover, heterogeneous evaluation expands inter-architecture variability, exposing backbone-dependent robustness differences compressed under homogeneous evaluations. Several datasets achieve very low error under homogeneous evaluations yet degrade substantially under heterogeneous evaluations, indicating that homogeneous evaluation can mask sensitivity to protocol shift. The heterogeneity ratio shows that relative degradation is not monotonic with dataset scale, suggesting additional dataset-specific effects. Spearman correlation analysis further indicates a weak-to-moderate, non-monotonic association between morph-to-genuine imbalance and average error across backbones. Overall, reliable MAD evaluation requires heterogeneous evaluations, threshold-aware analysis, and explicit consideration of dataset properties beyond scale alone

Zitieren

APA

HmaSalah, S. R., Al-Talabani, A. K., & Asaad, A. T. (2026). A Dataset-Centric Analysis of Evaluation Protocols in Face Morph Attack Detection. Polytechnic Journal, 16(2). https://doi.org/10.59341/2707-7799.1885

Vancouver

HmaSalah SR, Al-Talabani AK, Asaad AT. A Dataset-Centric Analysis of Evaluation Protocols in Face Morph Attack Detection. Polytechnic Journal. 2026;16(2). doi:10.59341/2707-7799.1885

BibTeX
@article{HmaSalah2026,
  author = {HmaSalah, Sheerko R. and Al-Talabani, Abdulbasit K. and Asaad, Aras T.},
  title = {A Dataset-Centric Analysis of Evaluation Protocols in Face Morph Attack Detection},
  journal = {Polytechnic Journal},
  year = {2026},
  volume = {16},
  number = {2},
  doi = {10.59341/2707-7799.1885}
}
Kostenlos starten →