EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

GANMasker: A Two-Stage Generative Adversarial Network for High-Quality Face Mask Removal

Mohamed Mahmoud iD, Hyun-Soo Kang iD

Sensors · 2023

DOI: 10.3390/s23167094 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Mohamed Mahmoud und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Information and Communication Engineering, School of Electrical and Computer Engineering, Chungbuk National University, Cheongju-si 286…. Hauptthemen laut MEDLINE: Masks, COVID-19. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Science and ICT, South Korea, MSIT (Ministry of Science and ICT), Korea, National Research Foundation of Korea (NRF).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep-learning-based image inpainting methods have made remarkable advancements, particularly in object removal tasks. The removal of face masks has gained significant attention, especially in the wake of the COVID-19 pandemic, and while numerous methods have successfully addressed the removal of small objects, removing large and complex masks from faces remains demanding. This paper presents a novel two-stage network for unmasking faces considering the intricate facial features typically concealed by masks, such as noses, mouths, and chins. Additionally, the scarcity of paired datasets comprising masked and unmasked face images poses an additional challenge. In the first stage of our proposed model, we employ an autoencoder-based network for binary segmentation of the face mask. Subsequently, in the second stage, we introduce a generative adversarial network (GAN)-based network enhanced with attention and Masked–Unmasked Region Fusion (MURF) mechanisms to focus on the masked region. Our network generates realistic and accurate unmasked faces that resemble the original faces. We train our model on paired unmasked and masked face images sourced from CelebA, a large public dataset, and evaluate its performance on multi-scale masked faces. The experimental results illustrate that the proposed method surpasses the current state-of-the-art techniques in both qualitative and quantitative metrics. It achieves a Peak Signal-to-Noise Ratio (PSNR) improvement of 4.18 dB over the second-best method, with the PSNR reaching 30.96. Additionally, it exhibits a 1% increase in the Structural Similarity Index Measure (SSIM), achieving a value of 0.95.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

MasksCOVID-19HumansPandemicsPersonal Protective EquipmentBenchmarking

Stichwörter der Autor:innen

COVID-19CelebA datasetattention mechanismautoencoderface mask removalface unmaskinggenerative adversarial networks (GANs)image inpainting

Autor:innen und Institutionen

  • Department of Information and Communication Engineering, School of Electrical and Computer Engineering, Chungbuk National University, Cheongju-si 28644, Republic of Korea.
  • Information Technology Department, Faculty of Computers and Information, Assiut University, Assiut 71515, Egypt.

ORCID-Profile: Mohamed Mahmoud, Hyun-Soo Kang

Förderung

  • Ministry of Science and ICT, South Korea
  • MSIT (Ministry of Science and ICT), Korea
  • National Research Foundation of Korea (NRF)

Zitieren

APA

Mahmoud, M., & Kang, H. S. (2023). GANMasker: A Two-Stage Generative Adversarial Network for High-Quality Face Mask Removal. Sensors. https://doi.org/10.3390/s23167094

Vancouver

Mahmoud M, Kang HS. GANMasker: A Two-Stage Generative Adversarial Network for High-Quality Face Mask Removal. Sensors. 2023. doi:10.3390/s23167094

BibTeX
@article{Mahmoud2023,
  author = {Mahmoud, Mohamed and Kang, Hyun-Soo},
  title = {GANMasker: A Two-Stage Generative Adversarial Network for High-Quality Face Mask Removal},
  journal = {Sensors},
  year = {2023},
  doi = {10.3390/s23167094}
}
Kostenlos starten →