Nose-Lip and Background Region Segmentation for Precisely Predicting Face Orientation
Journal of Image and Graphics · 2026 · 14 (2)
DOI: 10.18178/joig.14.2.172-193 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Image and Graphics, 2026. Verfasst von Shet R. Prakash.
Abstract (Originalsprache)
—The core necessity for the video analysis-based application is the prediction of human face orientation. Here, we propose a unique and novel solution for predicting face orientation through a combination of facial features like the nose and lip region, along with non-facial features like the background region of the facial image. The proposed solution has two stages. The first stage, namely the Nose-Lip Segmenter (NLSeg), generates a nose-lip mask (m2) through a custom-trained U-Net model. The U-Net model segments the nose and lip region very accurately with an Intersection Over Union (IOU) score of 87.56%. The second stage generates a background region mask (m1) through two different methods. In the first method, a background region mask (m1) is constructed through the k-means clustering and Hue-Saturation-Value (HSV) skin color model. In the second method, the background region mask (m1) is constructed through the media-pipe selfie segmentation model. The proposed algorithm blends the nose-lip mask (m2) and background region mask (m1) together to predict face orientation across left, right, and neutral directions. The efficiency of both approaches, namely (NLSeg+method 1) and (NLSeg+method 2), is studied and evaluated on six public datasets namely BIWI-Kinect, AFLW2000-3D, Pandora, Pointing04, Stirling/ESRC 3D face, and multi camera pedestrians video dataset obtained from École Polytechnique Fédérale de Lausanne (EPFL). The proposed work yields very accurate results in spite of challenges like diverse head pose angles, facial expressions, or improper segmentation. The accuracy is 98% when subjects are non-occluded and is above 90% in the case of partial occlusion
Zitieren
APA
Prakash, S. R. (2026). Nose-Lip and Background Region Segmentation for Precisely Predicting Face Orientation. Journal of Image and Graphics, 14(2). https://doi.org/10.18178/joig.14.2.172-193
Vancouver
Prakash SR. Nose-Lip and Background Region Segmentation for Precisely Predicting Face Orientation. Journal of Image and Graphics. 2026;14(2). doi:10.18178/joig.14.2.172-193
BibTeX
@article{Prakash2026,
author = {Prakash, Shet R.},
title = {Nose-Lip and Background Region Segmentation for Precisely Predicting Face Orientation},
journal = {Journal of Image and Graphics},
year = {2026},
volume = {14},
number = {2},
doi = {10.18178/joig.14.2.172-193}
}
EUVIMED