EUVIMEDEUVIMED entdecken
Crossref

Nose-Lip and Background Region Segmentation for Precisely Predicting Face Orientation

Shet R. Prakash

Journal of Image and Graphics · 2026 · 14 (2)

DOI: 10.18178/joig.14.2.172-193 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Image and Graphics, 2026. Verfasst von Shet R. Prakash.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

—The core necessity for the video analysis-based application is the prediction of human face orientation. Here, we propose a unique and novel solution for predicting face orientation through a combination of facial features like the nose and lip region, along with non-facial features like the background region of the facial image. The proposed solution has two stages. The first stage, namely the Nose-Lip Segmenter (NLSeg), generates a nose-lip mask (m2) through a custom-trained U-Net model. The U-Net model segments the nose and lip region very accurately with an Intersection Over Union (IOU) score of 87.56%. The second stage generates a background region mask (m1) through two different methods. In the first method, a background region mask (m1) is constructed through the k-means clustering and Hue-Saturation-Value (HSV) skin color model. In the second method, the background region mask (m1) is constructed through the media-pipe selfie segmentation model. The proposed algorithm blends the nose-lip mask (m2) and background region mask (m1) together to predict face orientation across left, right, and neutral directions. The efficiency of both approaches, namely (NLSeg+method 1) and (NLSeg+method 2), is studied and evaluated on six public datasets namely BIWI-Kinect, AFLW2000-3D, Pandora, Pointing04, Stirling/ESRC 3D face, and multi camera pedestrians video dataset obtained from École Polytechnique Fédérale de Lausanne (EPFL). The proposed work yields very accurate results in spite of challenges like diverse head pose angles, facial expressions, or improper segmentation. The accuracy is 98% when subjects are non-occluded and is above 90% in the case of partial occlusion

Zitieren

APA

Prakash, S. R. (2026). Nose-Lip and Background Region Segmentation for Precisely Predicting Face Orientation. Journal of Image and Graphics, 14(2). https://doi.org/10.18178/joig.14.2.172-193

Vancouver

Prakash SR. Nose-Lip and Background Region Segmentation for Precisely Predicting Face Orientation. Journal of Image and Graphics. 2026;14(2). doi:10.18178/joig.14.2.172-193

BibTeX
@article{Prakash2026,
  author = {Prakash, Shet R.},
  title = {Nose-Lip and Background Region Segmentation for Precisely Predicting Face Orientation},
  journal = {Journal of Image and Graphics},
  year = {2026},
  volume = {14},
  number = {2},
  doi = {10.18178/joig.14.2.172-193}
}
Kostenlos starten →