EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Mitigating Data Imbalance in Head Pose Estimation Through Diffusion Model Generated Synthetic Data with Pose Reference

Dimas Herjuno, Keiichi Horio

Applied Sciences · 02.11.2026 · 16 (21) · 10839

DOI: 10.3390/app162110839 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 02.11.2026. Verfasst von Dimas Herjuno und 1 weiteren Autor:innen. Die Arbeit nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: JSPS KAKENHI.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Many head pose estimation approaches are limited by the scarcity of diverse, accurately annotated datasets, especially for skewed facial orientations. Such extreme angles occur far less frequently in real-world data collection, leaving them severely underrepresented. This weakens trained models exactly at the extreme angles they had few chances to learn. Rather than perturbing existing samples, we generate genuinely new ones where data is sparse: a synthetic data framework using the SDXL diffusion model conditioned on OpenPose-derived keypoint maps, with InstantID for identity preservation. Because the produced pose can differ from the request, every image is reannotated by an independent 3D estimator (DAD-3DNet) rather than labeled by its target angle, yielding a more balanced pose distribution. We evaluate cross-dataset generalization using the Geodesic Error across two backbones, 6DRepNet and Hopenet. Adding the synthetic data to real training lowers cross-dataset error for both backbones, most clearly on unseen subjects, showing it is an effective complement to real data at rare orientations.

Förderung

  • JSPS KAKENHI

Zitieren

APA

Herjuno, D., & Horio, K. (2026). Mitigating Data Imbalance in Head Pose Estimation Through Diffusion Model Generated Synthetic Data with Pose Reference. Applied Sciences, 16(21), 10839. https://doi.org/10.3390/app162110839

Vancouver

Herjuno D, Horio K. Mitigating Data Imbalance in Head Pose Estimation Through Diffusion Model Generated Synthetic Data with Pose Reference. Applied Sciences. 2026;16(21):10839. doi:10.3390/app162110839

BibTeX
@article{Herjuno2026,
  author = {Herjuno, Dimas and Horio, Keiichi},
  title = {Mitigating Data Imbalance in Head Pose Estimation Through Diffusion Model Generated Synthetic Data with Pose Reference},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {21},
  pages = {10839},
  doi = {10.3390/app162110839}
}
Kostenlos starten →