Overcoming occlusions in AR, via multi-view, real-time 3D human pose estimation
Machine Vision and Applications · 2026-03 · 37 (2)
DOI: 10.1007/s00138-025-01783-9 ↗Kurz gefasst
Fachartikel in der Zeitschrift Machine Vision and Applications, online erschienen am 06.02.2026. Verfasst von Ioannis Pastaltzidis und 4 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Centre for Research & Technology Hellas.
Abstract (Originalsprache)
AR applications are rapidly gaining adoption, expanding users’ perceptual capabilities. Their potential for addressing visual occlusions and effectively extending the user’s line of sight significantly enhances their value in various contexts, from professional to personal use. This work presents a novel system designed to project 3D human poses onto AR glasses, enabling users to perceive concealed individuals behind solid objects, addressing a critical limitation of traditional visual perception. To achieve real-time and accurate 3D projection, we employ fiducial markers strategically placed within the environment. The markers are periodically fused with IMU sensor data to accurately estimate the user’s head orientation, a crucial step for correct spatial alignment. Furthermore, we leverage a multi-view 3D human pose estimation method using calibrated cameras and incorporate attention mechanisms. These mechanisms focus the system on relevant features, improving accuracy and minimizing 3D joint error. Our experiments demonstrate that the proposed framework accurately projects 3D skeletal representations onto AR glasses, even when significant occlusions are caused by solid objects or other occupants within the scene. This novel approach offers a method to enhance situational awareness in dynamic environments where visibility is compromised, potentially benefiting various applications, from first response scenarios to security and surveillance.
Förderung
- Centre for Research & Technology Hellas
Zitieren
APA
Pastaltzidis, I., Karakostas, I., Dimitriou, N., Krinidis, S., & Tzovaras, D. (2026). Overcoming occlusions in AR, via multi-view, real-time 3D human pose estimation. Machine Vision and Applications, 37(2). https://doi.org/10.1007/s00138-025-01783-9
Vancouver
Pastaltzidis I, Karakostas I, Dimitriou N, Krinidis S, Tzovaras D. Overcoming occlusions in AR, via multi-view, real-time 3D human pose estimation. Machine Vision and Applications. 2026;37(2). doi:10.1007/s00138-025-01783-9
BibTeX
@article{Pastaltzidis2026,
author = {Pastaltzidis, Ioannis and Karakostas, Iason and Dimitriou, Nikolaos and Krinidis, Stelios and Tzovaras, Dimitrios},
title = {Overcoming occlusions in AR, via multi-view, real-time 3D human pose estimation},
journal = {Machine Vision and Applications},
year = {2026},
volume = {37},
number = {2},
doi = {10.1007/s00138-025-01783-9}
}
EUVIMED