EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Transformer‐Based Network for Full Object Pose Estimation with Depth Refinement

Mahmoud Abdulsalam, Kenan Ahiska, Nabil Aouf

Advanced Intelligent Systems · 2024-10 · 6 (10)

DOI: 10.1002/aisy.202400110 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Advanced Intelligent Systems, online erschienen am 28.07.2024. Verfasst von Mahmoud Abdulsalam und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In response to increasing demand for robotics manipulation, accurate vision‐based full pose estimation is essential. While convolutional neural networks‐based approaches have been introduced, the quest for higher performance continues, especially for precise robotics manipulation, including in the Agri‐robotics domain. This article proposes an improved transformer‐based pipeline for full pose estimation, incorporating a Depth Refinement Module. Operating solely on monocular images, the architecture features an innovative Lighter Depth Estimation Network using a Feature Pyramid with an up‐sampling method for depth prediction. A Transformer‐based Detection Network with additional prediction heads is employed to directly regress object centers and predict the full poses of the target objects. A novel Depth Refinement Module is then utilized alongside the predicted centers, full poses, and depth patches to refine the accuracy of the estimated poses. The performance of this pipeline is extensively compared with other state‐of‐the‐art methods, and the results are analyzed for fruit picking applications. The results demonstrate that the pipeline improves the accuracy of pose estimation to up to 90.79% compared to other methods available in the literature.

Zitieren

APA

Abdulsalam, M., Ahiska, K., & Aouf, N. (2024). A Transformer‐Based Network for Full Object Pose Estimation with Depth Refinement. Advanced Intelligent Systems, 6(10). https://doi.org/10.1002/aisy.202400110

Vancouver

Abdulsalam M, Ahiska K, Aouf N. A Transformer‐Based Network for Full Object Pose Estimation with Depth Refinement. Advanced Intelligent Systems. 2024;6(10). doi:10.1002/aisy.202400110

BibTeX
@article{Abdulsalam2024,
  author = {Abdulsalam, Mahmoud and Ahiska, Kenan and Aouf, Nabil},
  title = {A Transformer‐Based Network for Full Object Pose Estimation with Depth Refinement},
  journal = {Advanced Intelligent Systems},
  year = {2024},
  volume = {6},
  number = {10},
  doi = {10.1002/aisy.202400110}
}
Kostenlos starten →