EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

Hybrid features for RGB-D object tracking using deep learning

Sari Awwad, Yousef Elsheikh, Ahmad Al-Rababa’a

Bulletin of Electrical Engineering and Informatics · 01.12.2026 · 15 (6) · 5012-5032

DOI: 10.11591/eei.v15i6.12903 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Bulletin of Electrical Engineering and Informatics, online erschienen am 01.12.2026. Verfasst von Sari Awwad und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Tracking objects in red, green, blue, and depth (RGB-D) video remains challenging because visual appearance can change under occlusion, illumination variation, and motion blur, while depth frames may contain missing or noisy values. This study proposes a hybrid RGB-D object-tracking framework that combines convolutional neural network (CNN) features with local binary patterns (LBP) for texture and histogram of oriented gradients (HOG) for shape, using a Kalman filter and a deep appearance model to estimate object locations across frames. The method is evaluated on the Digital Twin Tracking Dataset (DTTD), comprising 100 videos with annotated ground-truth tracks. The experimental protocol uses an 80:20 training/testing split, 100 training epochs, a batch size of 32, and rotation and horizontal-flip augmentation. On the reported benchmark, the proposed approach achieves a success rate (SR) of 88.9%, a precision rate (PR) of 91.5%, and a root mean square error (RMSE) of 3.9 pixels, at 22 frames per second (FPS). These results indicate that combining learned semantic representations with handcrafted texture and shape descriptors improves tracking performance over the individual feature-based baselines, particularly under occlusion and illumination changes.

Zitieren

APA

Awwad, S., Elsheikh, Y., & Al-Rababa’a, A. (2026). Hybrid features for RGB-D object tracking using deep learning. Bulletin of Electrical Engineering and Informatics, 15(6), 5012-5032. https://doi.org/10.11591/eei.v15i6.12903

Vancouver

Awwad S, Elsheikh Y, Al-Rababa’a A. Hybrid features for RGB-D object tracking using deep learning. Bulletin of Electrical Engineering and Informatics. 2026;15(6):5012-5032. doi:10.11591/eei.v15i6.12903

BibTeX
@article{Awwad2026,
  author = {Awwad, Sari and Elsheikh, Yousef and Al-Rababa’a, Ahmad},
  title = {Hybrid features for RGB-D object tracking using deep learning},
  journal = {Bulletin of Electrical Engineering and Informatics},
  year = {2026},
  volume = {15},
  number = {6},
  pages = {5012--5032},
  doi = {10.11591/eei.v15i6.12903}
}
Kostenlos starten →