EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

IOF-Tracker: A Two-Stage Multiple Targets Tracking Method Using Spatial-Temporal Fusion Algorithm

Hongbin Liu, Yongze Zhao, Peng Dong, Xiuyi Guo, Yilin Wang

Applied Sciences · 26.12.2024 · 15 (1) · 107

DOI: 10.3390/app15010107 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 26.12.2024. Verfasst von Hongbin Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Shandong Province Natural Science Foundation, Foundation for the Key Research and Promotion of Henan Province (Science and Technology), Key R & D Plan of Shandong Province (Innovation Ability Improvement Project of Small and Medium-sized Science and Technology Enterprises).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi-object tracking aims to track multiple objects across consecutive frames in a video, assigning a unique classifier to each object. However, issues such as occlusions, directional changes, or shape alterations can cause appearance variations, leading to detection and matching problems that in turn result in frequent ID switches. To solve these issues, this paper proposes a two-stage multi-object tracking framework based on a spatial and temporal fusion algorithm. First, the video frames are processed by a detector to identify objects and form rectangular detection areas. Meanwhile, an estimator predicts the target rectangular areas in the next frame. Then, we extract the optical flow of the target pixels within the detection and prediction areas, and then a temporal information model is established by calculating the average of the target pixels’ optical flow. Afterward, we present a spatial information model using the R-IoU (Reverse of Intersection over Union) between the detection and prediction areas. This spatial and temporal information is combined with weighted matrix fusion, which achieves the feature matching and association task. Finally, we implement a two-stage association multi-object tracking model using the mentioned fusion algorithm. Experiments on the MOTChallenge dataset using the official detector show that our two-stage multi-object tracking method based on the spatial and temporal fusion algorithm is robust in handling occlusions and ID switch issues. As of the submission of this paper, the proposed method has achieved the top ranking in the MOT17 benchmark when evaluated with the official detector.

Förderung

  • Shandong Province Natural Science Foundation
  • Foundation for the Key Research and Promotion of Henan Province (Science and Technology)
  • Key R & D Plan of Shandong Province (Innovation Ability Improvement Project of Small and Medium-sized Science and Technology Enterprises)
  • Doctoral Research Fund Project of Shandong Jianzhu University

Zitieren

APA

Liu, H., Zhao, Y., Dong, P., Guo, X., & Wang, Y. (2024). IOF-Tracker: A Two-Stage Multiple Targets Tracking Method Using Spatial-Temporal Fusion Algorithm. Applied Sciences, 15(1), 107. https://doi.org/10.3390/app15010107

Vancouver

Liu H, Zhao Y, Dong P, Guo X, Wang Y. IOF-Tracker: A Two-Stage Multiple Targets Tracking Method Using Spatial-Temporal Fusion Algorithm. Applied Sciences. 2024;15(1):107. doi:10.3390/app15010107

BibTeX
@article{Liu2024,
  author = {Liu, Hongbin and Zhao, Yongze and Dong, Peng and Guo, Xiuyi and Wang, Yilin},
  title = {IOF-Tracker: A Two-Stage Multiple Targets Tracking Method Using Spatial-Temporal Fusion Algorithm},
  journal = {Applied Sciences},
  year = {2024},
  volume = {15},
  number = {1},
  pages = {107},
  doi = {10.3390/app15010107}
}
Kostenlos starten →