IOF-Tracker: A Two-Stage Multiple Targets Tracking Method Using Spatial-Temporal Fusion Algorithm
Applied Sciences · 26.12.2024 · 15 (1) · 107
DOI: 10.3390/app15010107 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 26.12.2024. Verfasst von Hongbin Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Shandong Province Natural Science Foundation, Foundation for the Key Research and Promotion of Henan Province (Science and Technology), Key R & D Plan of Shandong Province (Innovation Ability Improvement Project of Small and Medium-sized Science and Technology Enterprises).
Abstract (Originalsprache)
Multi-object tracking aims to track multiple objects across consecutive frames in a video, assigning a unique classifier to each object. However, issues such as occlusions, directional changes, or shape alterations can cause appearance variations, leading to detection and matching problems that in turn result in frequent ID switches. To solve these issues, this paper proposes a two-stage multi-object tracking framework based on a spatial and temporal fusion algorithm. First, the video frames are processed by a detector to identify objects and form rectangular detection areas. Meanwhile, an estimator predicts the target rectangular areas in the next frame. Then, we extract the optical flow of the target pixels within the detection and prediction areas, and then a temporal information model is established by calculating the average of the target pixels’ optical flow. Afterward, we present a spatial information model using the R-IoU (Reverse of Intersection over Union) between the detection and prediction areas. This spatial and temporal information is combined with weighted matrix fusion, which achieves the feature matching and association task. Finally, we implement a two-stage association multi-object tracking model using the mentioned fusion algorithm. Experiments on the MOTChallenge dataset using the official detector show that our two-stage multi-object tracking method based on the spatial and temporal fusion algorithm is robust in handling occlusions and ID switch issues. As of the submission of this paper, the proposed method has achieved the top ranking in the MOT17 benchmark when evaluated with the official detector.
Förderung
- Shandong Province Natural Science Foundation
- Foundation for the Key Research and Promotion of Henan Province (Science and Technology)
- Key R & D Plan of Shandong Province (Innovation Ability Improvement Project of Small and Medium-sized Science and Technology Enterprises)
- Doctoral Research Fund Project of Shandong Jianzhu University
Zitieren
APA
Liu, H., Zhao, Y., Dong, P., Guo, X., & Wang, Y. (2024). IOF-Tracker: A Two-Stage Multiple Targets Tracking Method Using Spatial-Temporal Fusion Algorithm. Applied Sciences, 15(1), 107. https://doi.org/10.3390/app15010107
Vancouver
Liu H, Zhao Y, Dong P, Guo X, Wang Y. IOF-Tracker: A Two-Stage Multiple Targets Tracking Method Using Spatial-Temporal Fusion Algorithm. Applied Sciences. 2024;15(1):107. doi:10.3390/app15010107
BibTeX
@article{Liu2024,
author = {Liu, Hongbin and Zhao, Yongze and Dong, Peng and Guo, Xiuyi and Wang, Yilin},
title = {IOF-Tracker: A Two-Stage Multiple Targets Tracking Method Using Spatial-Temporal Fusion Algorithm},
journal = {Applied Sciences},
year = {2024},
volume = {15},
number = {1},
pages = {107},
doi = {10.3390/app15010107}
}
EUVIMED