SRE-YOLOv8: An Improved UAV Object Detection Model Utilizing Swin Transformer and RE-FPN
Sensors · 17.06.2024 · 24 (12) · 3918
DOI: 10.3390/s24123918 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 17.06.2024. Verfasst von Jun Li und 3 weiteren Autor:innen. Beteiligte Einrichtung: Artificial Intelligence Security Innovation Research, Beijing Information Science and Technology University, Beijing 100192, China. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Basic Research Project of the National Defense Science and Industry Bureau, the Translational Application Project of the "Wise Eyes Action".
Abstract (Originalsprache)
To tackle the intricate challenges associated with the low detection accuracy of images taken by unmanned aerial vehicles (UAVs), arising from the diverse sizes and types of objects coupled with limited feature information, we present the SRE-YOLOv8 as an advanced method. Our method enhances the YOLOv8 object detection algorithm by leveraging the Swin Transformer and a lightweight residual feature pyramid network (RE-FPN) structure. Firstly, we introduce an optimized Swin Transformer module into the backbone network to preserve ample global contextual information during feature extraction and to extract a broader spectrum of features using self-attention mechanisms. Subsequently, we integrate a Residual Feature Augmentation (RFA) module and a lightweight attention mechanism named ECA, thereby transforming the original FPN structure to RE-FPN, intensifying the network’s emphasis on critical features. Additionally, an SOD (small object detection) layer is incorporated to enhance the network’s ability to recognize the spatial information of the model, thus augmenting accuracy in detecting small objects. Finally, we employ a Dynamic Head equipped with multiple attention mechanisms in the object detection head to enhance its performance in identifying low-resolution targets amidst complex backgrounds. Experimental evaluation conducted on the VisDrone2021 dataset reveals a significant advancement, showcasing an impressive 9.2% enhancement over the original YOLOv8 algorithm.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Artificial Intelligence Security Innovation Research, Beijing Information Science and Technology University, Beijing 100192, China.
- Department of Information Security, Beijing Information Science and Technology University, Beijing 100192, China.
- National Computer System Engineering Research Institute of China, Beijing 100083, China.
- School of Computer Science and Technology, East China Normal University, Shanghai 200062, China.
- Shanghai International School of Chief Technology Officer, East China Normal University, Shanghai 200062, China.
ORCID-Profile: Feng Liu
Förderung
- Basic Research Project of the National Defense Science and Industry Bureau
- the Translational Application Project of the "Wise Eyes Action"
Zitieren
APA
Li, J., Zhang, J., Shao, Y., & Liu, F. (2024). SRE-YOLOv8: An Improved UAV Object Detection Model Utilizing Swin Transformer and RE-FPN. Sensors, 24(12), 3918. https://doi.org/10.3390/s24123918
Vancouver
Li J, Zhang J, Shao Y, Liu F. SRE-YOLOv8: An Improved UAV Object Detection Model Utilizing Swin Transformer and RE-FPN. Sensors. 2024;24(12):3918. doi:10.3390/s24123918
BibTeX
@article{Li2024,
author = {Li, Jun and Zhang, Jiajie and Shao, Yanhua and Liu, Feng},
title = {SRE-YOLOv8: An Improved UAV Object Detection Model Utilizing Swin Transformer and RE-FPN},
journal = {Sensors},
year = {2024},
volume = {24},
number = {12},
pages = {3918},
doi = {10.3390/s24123918}
}
EUVIMED