EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

IV-YOLO: A Lightweight Dual-Branch Object Detection Network

Dan Tian iD, Xin Yan, Dong Zhou, Chen Wang iD, Wenshuai Zhang

Sensors · 24.09.2024 · 24 (19) · 6181

DOI: 10.3390/s24196181 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 24.09.2024. Verfasst von Dan Tian und 4 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Electronic Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, China. Die Arbeit wurde bisher 31-mal zitiert (Crossref) und nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the rapid growth in demand for security surveillance, assisted driving, and remote sensing, object detection networks with robust environmental perception and high detection accuracy have become a research focus. However, single-modality image detection technologies face limitations in environmental adaptability, often affected by factors such as lighting conditions, fog, rain, and obstacles like vegetation, leading to information loss and reduced detection accuracy. We propose an object detection network that integrates features from visible light and infrared images—IV-YOLO—to address these challenges. This network is based on YOLOv8 (You Only Look Once v8) and employs a dual-branch fusion structure that leverages the complementary features of infrared and visible light images for target detection. We designed a Bidirectional Pyramid Feature Fusion structure (Bi-Fusion) to effectively integrate multimodal features, reducing errors from feature redundancy and extracting fine-grained features for small object detection. Additionally, we developed a Shuffle-SPP structure that combines channel and spatial attention to enhance the focus on deep features and extract richer information through upsampling. Regarding model optimization, we designed a loss function tailored for multi-scale object detection, accelerating the convergence speed of the network during training. Compared with the current state-of-the-art Dual-YOLO model, IV-YOLO achieves mAP improvements of 2.8%, 1.1%, and 2.2% on the Drone Vehicle, FLIR, and KAIST datasets, respectively. On the Drone Vehicle and FLIR datasets, IV-YOLO has a parameter count of 4.31 M and achieves a frame rate of 203.2 fps, significantly outperforming YOLOv8n (5.92 M parameters, 188.6 fps on the Drone Vehicle dataset) and YOLO-FIR (7.1 M parameters, 83.3 fps on the FLIR dataset), which had previously achieved the best performance on these datasets. This demonstrates that IV-YOLO achieves higher real-time detection performance while maintaining lower parameter complexity, making it highly promising for applications in autonomous driving, public safety, and beyond.

Schlagwörter

Stichwörter der Autor:innen

IV-YOLOattention mechanismbi-directional pyramid feature fusiondual-branch image object detectionsmall target detection

Autor:innen und Institutionen

  • Institute of Electronic Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, China.

ORCID-Profile: Dan Tian, Chen Wang

Zitieren

APA

Tian, D., Yan, X., Zhou, D., Wang, C., & Zhang, W. (2024). IV-YOLO: A Lightweight Dual-Branch Object Detection Network. Sensors, 24(19), 6181. https://doi.org/10.3390/s24196181

Vancouver

Tian D, Yan X, Zhou D, Wang C, Zhang W. IV-YOLO: A Lightweight Dual-Branch Object Detection Network. Sensors. 2024;24(19):6181. doi:10.3390/s24196181

BibTeX
@article{Tian2024,
  author = {Tian, Dan and Yan, Xin and Zhou, Dong and Wang, Chen and Zhang, Wenshuai},
  title = {IV-YOLO: A Lightweight Dual-Branch Object Detection Network},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {19},
  pages = {6181},
  doi = {10.3390/s24196181}
}
Kostenlos starten →