Multi-Task Visual Perception for Object Detection and Semantic Segmentation in Intelligent Driving
Remote Sensing · 16.05.2024 · 16 (10) · 1774
DOI: 10.3390/rs16101774 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 16.05.2024. Verfasst von Jiao Zhan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, Major Science and Technology Project of Hubei Province of China.
Abstract (Originalsprache)
With the rapid development of intelligent driving vehicles, multi-task visual perception based on deep learning emerges as a key technological pathway toward safe vehicle navigation in real traffic scenarios. However, due to the high-precision and high-efficiency requirements of intelligent driving vehicles in practical driving environments, multi-task visual perception remains a challenging task. Existing methods typically adopt effective multi-task learning networks to concurrently handle multiple tasks. Despite the fact that they obtain remarkable achievements, better performance can be achieved through tackling existing problems like underutilized high-resolution features and underexploited non-local contextual dependencies. In this work, we propose YOLOPv3, an efficient anchor-based multi-task visual perception network capable of handling traffic object detection, drivable area segmentation, and lane detection simultaneously. Compared to prior works, we make essential improvements. On the one hand, we propose architecture enhancements that can utilize multi-scale high-resolution features and non-local contextual dependencies for improving network performance. On the other hand, we propose optimization improvements aiming at enhancing network training, enabling our YOLOPv3 to achieve optimal performance via straightforward end-to-end training. The experimental results on the BDD100K dataset demonstrate that YOLOPv3 sets a new state of the art (SOTA): 96.9% recall and 84.3% mAP50 in traffic object detection, 93.2% mIoU in drivable area segmentation, and 88.3% accuracy and 28.0% IoU in lane detection. In addition, YOLOPv3 maintains competitive inference speed against the lightweight YOLOP. Thus, YOLOPv3 stands as a robust solution for handling multi-task visual perception problems. The code and trained models have been released on GitHub.
Förderung
- National Key Research and Development Program of China
- Major Science and Technology Project of Hubei Province of China
Zitieren
APA
Zhan, J., Liu, J., Wu, Y., & Guo, C. (2024). Multi-Task Visual Perception for Object Detection and Semantic Segmentation in Intelligent Driving. Remote Sensing, 16(10), 1774. https://doi.org/10.3390/rs16101774
Vancouver
Zhan J, Liu J, Wu Y, Guo C. Multi-Task Visual Perception for Object Detection and Semantic Segmentation in Intelligent Driving. Remote Sensing. 2024;16(10):1774. doi:10.3390/rs16101774
BibTeX
@article{Zhan2024,
author = {Zhan, Jiao and Liu, Jingnan and Wu, Yejun and Guo, Chi},
title = {Multi-Task Visual Perception for Object Detection and Semantic Segmentation in Intelligent Driving},
journal = {Remote Sensing},
year = {2024},
volume = {16},
number = {10},
pages = {1774},
doi = {10.3390/rs16101774}
}
EUVIMED