EUVIMEDEUVIMED entdecken
Crossref

Lightweight Real-Time Semantic Segmentation Network With Efficient Transformer and CNN

Guoan Xu, Juncheng Li, Guangwei Gao, Huimin Lu, Jian Yang, Dong Yue

IEEE Transactions on Intelligent Transportation Systems · 2023-12 · 24 (12) · 15897-15906

DOI: 10.1109/tits.2023.3248089 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2023-12. Verfasst von Guoan Xu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 201-mal zitiert (Crossref) und nennt 54 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Open Fund Project of Provincial Key Laboratory for Computer Information Processing Technology, Soochow University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In the past decade, convolutional neural networks (CNNs) have shown prominence for semantic segmentation. Although CNN models have very impressive performance, the ability to capture global representation is still insufficient, which results in suboptimal results. Recently, Transformer achieved huge success in NLP tasks, demonstrating its advantages in modeling long-range dependency. Recently, Transformer has also attracted tremendous attention from computer vision researchers who reformulate the image processing tasks as a sequence-to-sequence prediction but resulted in deteriorating local feature details. In this work, we propose a lightweight real-time semantic segmentation network called LETNet. LETNet combines a U-shaped CNN with Transformer effectively in a capsule embedding style to compensate for respective deficiencies. Meanwhile, the elaborately designed Lightweight Dilated Bottleneck (LDB) module and Feature Enhancement (FE) module cultivate a positive impact on training from scratch simultaneously. Extensive experiments performed on challenging datasets demonstrate that LETNet achieves superior performances in accuracy and efficiency balance. Specifically, It only contains 0.95M parameters and 13.6G FLOPs but yields 72.8% mIoU at 120 FPS on the Cityscapes test set and 70.5% mIoU at 250 FPS on the CamVid test dataset using a single RTX 3090 GPU. Source code will be available at https://github.com/IVIPLab/LETNet.

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China
  • Open Fund Project of Provincial Key Laboratory for Computer Information Processing Technology, Soochow University

Zitieren

APA

Xu, G., Li, J., Gao, G., Lu, H., Yang, J., & Yue, D. (2023). Lightweight Real-Time Semantic Segmentation Network With Efficient Transformer and CNN. IEEE Transactions on Intelligent Transportation Systems, 24(12), 15897-15906. https://doi.org/10.1109/tits.2023.3248089

Vancouver

Xu G, Li J, Gao G, Lu H, Yang J, Yue D. Lightweight Real-Time Semantic Segmentation Network With Efficient Transformer and CNN. IEEE Transactions on Intelligent Transportation Systems. 2023;24(12):15897-15906. doi:10.1109/tits.2023.3248089

BibTeX
@article{Xu2023,
  author = {Xu, Guoan and Li, Juncheng and Gao, Guangwei and Lu, Huimin and Yang, Jian and Yue, Dong},
  title = {Lightweight Real-Time Semantic Segmentation Network With Efficient Transformer and CNN},
  journal = {IEEE Transactions on Intelligent Transportation Systems},
  year = {2023},
  volume = {24},
  number = {12},
  pages = {15897--15906},
  doi = {10.1109/tits.2023.3248089}
}
Kostenlos starten →