EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

TANet: Transformer‐based asymmetric network for RGB‐D salient object detection

Chang Liu, Gang Yang, Shuo Wang, Hangxu Wang, Yunhua Zhang, Yutao Wang

IET Computer Vision · 2023-06 · 17 (4) · 415-430

DOI: 10.1049/cvi2.12177 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IET Computer Vision, online erschienen am 16.02.2023. Verfasst von Chang Liu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Existing RGB‐D salient object detection methods mainly rely on a symmetric two‐stream Convolutional Neural Network (CNN)‐based network to extract RGB and depth channel features separately. However, there are two problems with the symmetric conventional network structure: first, the ability of CNN in learning global contexts is limited; second, the symmetric two‐stream structure ignores the inherent differences between modalities. In this study, a Transformer‐based asymmetric network is proposed to tackle the issues mentioned above. The authors employ the powerful feature extraction capability of Transformer to extract global semantic information from RGB data and design a lightweight CNN backbone to extract spatial structure information from depth data without pre‐training. The asymmetric hybrid encoder effectively reduces the number of parameters in the model while increasing speed without sacrificing performance. Then, a cross‐modal feature fusion module which enhances and fuses RGB and depth features with each other is designed. Finally, the authors add edge prediction as an auxiliary task and propose an edge enhancement module to generate sharper contours. Extensive experiments demonstrate that our method achieves superior performance over 14 state‐of‐the‐art RGB‐D methods on six public datasets. The code of the authors will be released at https://github.com/lc012463/TANet .

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Liu, C., Yang, G., Wang, S., Wang, H., Zhang, Y., & Wang, Y. (2023). TANet: Transformer‐based asymmetric network for RGB‐D salient object detection. IET Computer Vision, 17(4), 415-430. https://doi.org/10.1049/cvi2.12177

Vancouver

Liu C, Yang G, Wang S, Wang H, Zhang Y, Wang Y. TANet: Transformer‐based asymmetric network for RGB‐D salient object detection. IET Computer Vision. 2023;17(4):415-430. doi:10.1049/cvi2.12177

BibTeX
@article{Liu2023,
  author = {Liu, Chang and Yang, Gang and Wang, Shuo and Wang, Hangxu and Zhang, Yunhua and Wang, Yutao},
  title = {TANet: Transformer‐based asymmetric network for RGB‐D salient object detection},
  journal = {IET Computer Vision},
  year = {2023},
  volume = {17},
  number = {4},
  pages = {415--430},
  doi = {10.1049/cvi2.12177}
}
Kostenlos starten →