EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Long-Tailed Object Detection for Multimodal Remote Sensing Images

Jiaxin Yang, Miaomiao Yu, Shuohao Li, Jun Zhang, Shengze Hu

Remote Sensing · 15.09.2023 · 15 (18) · 4539

DOI: 10.3390/rs15184539 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 15.09.2023. Verfasst von Jiaxin Yang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the rapid development of remote sensing technology, the application of convolutional neural networks in remote sensing object detection has become very widespread, and some multimodal feature fusion networks have also been proposed in recent years. However, these methods generally do not consider the long-tailed problem that is widely present in remote sensing images, which limits the further improvement of model detection performance. To solve this problem, we propose a novel long-tailed object detection method for multimodal remote sensing images, which can effectively fuse the complementary information of visible light and infrared images and adapt to the imbalance between positive and negative samples of different categories. Firstly, the dynamic feature fusion module (DFF) based on image entropy can dynamically adjust the fusion coefficient according to the information content of different source images, retaining more key feature information for subsequent object detection. Secondly, the instance-balanced mosaic (IBM) data augmentation method balances instance sampling during data augmentation, providing more sample features for the model and alleviating the negative impact of data distribution imbalance. Finally, class-balanced BCE loss (CBB) can not only consider the learning difficulty of specific instances but also balances the learning difficulty between categories, thereby improving the model’s detection accuracy for tail instances. Experimental results on three public benchmark datasets show that our proposed method achieves state-of-the-art performance; in particular, the optimization of the long-tailed problem enables the model to meet various application scenarios of remote sensing image detection.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Yang, J., Yu, M., Li, S., Zhang, J., & Hu, S. (2023). Long-Tailed Object Detection for Multimodal Remote Sensing Images. Remote Sensing, 15(18), 4539. https://doi.org/10.3390/rs15184539

Vancouver

Yang J, Yu M, Li S, Zhang J, Hu S. Long-Tailed Object Detection for Multimodal Remote Sensing Images. Remote Sensing. 2023;15(18):4539. doi:10.3390/rs15184539

BibTeX
@article{Yang2023,
  author = {Yang, Jiaxin and Yu, Miaomiao and Li, Shuohao and Zhang, Jun and Hu, Shengze},
  title = {Long-Tailed Object Detection for Multimodal Remote Sensing Images},
  journal = {Remote Sensing},
  year = {2023},
  volume = {15},
  number = {18},
  pages = {4539},
  doi = {10.3390/rs15184539}
}
Kostenlos starten →