EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Multimodal deep learning-based feature fusion for object detection in remote sensing images

Shoulin Yin, Qunming Wang, Liguo Wang, Mirjana Ivanovic, Hang Li

Computer Science and Information Systems · 2025 · 22 (1) · 327-344

DOI: 10.2298/csis241110011y ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Science and Information Systems, 2025. Verfasst von Shoulin Yin und 4 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Object detection is an important computer vision task, which is developed from image classification task. The difference is that it is no longer only to classify a single type of object in an image, but to complete the classification and positioning of multiple objects that may exist in an image at the same time. Classification refers to assigning category labels to the object, and positioning refers to determining the vertex coordinates of the peripheral rectangular box of the object. Therefore, object detection is more challenging and has broader application prospects, such as automatic driving, face recognition, pedestrian detection, medical detection etc,. Object detection can also be used as the research basis for more complex computer vision task such as image segmentation, image description, object tracking and action recognition. In traditional object detection, the feature utilization rate is low and it is easy to be affected by other environmental factors. Hence, this paper proposes a multimodal deep learning-based feature fusion for object detection in remote sensing images. In the new model, cascade RCNN is the backbone network. Parallel cascade RCNN network is utilized for feature fusion to enhance feature expression ability. In order to solve the problem of different segmentation shapes and sizes, the central part of the network adopts multi-coefficient cascaded hollow convolution to obtain multi-receptive field features without using pooling mode and preserving image information. Meanwhile, an improved selfattention combined receptive field strategy is used to obtain both low-level features with marginal details and high-level features with global semantics. Finally, we conduct experiments on DOTA set including ablation experiments and comparison experiments. The experimental results show that the mean Average Precision (mAP) and other indexes have been greatly improved, and its performance is better than the state-of-the-art detection algorithms. It has a good application prospect in the remote sensing image object detection task.

Zitieren

APA

Yin, S., Wang, Q., Wang, L., Ivanovic, M., & Li, H. (2025). Multimodal deep learning-based feature fusion for object detection in remote sensing images. Computer Science and Information Systems, 22(1), 327-344. https://doi.org/10.2298/csis241110011y

Vancouver

Yin S, Wang Q, Wang L, Ivanovic M, Li H. Multimodal deep learning-based feature fusion for object detection in remote sensing images. Computer Science and Information Systems. 2025;22(1):327-344. doi:10.2298/csis241110011y

BibTeX
@article{Yin2025,
  author = {Yin, Shoulin and Wang, Qunming and Wang, Liguo and Ivanovic, Mirjana and Li, Hang},
  title = {Multimodal deep learning-based feature fusion for object detection in remote sensing images},
  journal = {Computer Science and Information Systems},
  year = {2025},
  volume = {22},
  number = {1},
  pages = {327--344},
  doi = {10.2298/csis241110011y}
}
Kostenlos starten →