EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

YOLO-DCTI: Small Object Detection in Remote Sensing Base on Contextual Transformer Enhancement

Lingtong Min, Ziman Fan, Qinyi Lv, Mohamed Reda, Linghao Shen, Binglu Wang

Remote Sensing · 10.08.2023 · 15 (16) · 3970

DOI: 10.3390/rs15163970 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 10.08.2023. Verfasst von Lingtong Min und 5 weiteren Autor:innen. Die Arbeit wurde bisher 80-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities, the Postdoctoral Science Foundation of China, the Fourth Special Grant of China Postdoctoral Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Object detection for remote sensing is a fundamental task in image processing of remote sensing; as one of the core components, small or tiny object detection plays an important role. Despite the considerable advancements achieved in small object detection with the integration of CNN and transformer networks, there remains untapped potential for enhancing the extraction and utilization of information associated with small objects. Particularly within transformer structures, this potential arises from the disregard of the complex and the intertwined interplay between spatial context information and channel information during the global modeling of pixel-level information within small objects. As a result, valuable information is prone to being obfuscated and annihilated. To mitigate this limitation, we propose an innovative framework, YOLO-DCTI, that capitalizes on the Contextual Transformer (CoT) framework for the detection of small or tiny objects. Specifically, within CoT, we seamlessly incorporate global residuals and local fusion mechanisms throughout the entire input-to-output pipeline. This integration facilitates a profound investigation into the network’s intrinsic representations at deeper levels and fosters the fusion of spatial contextual attributes with channel characteristics. Moreover, we propose an improved decoupled contextual transformer detection head structure, denoted as DCTI, to effectively resolve the feature conflicts that ensue from the concurrent classification and regression tasks. The experimental results on the Dota, VISDrone, and NWPU VHR-10 datasets show that, on the powerful real-time detection network YOLOv7, the speed and accuracy of tiny targets are better balanced.

Förderung

  • National Natural Science Foundation of China
  • Fundamental Research Funds for the Central Universities, the Postdoctoral Science Foundation of China
  • the Fourth Special Grant of China Postdoctoral Science Foundation

Zitieren

APA

Min, L., Fan, Z., Lv, Q., Reda, M., Shen, L., & Wang, B. (2023). YOLO-DCTI: Small Object Detection in Remote Sensing Base on Contextual Transformer Enhancement. Remote Sensing, 15(16), 3970. https://doi.org/10.3390/rs15163970

Vancouver

Min L, Fan Z, Lv Q, Reda M, Shen L, Wang B. YOLO-DCTI: Small Object Detection in Remote Sensing Base on Contextual Transformer Enhancement. Remote Sensing. 2023;15(16):3970. doi:10.3390/rs15163970

BibTeX
@article{Min2023,
  author = {Min, Lingtong and Fan, Ziman and Lv, Qinyi and Reda, Mohamed and Shen, Linghao and Wang, Binglu},
  title = {YOLO-DCTI: Small Object Detection in Remote Sensing Base on Contextual Transformer Enhancement},
  journal = {Remote Sensing},
  year = {2023},
  volume = {15},
  number = {16},
  pages = {3970},
  doi = {10.3390/rs15163970}
}
Kostenlos starten →