EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Efficient Pruning of Detection Transformer in Remote Sensing Using Ant Colony Evolutionary Pruning

Hailin Su, Haijiang Sun, Yongxian Zhao

Applied Sciences · 29.12.2024 · 15 (1) · 200

DOI: 10.3390/app15010200 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 29.12.2024. Verfasst von Hailin Su und 2 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study mainly addresses the issues of an excessive model parameter count and computational complexity in Detection Transformer (DETR) for remote sensing object detection and similar neural networks. We propose an innovative neural network pruning method called “ant colony evolutionary pruning (ACEP)” which reduces the number of parameters in the neural network to improve the performance and efficiency of DETR-based neural networks in the remote sensing field. To retain the original network’s performance as much as possible, we combine population evolution and ant colony algorithms for dynamic search processes to automatically find efficient sparse sub-networks. Additionally, we design three different sparse operators based on the structural characteristics of DETR-like neural networks. Furthermore, considering the characteristics of remote sensing objects, we introduce sparsity constraints to each network layer to achieve efficient network pruning. The experimental results demonstrate that ACEP is effective on various DETR-like models. After removing a significant number of redundant parameters, it greatly improves the inference speed of these networks when performing remote sensing object detection tasks.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Su, H., Sun, H., & Zhao, Y. (2024). Efficient Pruning of Detection Transformer in Remote Sensing Using Ant Colony Evolutionary Pruning. Applied Sciences, 15(1), 200. https://doi.org/10.3390/app15010200

Vancouver

Su H, Sun H, Zhao Y. Efficient Pruning of Detection Transformer in Remote Sensing Using Ant Colony Evolutionary Pruning. Applied Sciences. 2024;15(1):200. doi:10.3390/app15010200

BibTeX
@article{Su2024,
  author = {Su, Hailin and Sun, Haijiang and Zhao, Yongxian},
  title = {Efficient Pruning of Detection Transformer in Remote Sensing Using Ant Colony Evolutionary Pruning},
  journal = {Applied Sciences},
  year = {2024},
  volume = {15},
  number = {1},
  pages = {200},
  doi = {10.3390/app15010200}
}
Kostenlos starten →