EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

EPANet-KD: Efficient progressive attention network for fine-grained provincial village classification via knowledge distillation

Cheng Zhang iD, Chunqing Liu iD, Huimin Gong, Jinlin Teng

PLOS ONE · 2024

DOI: 10.1371/journal.pone.0298452 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, 2024. Verfasst von Cheng Zhang und 3 weiteren Autor:innen. Beteiligte Einrichtung: College of Landscape Architecture and Art, Jiangxi Agricultural University, Nanchang, China. Hauptthemen laut MEDLINE: Benchmarking, Educational Personnel. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

Fine-grained classification of historical traditional villages plays a crucial role in guiding the future development and construction of urban and rural areas. This study aims to propose a new dataset for fine-grained classification of traditional villages and to propose an efficient progressive attention network for the problem of low accuracy and efficiency of fine-grained traditional historical village classification. Methods and results Firstly, in order to further study the long-standing problem of fine-grained classification of traditional villages, a new fine-grained classification dataset of traditional villages containing 4,400 images, referred to as PVCD, is proposed by crawling and hand-arranging. Secondly, a new Progressive Attention Module, abbreviated as PAM, is also proposed. PAM engages in attentional modeling of prominent spatial features within the spatial dimension, subsequently applying attentional modeling to channel features beneath the identified salient spatial features. This process involves salient spatial feature attention modeling of prominent channel features within the dimension to extract discriminative information for fine-grained classification, thereby enhancing the performance of classifying traditional villages with precision. Finally, a new knowledge distillation strategy of softened alignment distillation, or SAD for short, is proposed, which simply and efficiently transfers the knowledge of softened category probability distributions through. Notably, based on the above proposed PAM, the lightweight EPANet-Student and the heavyweight EPANet-Teacher are proposed. In addition, the heavyweight EPANet-Teacher transfers the knowledge of fine-grained categorization of traditional villages to the lightweight EPANet-Student through the proposed SAD, abbreviated as EPANet-KD. The experimental results show that the proposed EPANet-Teacher achieves state-of-the-art performance with an accuracy of 67.27%, and the proposed EPANet-KD achieves comparable performance to the proposed EPANet-Teacher with 3.32M parameters and 0.42G computation.

Conclusion

The proposed EPANet-KD maintains a good balance of accuracy and efficiency in the fine-grained classification of traditional villages, considerably promoting the research on the fine-grained classification of traditional villages. In addition, it facilitates the digital preservation and development of traditional villages. All datasets, codes and benchmarking results are publicly available for the promotion of this research area. https://github.com/Jack13026212687/EPANet-KD .

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

BenchmarkingEducational PersonnelHumansDistillationHandKnowledge

Autor:innen und Institutionen

  • College of Landscape Architecture and Art, Jiangxi Agricultural University, Nanchang, China.
  • Jiangxi Rural Culture Development Research Center, Nanchang, China.

ORCID-Profile: Cheng Zhang, Chunqing Liu

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Zhang, C., Liu, C., Gong, H., & Teng, J. (2024). EPANet-KD: Efficient progressive attention network for fine-grained provincial village classification via knowledge distillation. PLOS ONE. https://doi.org/10.1371/journal.pone.0298452

Vancouver

Zhang C, Liu C, Gong H, Teng J. EPANet-KD: Efficient progressive attention network for fine-grained provincial village classification via knowledge distillation. PLOS ONE. 2024. doi:10.1371/journal.pone.0298452

BibTeX
@article{Zhang2024,
  author = {Zhang, Cheng and Liu, Chunqing and Gong, Huimin and Teng, Jinlin},
  title = {EPANet-KD: Efficient progressive attention network for fine-grained provincial village classification via knowledge distillation},
  journal = {PLOS ONE},
  year = {2024},
  doi = {10.1371/journal.pone.0298452}
}
Kostenlos starten →