EUVIMEDEUVIMED entdecken
Crossref

Unsupervised Part Discovery via Dual Representation Alignment

Jiahao Xia, Wenjian Huang, Min Xu, Jianguo Zhang, Haimin Zhang, Ziyu Sheng, Dong Xu

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024-12 · 46 (12) · 10597-10613

DOI: 10.1109/tpami.2024.3445582 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024-12. Verfasst von Jiahao Xia und 6 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 74 Literaturangaben. Gefördert von: China Scholarship Council.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Object parts serve as crucial intermediate representations in various downstream tasks, but part-level representation learning still has not received as much attention as other vision tasks. Previous research has established that Vision Transformer can learn instance-level attention without labels, extracting high-quality instance-level representations for boosting downstream tasks. In this paper, we achieve unsupervised part-specific attention learning using a novel paradigm and further employ the part representations to improve part discovery performance. Specifically, paired images are generated from the same image with different geometric transformations, and multiple part representations are extracted from these paired images using a novel module, named PartFormer. These part representations from the paired images are then exchanged to improve geometric transformation invariance. Subsequently, the part representations are aligned with the feature map extracted by a feature map encoder, achieving high similarity with the pixel representations of the corresponding part regions and low similarity in irrelevant regions. Finally, the geometric and semantic constraints are applied to the part representations through the intermediate results in alignment for part-specific attention learning, encouraging the PartFormer to focus locally and the part representations to explicitly include the information of the corresponding parts. Moreover, the aligned part representations can further serve as a series of reliable detectors in the testing phase, predicting pixel masks for part discovery. Extensive experiments are carried out on four widely used datasets, and our results demonstrate that the proposed method achieves competitive performance and robustness due to its part-specific attention.

Förderung

  • China Scholarship Council

Zitieren

APA

Xia, J., Huang, W., Xu, M., Zhang, J., Zhang, H., Sheng, Z., & Xu, D. (2024). Unsupervised Part Discovery via Dual Representation Alignment. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(12), 10597-10613. https://doi.org/10.1109/tpami.2024.3445582

Vancouver

Xia J, Huang W, Xu M, Zhang J, Zhang H, Sheng Z, et al. Unsupervised Part Discovery via Dual Representation Alignment. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(12):10597-10613. doi:10.1109/tpami.2024.3445582

BibTeX
@article{Xia2024,
  author = {Xia, Jiahao and Huang, Wenjian and Xu, Min and Zhang, Jianguo and Zhang, Haimin and Sheng, Ziyu and Xu, Dong},
  title = {Unsupervised Part Discovery via Dual Representation Alignment},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2024},
  volume = {46},
  number = {12},
  pages = {10597--10613},
  doi = {10.1109/tpami.2024.3445582}
}
Kostenlos starten →