Semi-transductive Learning for Generalized Zero-Shot Sketch-Based Image Retrieval
Proceedings of the AAAI Conference on Artificial Intelligence · 26.06.2023 · 37 (6) · 7678-7686
DOI: 10.1609/aaai.v37i6.25931 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 26.06.2023. Verfasst von Ce Ge und 5 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref).
Abstract (Originalsprache)
Sketch-based image retrieval (SBIR) is an attractive research area where freehand sketches are used as queries to retrieve relevant images. Existing solutions have advanced the task to the challenging zero-shot setting (ZS-SBIR), where the trained models are tested on new classes without seen data. However, they are prone to overfitting under a realistic scenario when the test data includes both seen and unseen classes. In this paper, we study generalized ZS-SBIR (GZS-SBIR) and propose a novel semi-transductive learning paradigm. Transductive learning is performed on the image modality to explore the potential data distribution within unseen classes, and zero-shot learning is performed on the sketch modality sharing the learned knowledge through a semi-heterogeneous architecture. A hybrid metric learning strategy is proposed to establish semantics-aware ranking property and calibrate the joint embedding space. Extensive experiments are conducted on two large-scale benchmarks and four evaluation metrics. The results show that our method is superior over the state-of-the-art competitors in the challenging GZS-SBIR task.
Zitieren
APA
Ge, C., Wang, J., Qi, Q., Sun, H., Xu, T., & Liao, J. (2023). Semi-transductive Learning for Generalized Zero-Shot Sketch-Based Image Retrieval. Proceedings of the AAAI Conference on Artificial Intelligence, 37(6), 7678-7686. https://doi.org/10.1609/aaai.v37i6.25931
Vancouver
Ge C, Wang J, Qi Q, Sun H, Xu T, Liao J. Semi-transductive Learning for Generalized Zero-Shot Sketch-Based Image Retrieval. Proceedings of the AAAI Conference on Artificial Intelligence. 2023;37(6):7678-7686. doi:10.1609/aaai.v37i6.25931
BibTeX
@article{Ge2023,
author = {Ge, Ce and Wang, Jingyu and Qi, Qi and Sun, Haifeng and Xu, Tong and Liao, Jianxin},
title = {Semi-transductive Learning for Generalized Zero-Shot Sketch-Based Image Retrieval},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2023},
volume = {37},
number = {6},
pages = {7678--7686},
doi = {10.1609/aaai.v37i6.25931}
}
EUVIMED