EUVIMEDEUVIMED entdecken
Crossref

Semantic-Guided Generative Image Augmentation Method with Diffusion Models for Image Classification

Bohan Li, Xiao Xu, Xinghao Wang, Yutai Hou, Yunlong Feng, Feng Wang, Xuanliang Zhang, Qingfu Zhu, Wanxiang Che

Proceedings of the AAAI Conference on Artificial Intelligence · 24.03.2024 · 38 (4) · 3018-3027

DOI: 10.1609/aaai.v38i4.28084 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 24.03.2024. Verfasst von Bohan Li und 8 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Existing image augmentation methods consist of two categories: perturbation-based methods and generative methods. Perturbation-based methods apply pre-defined perturbations to augment an original image, but only locally vary the image, thus lacking image diversity. In contrast, generative methods bring more image diversity in the augmented images but may not preserve semantic consistency, thus may incorrectly change the essential semantics of the original image. To balance image diversity and semantic consistency in augmented images, we propose SGID, a Semantic-guided Generative Image augmentation method with Diffusion models for image classification. Specifically, SGID employs diffusion models to generate augmented images with good image diversity. More importantly, SGID takes image labels and captions as guidance to maintain semantic consistency between the augmented and original images. Experimental results show that SGID outperforms the best augmentation baseline by 1.72% on ResNet-50 (from scratch), 0.33% on ViT (ImageNet-21k), and 0.14% on CLIP-ViT (LAION-2B). Moreover, SGID can be combined with other image augmentation baselines and further improves the overall performance. We demonstrate the semantic consistency and image diversity of SGID through quantitative human and automated evaluations, as well as qualitative case studies.

Zitieren

APA

Li, B., Xu, X., Wang, X., Hou, Y., Feng, Y., Wang, F., Zhang, X., Zhu, Q., & Che, W. (2024). Semantic-Guided Generative Image Augmentation Method with Diffusion Models for Image Classification. Proceedings of the AAAI Conference on Artificial Intelligence, 38(4), 3018-3027. https://doi.org/10.1609/aaai.v38i4.28084

Vancouver

Li B, Xu X, Wang X, Hou Y, Feng Y, Wang F, et al. Semantic-Guided Generative Image Augmentation Method with Diffusion Models for Image Classification. Proceedings of the AAAI Conference on Artificial Intelligence. 2024;38(4):3018-3027. doi:10.1609/aaai.v38i4.28084

BibTeX
@article{Li2024,
  author = {Li, Bohan and Xu, Xiao and Wang, Xinghao and Hou, Yutai and Feng, Yunlong and Wang, Feng and Zhang, Xuanliang and Zhu, Qingfu and Che, Wanxiang},
  title = {Semantic-Guided Generative Image Augmentation Method with Diffusion Models for Image Classification},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2024},
  volume = {38},
  number = {4},
  pages = {3018--3027},
  doi = {10.1609/aaai.v38i4.28084}
}
Kostenlos starten →