EUVIMEDEUVIMED entdecken
Crossref

Concept Decomposition for Visual Exploration and Inspiration

Yael Vinker, Andrey Voynov, Daniel Cohen-Or, Ariel Shamir

ACM Transactions on Graphics · 05.12.2023 · 42 (6) · 1-13

DOI: 10.1145/3618315 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 05.12.2023. Verfasst von Yael Vinker und 3 weiteren Autor:innen. Die Arbeit wurde bisher 48-mal zitiert (Crossref) und nennt 69 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A creative idea is often born from transforming, combining, and modifying ideas from existing visual examples capturing various concepts. However, one cannot simply copy the concept as a whole, and inspiration is achieved by examining certain aspects of the concept. Hence, it is often necessary to separate a concept into different aspects to provide new perspectives. In this paper, we propose a method to decompose a visual concept, represented as a set of images, into different visual aspects encoded in a hierarchical tree structure. We utilize large vision-language models and their rich latent space for concept decomposition and generation. Each node in the tree represents a sub-concept using a learned vector embedding injected into the latent space of a pretrained text-to-image model. We use a set of regularizations to guide the optimization of the embedding vectors encoded in the nodes to follow the hierarchical structure of the tree. Our method allows to explore and discover new concepts derived from the original one. The tree provides the possibility of endless visual sampling at each node, allowing the user to explore the hidden sub-concepts of the object of interest. The learned aspects in each node can be combined within and across trees to create new visual ideas, and can be used in natural language sentences to apply such aspects to new designs. Project page: https://inspirationtree.github.io/inspirationtree/

Zitieren

APA

Vinker, Y., Voynov, A., Cohen-Or, D., & Shamir, A. (2023). Concept Decomposition for Visual Exploration and Inspiration. ACM Transactions on Graphics, 42(6), 1-13. https://doi.org/10.1145/3618315

Vancouver

Vinker Y, Voynov A, Cohen-Or D, Shamir A. Concept Decomposition for Visual Exploration and Inspiration. ACM Transactions on Graphics. 2023;42(6):1-13. doi:10.1145/3618315

BibTeX
@article{Vinker2023,
  author = {Vinker, Yael and Voynov, Andrey and Cohen-Or, Daniel and Shamir, Ariel},
  title = {Concept Decomposition for Visual Exploration and Inspiration},
  journal = {ACM Transactions on Graphics},
  year = {2023},
  volume = {42},
  number = {6},
  pages = {1--13},
  doi = {10.1145/3618315}
}
Kostenlos starten →