EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Efficient Visual Metaphor Image Generation Based on Metaphor Understanding

Chang Su, Xingyue Wang, Shupin Liu, Yijiang Chen

Neural Processing Letters · 16.04.2024 · 56 (3)

DOI: 10.1007/s11063-024-11609-w ↗

Kurz gefasst

Fachartikel in der Zeitschrift Neural Processing Letters, online erschienen am 16.04.2024. Verfasst von Chang Su und 3 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Metaphor has significant implications for revealing cognitive and thinking mechanisms. Visual metaphor image generation not only presents metaphorical connotations intuitively but also reflects AI’s understanding of metaphor through the generated images. This paper investigates the task of generating images based on text with visual metaphors. We explore metaphor image generation and create a dataset containing sentences with visual metaphors. Then, we propose a visual metaphor generation image framework based on metaphor understanding, which is more tailored to the essence of metaphor, better utilizes visual features, and has stronger interpretability. Specifically, the framework extracts the source domain, target domain, and metaphor interpretation from metaphorical sentences, separating the elements of the metaphor to deepen the understanding of its themes and intentions. Additionally, the framework introduces image data from the source domain to capture visual similarities and generate visual enhancement prompts specific to the domain. Finally, these prompts are combined with metaphorical interpretation sentences to form the final prompt text. Experimental results demonstrate that this approach effectively captures the essence of metaphor and generates metaphorical images consistent with the textual meaning.

Zitieren

APA

Su, C., Wang, X., Liu, S., & Chen, Y. (2024). Efficient Visual Metaphor Image Generation Based on Metaphor Understanding. Neural Processing Letters, 56(3). https://doi.org/10.1007/s11063-024-11609-w

Vancouver

Su C, Wang X, Liu S, Chen Y. Efficient Visual Metaphor Image Generation Based on Metaphor Understanding. Neural Processing Letters. 2024;56(3). doi:10.1007/s11063-024-11609-w

BibTeX
@article{Su2024,
  author = {Su, Chang and Wang, Xingyue and Liu, Shupin and Chen, Yijiang},
  title = {Efficient Visual Metaphor Image Generation Based on Metaphor Understanding},
  journal = {Neural Processing Letters},
  year = {2024},
  volume = {56},
  number = {3},
  doi = {10.1007/s11063-024-11609-w}
}
Kostenlos starten →