Text-Guided Image Editing Based on Post Score for Gaining Attention on Social Media
Sensors · 2024
DOI: 10.3390/s24030921 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2024. Verfasst von Yuto Watanabe und 4 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Information Science and Technology, Hokkaido University, N-14, W-9, Kita-ku, Sapporo 060-0814, Hokkaido, Japan. Hauptthemen laut MEDLINE: Social Media. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Society for the Promotion of Science, Japan Society for the Promotion of Science (JSPS) KAKENHI.
Abstract (Originalsprache)
Text-guided image editing has been highlighted in the fields of computer vision and natural language processing in recent years. The approach takes an image and text prompt as input and aims to edit the image in accordance with the text prompt while preserving text-unrelated regions. The results of text-guided image editing differ depending on the way the text prompt is represented, even if it has the same meaning. It is up to the user to decide which result best matches the intended use of the edited image. This paper assumes a situation in which edited images are posted to social media and proposes a novel text-guided image editing method to help the edited images gain attention from a greater audience. In the proposed method, we apply the pre-trained text-guided image editing method and obtain multiple edited images from the multiple text prompts generated from a large language model. The proposed method leverages the novel model that predicts post scores representing engagement rates and selects one image that will gain the most attention from the audience on social media among these edited images. Subject experiments on a dataset of real Instagram posts demonstrate that the edited images of the proposed method accurately reflect the content of the text prompts and provide a positive impression to the audience on social media compared to those of previous text-guided image editing methods.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Graduate School of Information Science and Technology, Hokkaido University, N-14, W-9, Kita-ku, Sapporo 060-0814, Hokkaido, Japan.
- Faculty of Information Science and Technology, Hokkaido University, N-14, W-9, Kita-ku, Sapporo 060-0814, Hokkaido, Japan.
ORCID-Profile: Yuto Watanabe, Ren Togo, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama
Förderung
- Japan Society for the Promotion of Science
- Japan Society for the Promotion of Science (JSPS) KAKENHI
Zitieren
APA
Watanabe, Y., Togo, R., Maeda, K., Ogawa, T., & Haseyama, M. (2024). Text-Guided Image Editing Based on Post Score for Gaining Attention on Social Media. Sensors. https://doi.org/10.3390/s24030921
Vancouver
Watanabe Y, Togo R, Maeda K, Ogawa T, Haseyama M. Text-Guided Image Editing Based on Post Score for Gaining Attention on Social Media. Sensors. 2024. doi:10.3390/s24030921
BibTeX
@article{Watanabe2024,
author = {Watanabe, Yuto and Togo, Ren and Maeda, Keisuke and Ogawa, Takahiro and Haseyama, Miki},
title = {Text-Guided Image Editing Based on Post Score for Gaining Attention on Social Media},
journal = {Sensors},
year = {2024},
doi = {10.3390/s24030921}
}
EUVIMED