EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Text-Guided Image Editing Based on Post Score for Gaining Attention on Social Media

Yuto Watanabe iD, Ren Togo iD, Keisuke Maeda iD, Takahiro Ogawa iD, Miki Haseyama iD

Sensors · 2024

DOI: 10.3390/s24030921 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2024. Verfasst von Yuto Watanabe und 4 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Information Science and Technology, Hokkaido University, N-14, W-9, Kita-ku, Sapporo 060-0814, Hokkaido, Japan. Hauptthemen laut MEDLINE: Social Media. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Society for the Promotion of Science, Japan Society for the Promotion of Science (JSPS) KAKENHI.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Text-guided image editing has been highlighted in the fields of computer vision and natural language processing in recent years. The approach takes an image and text prompt as input and aims to edit the image in accordance with the text prompt while preserving text-unrelated regions. The results of text-guided image editing differ depending on the way the text prompt is represented, even if it has the same meaning. It is up to the user to decide which result best matches the intended use of the edited image. This paper assumes a situation in which edited images are posted to social media and proposes a novel text-guided image editing method to help the edited images gain attention from a greater audience. In the proposed method, we apply the pre-trained text-guided image editing method and obtain multiple edited images from the multiple text prompts generated from a large language model. The proposed method leverages the novel model that predicts post scores representing engagement rates and selects one image that will gain the most attention from the audience on social media among these edited images. Subject experiments on a dataset of real Instagram posts demonstrate that the edited images of the proposed method accurately reflect the content of the text prompts and provide a positive impression to the audience on social media compared to those of previous text-guided image editing methods.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Social MediaHumansLanguageNatural Language Processing

Stichwörter der Autor:innen

diffusion modelpost scoreposted image editingsocial media marketingtext-guided image editing

Autor:innen und Institutionen

  • Graduate School of Information Science and Technology, Hokkaido University, N-14, W-9, Kita-ku, Sapporo 060-0814, Hokkaido, Japan.
  • Faculty of Information Science and Technology, Hokkaido University, N-14, W-9, Kita-ku, Sapporo 060-0814, Hokkaido, Japan.

ORCID-Profile: Yuto Watanabe, Ren Togo, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

Förderung

  • Japan Society for the Promotion of Science
  • Japan Society for the Promotion of Science (JSPS) KAKENHI

Zitieren

APA

Watanabe, Y., Togo, R., Maeda, K., Ogawa, T., & Haseyama, M. (2024). Text-Guided Image Editing Based on Post Score for Gaining Attention on Social Media. Sensors. https://doi.org/10.3390/s24030921

Vancouver

Watanabe Y, Togo R, Maeda K, Ogawa T, Haseyama M. Text-Guided Image Editing Based on Post Score for Gaining Attention on Social Media. Sensors. 2024. doi:10.3390/s24030921

BibTeX
@article{Watanabe2024,
  author = {Watanabe, Yuto and Togo, Ren and Maeda, Keisuke and Ogawa, Takahiro and Haseyama, Miki},
  title = {Text-Guided Image Editing Based on Post Score for Gaining Attention on Social Media},
  journal = {Sensors},
  year = {2024},
  doi = {10.3390/s24030921}
}
Kostenlos starten →