EUVIMEDEUVIMED entdecken
Crossref

FT-Shield: A Watermark Against Unauthorized Fine-tuning in Text-to-Image Diffusion Models

Yingqian Cui, Jie Ren, Yuping Lin, Han Xu, Pengfei He, Yue Xing, Lingjuan Lyu, Wenqi Fan, Hui Liu, Jiliang Tang

ACM SIGKDD Explorations Newsletter · 21.01.2025 · 26 (2) · 76-88

DOI: 10.1145/3715073.3715080 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM SIGKDD Explorations Newsletter, online erschienen am 29.01.2025. Verfasst von Yingqian Cui und 9 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 36 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Text-to-image generative models, especially those based on latent diffusion models (LDMs), have demonstrated outstanding ability in generating high-quality and high-resolution images from textual prompts. With this advancement, various fine-tuning methods have been developed to personalize text-to-image models for specific applications such as artistic style adaptation and human face transfer. However, such advancements have raised copyright concerns, especially when the data are used for personalization without authorization. For example, a malicious user can employ fine-tuning techniques to replicate the style of an artist without consent. In light of this concern, we propose FT-Shield, a watermarking solution tailored for the fine-tuning of text-to-image diffusion models. FT-Shield addresses copyright protection challenges by designing new watermark generation and detection strategies. In particular, it introduces an innovative algorithm for watermark generation. It ensures the seamless transfer of watermarks from training images to generated outputs, facilitating the identification of copyrighted material use. To tackle the variability in fine-tuning methods and their impact on watermark detection, FT-Shield integrates a Mixture of Experts (MoE) approach for watermark detection. Comprehensive experiments validate the effectiveness of our proposed FT-Shield.

Zitieren

APA

Cui, Y., Ren, J., Lin, Y., Xu, H., He, P., Xing, Y., Lyu, L., Fan, W., Liu, H., & Tang, J. (2025). FT-Shield: A Watermark Against Unauthorized Fine-tuning in Text-to-Image Diffusion Models. ACM SIGKDD Explorations Newsletter, 26(2), 76-88. https://doi.org/10.1145/3715073.3715080

Vancouver

Cui Y, Ren J, Lin Y, Xu H, He P, Xing Y, et al. FT-Shield: A Watermark Against Unauthorized Fine-tuning in Text-to-Image Diffusion Models. ACM SIGKDD Explorations Newsletter. 2025;26(2):76-88. doi:10.1145/3715073.3715080

BibTeX
@article{Cui2025,
  author = {Cui, Yingqian and Ren, Jie and Lin, Yuping and Xu, Han and He, Pengfei and Xing, Yue and Lyu, Lingjuan and Fan, Wenqi and Liu, Hui and Tang, Jiliang},
  title = {FT-Shield: A Watermark Against Unauthorized Fine-tuning in Text-to-Image Diffusion Models},
  journal = {ACM SIGKDD Explorations Newsletter},
  year = {2025},
  volume = {26},
  number = {2},
  pages = {76--88},
  doi = {10.1145/3715073.3715080}
}
Kostenlos starten →