EUVIMEDEUVIMED entdecken
Crossref

Watermarking for Stable Diffusion Models

Zihan Yuan, Li Li, Zichi Wang, Xinpeng Zhang

IEEE Internet of Things Journal · 01.11.2024 · 11 (21) · 35238-35249

DOI: 10.1109/jiot.2024.3434656 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Internet of Things Journal, erschienen am 01.11.2024. Verfasst von Zihan Yuan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 33-mal zitiert (Crossref) und nennt 31 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Chenguang Program of Shanghai Education Development Foundation and Shanghai Municipal Education Commission.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In the scenario of text data and image data interact of the Internet of Things (IoT) applications, the problem of copyright protection of the text-to-image models is threatened due to the replicability and portability of the neural network model. In order to solve this problem, we propose a model watermarking for the typical text-to-image diffusion models (DMs)–stable DMs (SDMs), which is a key aspect of the copyright protection of text-to-image models. Our scheme injects watermark into an SDM and makes the SDM generate watermark through a predefined prompt. The ownership of the SDM can be proved by the different output results of the model to the predefined prompt. The proposed method does not require raw training data and internal details of SDMs, which only need a predefined prompt and watermark to fine tune the pretrained SDM with minimal epoch. A large number of experiments show that our watermarking technology is effective, and can realize the copyright protection of the SDMs on the premise of less influence on the original function.

Förderung

  • National Natural Science Foundation of China
  • Chenguang Program of Shanghai Education Development Foundation and Shanghai Municipal Education Commission

Zitieren

APA

Yuan, Z., Li, L., Wang, Z., & Zhang, X. (2024). Watermarking for Stable Diffusion Models. IEEE Internet of Things Journal, 11(21), 35238-35249. https://doi.org/10.1109/jiot.2024.3434656

Vancouver

Yuan Z, Li L, Wang Z, Zhang X. Watermarking for Stable Diffusion Models. IEEE Internet of Things Journal. 2024;11(21):35238-35249. doi:10.1109/jiot.2024.3434656

BibTeX
@article{Yuan2024,
  author = {Yuan, Zihan and Li, Li and Wang, Zichi and Zhang, Xinpeng},
  title = {Watermarking for Stable Diffusion Models},
  journal = {IEEE Internet of Things Journal},
  year = {2024},
  volume = {11},
  number = {21},
  pages = {35238--35249},
  doi = {10.1109/jiot.2024.3434656}
}
Kostenlos starten →