Watermarking for Stable Diffusion Models
IEEE Internet of Things Journal · 01.11.2024 · 11 (21) · 35238-35249
DOI: 10.1109/jiot.2024.3434656 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Internet of Things Journal, erschienen am 01.11.2024. Verfasst von Zihan Yuan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 33-mal zitiert (Crossref) und nennt 31 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Chenguang Program of Shanghai Education Development Foundation and Shanghai Municipal Education Commission.
Abstract (Originalsprache)
In the scenario of text data and image data interact of the Internet of Things (IoT) applications, the problem of copyright protection of the text-to-image models is threatened due to the replicability and portability of the neural network model. In order to solve this problem, we propose a model watermarking for the typical text-to-image diffusion models (DMs)–stable DMs (SDMs), which is a key aspect of the copyright protection of text-to-image models. Our scheme injects watermark into an SDM and makes the SDM generate watermark through a predefined prompt. The ownership of the SDM can be proved by the different output results of the model to the predefined prompt. The proposed method does not require raw training data and internal details of SDMs, which only need a predefined prompt and watermark to fine tune the pretrained SDM with minimal epoch. A large number of experiments show that our watermarking technology is effective, and can realize the copyright protection of the SDMs on the premise of less influence on the original function.
Förderung
- National Natural Science Foundation of China
- Chenguang Program of Shanghai Education Development Foundation and Shanghai Municipal Education Commission
Zitieren
APA
Yuan, Z., Li, L., Wang, Z., & Zhang, X. (2024). Watermarking for Stable Diffusion Models. IEEE Internet of Things Journal, 11(21), 35238-35249. https://doi.org/10.1109/jiot.2024.3434656
Vancouver
Yuan Z, Li L, Wang Z, Zhang X. Watermarking for Stable Diffusion Models. IEEE Internet of Things Journal. 2024;11(21):35238-35249. doi:10.1109/jiot.2024.3434656
BibTeX
@article{Yuan2024,
author = {Yuan, Zihan and Li, Li and Wang, Zichi and Zhang, Xinpeng},
title = {Watermarking for Stable Diffusion Models},
journal = {IEEE Internet of Things Journal},
year = {2024},
volume = {11},
number = {21},
pages = {35238--35249},
doi = {10.1109/jiot.2024.3434656}
}
EUVIMED