EUVIMEDAtklāt EUVIMED
Open access · CC BY-NC 4.0

A screen‐shooting resilient document image watermarking scheme using deep neural network

Sulong Ge, Jianwei Fei, Zhihua Xia, Yao Tong, Jian Weng, Jianan Liu

IET Image Processing · 2023-02 · 17 (2) · 323-336

DOI: 10.1049/ipr2.12653 ↗

At a glance

Journal article in IET Image Processing, published online on 2022-11-02. Written by Sulong Ge and 5 co-authors. Cited 38 times so far (Crossref); 36 references. The full text is freely available (open access, CC BY-NC 4.0). Funded by: Priority Academic Program Development of Jiangsu Higher Education Institutions, Qinglan Project of Jiangsu Province of China, National Natural Science Foundation of China.

AbstraktsBibliogrāfiskie datiCiteRelated studies

Abstract (original language)

With the advent of the screen‐reading era, the confidential documents displayed on the screen can be easily captured by a camera without leaving any traces. Thus, this paper proposes a novel screen‐shooting resilient watermarking scheme for document image using deep neural network. By applying this scheme, when the watermarked image is displayed on the screen and captured by a camera, the watermark can be still extracted from the captured photographs. Specifically, the scheme is an end‐to‐end neural network with an encoder to embed watermark and a decoder to extract watermark. During the training process, a distortion layer between encoder and decoder is added to simulate the distortions introduced by screen‐shooting process in real scenes, such as camera distortion, shooting distortion, and light source distortion. Furthermore, a background sensitive loss and a lpips loss are used to improve visual quality of the watermarked document images in the training process. Besides, a strength factor adjustment strategy is also designed to improve the visual quality with little loss of bit extraction accuracy. The experimental results show that the proposed scheme has higher visual quality and robustness than the other two recent state‐of‐the‐art methods.

Funding

  • Priority Academic Program Development of Jiangsu Higher Education Institutions
  • Qinglan Project of Jiangsu Province of China
  • National Natural Science Foundation of China

Cite

APA

Ge, S., Fei, J., Xia, Z., Tong, Y., Weng, J., & Liu, J. (2023). A screen‐shooting resilient document image watermarking scheme using deep neural network. IET Image Processing, 17(2), 323-336. https://doi.org/10.1049/ipr2.12653

Vancouver

Ge S, Fei J, Xia Z, Tong Y, Weng J, Liu J. A screen‐shooting resilient document image watermarking scheme using deep neural network. IET Image Processing. 2023;17(2):323-336. doi:10.1049/ipr2.12653

BibTeX
@article{Ge2023,
  author = {Ge, Sulong and Fei, Jianwei and Xia, Zhihua and Tong, Yao and Weng, Jian and Liu, Jianan},
  title = {A screen‐shooting resilient document image watermarking scheme using deep neural network},
  journal = {IET Image Processing},
  year = {2023},
  volume = {17},
  number = {2},
  pages = {323--336},
  doi = {10.1049/ipr2.12653}
}
Start for free →