EUVIMEDEUVIMED entdecken
Crossref

Speech Watermarking with Discrete Intermediate Representations

Shengpeng Ji, Ziyue Jiang, Jialong Zuo, Minghui Fang, Yifu Chen, Tao Jin, Zhou Zhao

Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (23) · 24239-24247

DOI: 10.1609/aaai.v39i23.34600 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Shengpeng Ji und 6 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Speech watermarking techniques can proactively mitigate the potential harmful consequences of instant voice cloning techniques. These techniques involve the insertion of signals into speech that are imperceptible to humans but can be detected by algorithms. Previous approaches typically embed watermark messages into continuous space. However, intuitively, embedding watermark information into robust discrete latent space can significantly improve the robustness of watermarking systems. In this paper, we propose DiscreteWM, a novel speech watermarking framework that injects watermarks into the discrete intermediate representations of speech. Specifically, we map speech into discrete latent space with a vector-quantized autoencoder and inject watermarks by changing the modular arithmetic relation of discrete IDs. To ensure the imperceptibility of watermarks, we also propose a manipulator model to select the candidate tokens for watermark embedding. Experimental results demonstrate that our framework achieves state-of-the-art performance in robustness and imperceptibility, simultaneously. Moreover, our flexible frame-wise approach can serve as an efficient solution for both voice cloning detection and information hiding. Additionally, DiscreteWM can encode 1 to 150 bits of watermark information within a 1-second speech clip, indicating its encoding capacity.

Zitieren

APA

Ji, S., Jiang, Z., Zuo, J., Fang, M., Chen, Y., Jin, T., & Zhao, Z. (2025). Speech Watermarking with Discrete Intermediate Representations. Proceedings of the AAAI Conference on Artificial Intelligence, 39(23), 24239-24247. https://doi.org/10.1609/aaai.v39i23.34600

Vancouver

Ji S, Jiang Z, Zuo J, Fang M, Chen Y, Jin T, et al. Speech Watermarking with Discrete Intermediate Representations. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(23):24239-24247. doi:10.1609/aaai.v39i23.34600

BibTeX
@article{Ji2025,
  author = {Ji, Shengpeng and Jiang, Ziyue and Zuo, Jialong and Fang, Minghui and Chen, Yifu and Jin, Tao and Zhao, Zhou},
  title = {Speech Watermarking with Discrete Intermediate Representations},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2025},
  volume = {39},
  number = {23},
  pages = {24239--24247},
  doi = {10.1609/aaai.v39i23.34600}
}
Kostenlos starten →