Generative Semantic Communications for Robust Speech-to-Text Translation
IEEE Transactions on Wireless Communications · 2026 · 25 · 1380-1393
DOI: 10.1109/twc.2025.3590671 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2026. Verfasst von Zhenzi Weng und 3 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 57 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, China Postdoctoral Science Foundation.
Abstract (Originalsprache)
In this article, we propose a robust semantic communication system for speech transmission, named Ross-S2T, to execute the speech-to-text translation (S2TT) transmission efficiently. First, a deep semantic encoder is developed to directly convert speech in the source language to textual features associated with the target language, facilitating the end-to-end (E2E) semantic exchange to perform the S2TT task and reducing the amount of transmission data without performance degradation. To mitigate semantic impairments inherent in the corrupted speech, a novel generative adversarial network (GAN)-enabled deep semantic compensator is established to estimate the hidden semantic information within the speech and extract deep semantic features simultaneously, which enables robust semantic transmission for corrupted speech. Furthermore, a semantic probe-aided compensator is devised to enhance the semantic fidelity of recovered semantic features and improve the understandability of the target text. According to simulation results, the proposed Ross-S2T exhibits superior S2TT performance compared to conventional approaches and high robustness against semantic impairments.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
Zitieren
APA
Weng, Z., Wang, Z., Qin, Z., & Tao, X. (2026). Generative Semantic Communications for Robust Speech-to-Text Translation. IEEE Transactions on Wireless Communications, 25, 1380-1393. https://doi.org/10.1109/twc.2025.3590671
Vancouver
Weng Z, Wang Z, Qin Z, Tao X. Generative Semantic Communications for Robust Speech-to-Text Translation. IEEE Transactions on Wireless Communications. 2026;25:1380-1393. doi:10.1109/twc.2025.3590671
BibTeX
@article{Weng2026,
author = {Weng, Zhenzi and Wang, Zijing and Qin, Zhijin and Tao, Xiaoming},
title = {Generative Semantic Communications for Robust Speech-to-Text Translation},
journal = {IEEE Transactions on Wireless Communications},
year = {2026},
volume = {25},
pages = {1380--1393},
doi = {10.1109/twc.2025.3590671}
}
EUVIMED