Deep Reinforcement Learning-Based Resource Allocation for Integrated Sensing, Communication, and Computation in Vehicular Network
IEEE Transactions on Wireless Communications · 2024-12 · 23 (12) · 18608-18622
DOI: 10.1109/twc.2024.3470873 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2024-12. Verfasst von Liu Yang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 50-mal zitiert (Crossref) und nennt 56 Literaturangaben. Gefördert von: Fundamental Research Funds for Central Universities, Beijing Municipal Natural Science Foundation, National Natural Science Foundation of China.
Abstract (Originalsprache)
In developing the sixth-generation (6G) system, integrated sensing and communication technology is becoming increasingly essential, especially for applications like autonomous driving. This paper develops an architecture for integrated sensing, communication, and computation (ISCC) in the vehicular network, where vehicles perform environment sensing, sensing data computation, and transmission. To support low-latency cooperation between vehicles and extend vehicles’ sensing range, over-air-computation federated learning is employed. The optimization problem of joint beamforming design and power resource allocation in the ISCC scenario is formulated to maximize the achievable data rate while ensuring sensing and computing performance. However, solving this joint optimization problem is a great challenge due to the high coupling resource and time-varying channel environment. Therefore, a hybrid reinforcement learning scheme is proposed in this work. First, the semidefinite relaxation and Gaussian randomization techniques are leveraged to obtain the approximate solution of the aggregation beamformer. Then, the deep deterministic policy gradient algorithm is proposed to tackle the transmit beamforming design and resource allocation problem in continuous action space. Extensive simulation results validated the admirable performance of the proposed scheme in convergence and achievable sum rate compared with the benchmark schemes. In addition, the impact of variables on the optimization performance is demonstrated via numerical results.
Förderung
- Fundamental Research Funds for Central Universities
- Beijing Municipal Natural Science Foundation
- National Natural Science Foundation of China
- National Key Research and Development Program of China
- NSF
- U.S. Department of Transportation, Toyota, Amazon and Japan Science and Technology Agency (JST) Adopting Sustainable Partnerships for Innovative Research Ecosy…
Zitieren
APA
Yang, L., Wei, Y., Feng, Z., Zhang, Q., & Han, Z. (2024). Deep Reinforcement Learning-Based Resource Allocation for Integrated Sensing, Communication, and Computation in Vehicular Network. IEEE Transactions on Wireless Communications, 23(12), 18608-18622. https://doi.org/10.1109/twc.2024.3470873
Vancouver
Yang L, Wei Y, Feng Z, Zhang Q, Han Z. Deep Reinforcement Learning-Based Resource Allocation for Integrated Sensing, Communication, and Computation in Vehicular Network. IEEE Transactions on Wireless Communications. 2024;23(12):18608-18622. doi:10.1109/twc.2024.3470873
BibTeX
@article{Yang2024,
author = {Yang, Liu and Wei, Yifei and Feng, Zhiyong and Zhang, Qixun and Han, Zhu},
title = {Deep Reinforcement Learning-Based Resource Allocation for Integrated Sensing, Communication, and Computation in Vehicular Network},
journal = {IEEE Transactions on Wireless Communications},
year = {2024},
volume = {23},
number = {12},
pages = {18608--18622},
doi = {10.1109/twc.2024.3470873}
}
EUVIMED