Collaboration-Aware Relay Selection for AUV in Internet of Underwater Network: Evolving Contextual Bandit Learning Approach
IEEE Internet of Things Journal · 01.02.2023 · 10 (3) · 2430-2443
DOI: 10.1109/jiot.2022.3211953 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Internet of Things Journal, erschienen am 01.02.2023. Verfasst von Haihong Zhao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 52 Literaturangaben. Gefördert von: National Natural Science Foundation of China, S&T Program of Hebei, Provincial Key Laboratory Performance Subsidy Project.
Abstract (Originalsprache)
In Internet of Underwater Things, data collection is assisted by autonomous underwater vehicle (AUV) to enhance the reliable transmission. AUV acts as a mobile collector and transmits the collected data to the station via relay nodes. However, the highly mobile nature of AUV needs an adaptive and efficient relay selection scheme for achieving good capacity performance. In this article, we propose a new contextual multiarmed bandit with evolving relay set (CMAB-ERS) learning framework, which successfully addresses crucial issues, including dynamic environment conditions and evolving relay set. To deal with the evolving relay set, CMAB-ERS incorporates collaborative effects into inference as well as learning processes, the new relays will acquire prior knowledge by having experienced nodes sharing observations, reducing the learning time significantly. To overcome the uncertainty of environmental information, we exploit the contextual environment factors to assist relay reward estimation and execute time-sensitive parameter update after every transmit–receive cycle, aiming for minimizing potential loss due to the time-varying channel. Correspondingly, the collaboration-aware online contextual bandit learning (COCBL) algorithm is designed that enables AUV to switch optimal relay adaptively and promises high-capacity transmission. Further, we rigorously prove the convergence of the COCBL algorithm by considering the evolving relay set and give its upper bound on the cumulative regret. Finally, extensive simulation results elucidate the effectiveness of the proposed COCBL.
Förderung
- National Natural Science Foundation of China
- S&T Program of Hebei
- Provincial Key Laboratory Performance Subsidy Project
Zitieren
APA
Zhao, H., Li, X., Han, S., Yan, L., & Yu, J. (2023). Collaboration-Aware Relay Selection for AUV in Internet of Underwater Network: Evolving Contextual Bandit Learning Approach. IEEE Internet of Things Journal, 10(3), 2430-2443. https://doi.org/10.1109/jiot.2022.3211953
Vancouver
Zhao H, Li X, Han S, Yan L, Yu J. Collaboration-Aware Relay Selection for AUV in Internet of Underwater Network: Evolving Contextual Bandit Learning Approach. IEEE Internet of Things Journal. 2023;10(3):2430-2443. doi:10.1109/jiot.2022.3211953
BibTeX
@article{Zhao2023,
author = {Zhao, Haihong and Li, Xinbin and Han, Song and Yan, Lei and Yu, Junzhi},
title = {Collaboration-Aware Relay Selection for AUV in Internet of Underwater Network: Evolving Contextual Bandit Learning Approach},
journal = {IEEE Internet of Things Journal},
year = {2023},
volume = {10},
number = {3},
pages = {2430--2443},
doi = {10.1109/jiot.2022.3211953}
}
EUVIMED