EUVIMEDEUVIMED entdecken
Crossref

Distributed Foundation Models for Multi-Modal Learning in 6G Wireless Networks

Jun Du, Tianyi Lin, Chunxiao Jiang, Qianqian Yang, C. Faouzi Bader, Zhu Han

IEEE Wireless Communications · 2024-06 · 31 (3) · 20-30

DOI: 10.1109/mwc.009.2300501 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Wireless Communications, 2024-06. Verfasst von Jun Du und 5 weiteren Autor:innen. Die Arbeit wurde bisher 204-mal zitiert (Crossref) und nennt 15 Literaturangaben. Gefördert von: National Natural Science Foundation China, NSF.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Benefiting from the ability to process and integrate data from various modalities, multi-modal foundation models (FMs) facilitate potential applications across a range of fields, including computer vision (CV), natural language processing (NLP), and diverse multi-modal applications such as imagetext retrieval. Currently, FMs are deployed on computing clusters for training and inference to meet their considerable computational demands. In the foreseeable future, the parameter size of FMs is expected to evolve further, posing challenges to both computation resources and energy supply. Fortunately, leveraging the next-generation wireless networks (6G) to aggregate substantial computation resources and multi-modal data from myriad wireless devices holds promise for handling the aforementioned challenges. In this work, we delve into state-of-the-art artificial intelligence (AI) techniques, specifically focusing on pipeline parallelism, data parallelism, and multi-modal learning, with the aim of supporting the sustainable development of distributed multi-modal FMs in the 6G era. In the context of pipeline parallelism, compressing activations and gradients while intelligently allocating communication resources can overcome communication bottlenecks caused by unstable wireless links. For data parallelism, federated learning (FL) with over-the-air computation (AirComp) seamlessly integrates communication and computation, significantly expediting gradient aggregation. Furthermore, by following the recent success of large language models (LLMs) and incorporating multi-modal learning into FMs, we can seamlessly integrate NLP and CV, along with the broader AI community, establishing the cornerstone for the intrinsic AI within 6G wireless networks.

Förderung

  • National Natural Science Foundation China
  • NSF

Zitieren

APA

Du, J., Lin, T., Jiang, C., Yang, Q., Bader, C. F., & Han, Z. (2024). Distributed Foundation Models for Multi-Modal Learning in 6G Wireless Networks. IEEE Wireless Communications, 31(3), 20-30. https://doi.org/10.1109/mwc.009.2300501

Vancouver

Du J, Lin T, Jiang C, Yang Q, Bader CF, Han Z. Distributed Foundation Models for Multi-Modal Learning in 6G Wireless Networks. IEEE Wireless Communications. 2024;31(3):20-30. doi:10.1109/mwc.009.2300501

BibTeX
@article{Du2024,
  author = {Du, Jun and Lin, Tianyi and Jiang, Chunxiao and Yang, Qianqian and Bader, C. Faouzi and Han, Zhu},
  title = {Distributed Foundation Models for Multi-Modal Learning in 6G Wireless Networks},
  journal = {IEEE Wireless Communications},
  year = {2024},
  volume = {31},
  number = {3},
  pages = {20--30},
  doi = {10.1109/mwc.009.2300501}
}
Kostenlos starten →