EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access · CC BY 4.0

Multimodal Federated Learning: A Survey

Liwei Che iD, Jiaqi Wang iD, Yao Zhou iD, Fenglong Ma iD

Sensors · 06.08.2023 · 23 (15) · 6986

DOI: 10.3390/s23156986 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Sensors, online erschienen am 06.08.2023. Verfasst von Liwei Che und 3 weiteren Autor:innen. Beteiligte Einrichtung: College of Information Sciences and Technology, Pennsylvania State University, University Park, PA 16802, USA. Die Arbeit wurde bisher 121-mal zitiert (Crossref) und nennt 84 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Federated learning (FL), which provides a collaborative training scheme for distributed data sources with privacy concerns, has become a burgeoning and attractive research area. Most existing FL studies focus on taking unimodal data, such as image and text, as the model input and resolving the heterogeneity challenge, i.e., the challenge of non-identical distribution (non-IID) caused by a data distribution imbalance related to data labels and data amount. In real-world applications, data are usually described by multiple modalities. However, to the best of our knowledge, only a handful of studies have been conducted to improve system performance utilizing multimodal data. In this survey paper, we identify the significance of this emerging research topic of multimodal federated learning (MFL) and present a literature review on the state-of-art MFL methods. Furthermore, we categorize multimodal federated learning into congruent and incongruent multimodal federated learning based on whether all clients possess the same modal combinations. We investigate the feasible application tasks and related benchmarks for MFL. Lastly, we summarize the promising directions and fundamental challenges in this field for future research.

Schlagwörter

Stichwörter der Autor:innen

Internet of Thingsfederated learningmultimodal learning

Autor:innen und Institutionen

  • College of Information Sciences and Technology, Pennsylvania State University, University Park, PA 16802, USA.
  • Instacart, San Francisco, CA 94105, USA.

ORCID-Profile: Liwei Che, Jiaqi Wang, Yao Zhou, Fenglong Ma

Zitieren

APA

Che, L., Wang, J., Zhou, Y., & Ma, F. (2023). Multimodal Federated Learning: A Survey. Sensors, 23(15), 6986. https://doi.org/10.3390/s23156986

Vancouver

Che L, Wang J, Zhou Y, Ma F. Multimodal Federated Learning: A Survey. Sensors. 2023;23(15):6986. doi:10.3390/s23156986

BibTeX
@article{Che2023,
  author = {Che, Liwei and Wang, Jiaqi and Zhou, Yao and Ma, Fenglong},
  title = {Multimodal Federated Learning: A Survey},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {15},
  pages = {6986},
  doi = {10.3390/s23156986}
}
Kostenlos starten →