EUVIMEDEUVIMED entdecken
Crossref

Grounding Foundation Models through Federated Transfer Learning: A General Framework

Yan Kang, Tao Fan, Hanlin Gu, Xiaojin Zhang, Lixin Fan, Qiang Yang

ACM Transactions on Intelligent Systems and Technology · 31.08.2025 · 16 (4) · 1-54

DOI: 10.1145/3742788 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Intelligent Systems and Technology, online erschienen am 18.08.2025. Verfasst von Yan Kang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 206 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Foundation Models (FMs) such as GPT-4 encoded with vast knowledge and powerful emergent abilities have achieved remarkable success in various natural language processing and computer vision tasks. Grounding FMs by adapting them to domain-specific tasks or augmenting them with domain-specific knowledge enables us to exploit the full potential of FMs. However, grounding FMs faces several challenges, stemming primarily from constrained computing resources, data privacy, model heterogeneity, and model ownership. Federated Transfer Learning (FTL), the combination of federated learning and transfer learning, provides promising solutions to address these challenges. Recently, the need for grounding FMs leveraging FTL, coined FTL-FM, has arisen strongly in both academia and industry. Motivated by the strong growth in FTL-FM research and the potential impact of FTL-FM on industrial applications, we propose an FTL-FM framework that formulates problems of grounding FMs in the federated learning setting, construct a detailed taxonomy based on the FTL-FM framework to categorize state-of-the-art FTL-FM works, and comprehensively overview FTL-FM works based on the proposed taxonomy. We also establish correspondence between FTL-FM and conventional phases of adapting FM so that FM practitioners can align their research works with FTL-FM. In addition, we overview advanced efficiency-improving and privacy-preserving techniques because efficiency and privacy are critical concerns in FTL-FM. Last, we discuss opportunities and future research directions of FTL-FM.

Zitieren

APA

Kang, Y., Fan, T., Gu, H., Zhang, X., Fan, L., & Yang, Q. (2025). Grounding Foundation Models through Federated Transfer Learning: A General Framework. ACM Transactions on Intelligent Systems and Technology, 16(4), 1-54. https://doi.org/10.1145/3742788

Vancouver

Kang Y, Fan T, Gu H, Zhang X, Fan L, Yang Q. Grounding Foundation Models through Federated Transfer Learning: A General Framework. ACM Transactions on Intelligent Systems and Technology. 2025;16(4):1-54. doi:10.1145/3742788

BibTeX
@article{Kang2025,
  author = {Kang, Yan and Fan, Tao and Gu, Hanlin and Zhang, Xiaojin and Fan, Lixin and Yang, Qiang},
  title = {Grounding Foundation Models through Federated Transfer Learning: A General Framework},
  journal = {ACM Transactions on Intelligent Systems and Technology},
  year = {2025},
  volume = {16},
  number = {4},
  pages = {1--54},
  doi = {10.1145/3742788}
}
Kostenlos starten →