EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

MAPFL: Modular Adaptive Personalised Federated Learning From Visual Sentiment to Physical Activity

Chang Liu, Yapeng Li, Zengmao Wang, Dewen Soh, Bo Du

CAAI Transactions on Intelligence Technology · 2026-10 · 11 (5) · 1546-1566

DOI: 10.1049/cit2.70120 ↗

Kurz gefasst

Fachartikel in der Zeitschrift CAAI Transactions on Intelligence Technology, online erschienen am 07.09.2026. Verfasst von Chang Liu und 4 weiteren Autor:innen. Die Arbeit nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Human‐centric sensing tasks such as visual sentiment analysis and smartphone‐based human activity recognition (HAR) exhibit strong client heterogeneity from feature, label, and concept shifts. Among these, concept shift—how individual users interpret and generate human‐centric signals—is particularly challenging yet underexplored in federated learning. We propose MAPFL (Modular Adaptive Personalised Federated Learning), a personalised federated framework that performs encoder‐level personalisation while preserving standard communication. Each client model is decomposed into a shared encoder and a local classifier head, and equipped with both global and personalised encoders. A gradient‐aligned personalisation controller learns client‐specific mixing coefficients that adaptively balance the two encoders based on the alignment of their gradients, allowing each client to decide how much to share versus personalise at the representation level. This design supports both image‐ and sensor‐based tasks. On an affective‐computing benchmark built from three in‐the‐wild visual sentiment datasets (ARTphoto, ABSTRACT, PARA) and on a smartphone‐based HAR benchmark derived from UCI HAR, MAPFL improves AUC and accuracy by up to 3.3% over strong federated and personalised baselines and converges faster and more stably. These results show that gradient‐aligned encoder personalisation is an effective and practical mechanism for handling multi‐dimensional heterogeneity in human‐centric sensing.

Förderung

  • National Natural Science Foundation of China
  • National Key Research and Development Program of China

Zitieren

APA

Liu, C., Li, Y., Wang, Z., Soh, D., & Du, B. (2026). MAPFL: Modular Adaptive Personalised Federated Learning From Visual Sentiment to Physical Activity. CAAI Transactions on Intelligence Technology, 11(5), 1546-1566. https://doi.org/10.1049/cit2.70120

Vancouver

Liu C, Li Y, Wang Z, Soh D, Du B. MAPFL: Modular Adaptive Personalised Federated Learning From Visual Sentiment to Physical Activity. CAAI Transactions on Intelligence Technology. 2026;11(5):1546-1566. doi:10.1049/cit2.70120

BibTeX
@article{Liu2026,
  author = {Liu, Chang and Li, Yapeng and Wang, Zengmao and Soh, Dewen and Du, Bo},
  title = {MAPFL: Modular Adaptive Personalised Federated Learning From Visual Sentiment to Physical Activity},
  journal = {CAAI Transactions on Intelligence Technology},
  year = {2026},
  volume = {11},
  number = {5},
  pages = {1546--1566},
  doi = {10.1049/cit2.70120}
}
Kostenlos starten →