EUVIMEDEUVIMED entdecken
Crossref

Decoupled Heterogeneous Multi-Teacher Mutual Distillation for Wearable Human Activity Recognition

Zhiwen Xiao, Huanlai Xing, Rong Qu, Hui Li, Ruibin Bai, Lexi Xu, Jincheng Peng, Li Feng, Qian Wan

ACM Transactions on Embedded Computing Systems · 30.10.2026

DOI: 10.1145/3849875 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Embedded Computing Systems, online erschienen am 30.10.2026. Verfasst von Zhiwen Xiao und 8 weiteren Autor:innen. Die Arbeit nennt 75 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Wearable human activity recognition (HAR) requires compact models that can capture temporal dependencies under constrained computation, memory, and energy budgets. Knowledge distillation (KD) offers a practical route to this goal by transferring informative predictions and representations from high-capacity teachers to lightweight students. Existing KD methods for wearable HAR, however, remain limited when structurally different teachers are involved. They commonly rely on homogeneous architectures, use mainly teacher-to-student transfer, and provide limited support for heterogeneous multi-teacher learning. This work proposes a decoupled heterogeneous multi-teacher mutual distillation (DHMMD) framework for wearable HAR. DHMMD performs offline reciprocal optimization between multiple heterogeneous teachers and a compact student, while only the distilled student is retained for inference. The framework combines two complementary paths. Bidirectional decoupled semantic distillation transfers target-class and non-target-class probability information through both aggregated and teacher-specific guidance. Bidirectional contrastive feature distillation aligns intermediate representations across heterogeneous architectures using ensemble-level and pairwise feature supervision. Experiments on HAPT, WISDM, and UCI_HAR show that DHMMD outperforms 21 state-of-the-art KD baselines in terms of F 1 score. Under the MLP-student setting, DHMMD improves the F 1 score by 9.30 percentage points on WISDM. On-device latency measurements on Raspberry Pi 4 and PYNQ-Z2, together with board-power-based energy estimation and memory accounting, further show that the distilled students reduce inference cost relative to the heterogeneous teachers. These results indicate that DHMMD is a practical offline training framework for compact wearable HAR models on mobile and application-processor-class edge platforms.

Zitieren

APA

Xiao, Z., Xing, H., Qu, R., Li, H., Bai, R., Xu, L., Peng, J., Feng, L., & Wan, Q. (2026). Decoupled Heterogeneous Multi-Teacher Mutual Distillation for Wearable Human Activity Recognition. ACM Transactions on Embedded Computing Systems. https://doi.org/10.1145/3849875

Vancouver

Xiao Z, Xing H, Qu R, Li H, Bai R, Xu L, et al. Decoupled Heterogeneous Multi-Teacher Mutual Distillation for Wearable Human Activity Recognition. ACM Transactions on Embedded Computing Systems. 2026. doi:10.1145/3849875

BibTeX
@article{Xiao2026,
  author = {Xiao, Zhiwen and Xing, Huanlai and Qu, Rong and Li, Hui and Bai, Ruibin and Xu, Lexi and Peng, Jincheng and Feng, Li and Wan, Qian},
  title = {Decoupled Heterogeneous Multi-Teacher Mutual Distillation for Wearable Human Activity Recognition},
  journal = {ACM Transactions on Embedded Computing Systems},
  year = {2026},
  doi = {10.1145/3849875}
}
Kostenlos starten →