EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MAD‐HAR: Privacy‐Preserving On‐Device Human Action Recognition via Multiagent LLM Debate

Xuecheng Zhou, Zepeng Gu, Chenyu Zuo, Shan Jiang, Mingjin Zhang, Jianguo Chen

IET Software · 2026-01 · 2026 (1)

DOI: 10.1049/sfw2/8714926 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IET Software, online erschienen am 10.04.2026. Verfasst von Xuecheng Zhou und 5 weiteren Autor:innen. Die Arbeit nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Guangxi Key Research and Development Program, Guangdong Provincial Pearl River Talents Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Human action recognition (HAR) is a fundamental component of ubiquitous computing, yet its wide‐range applications are hindered by privacy concerns. Specifically, high‐accuracy models typically require cloud‐based processing that compromises sensitive visual data, while privacy‐preserving on‐device models suffer from limited reasoning capacities and frequent hallucinations. To resolve this conflict, we introduce multiagent debate for HAR (MAD‐HAR), a novel framework designed for strictly local environments. MAD‐HAR leverages a lightweight vision–language model (VLM) with a granular prompt to convert visual inputs into semantic captions, anonymizing data before inference. To mitigate reasoning failures, a heterogeneous ensemble of diverse small and medium language model agents (ranging from 8B to 14B parameters) engages in a structured multiround debate. Rather than outputting simple labels, agents are prompted to generate structured rationales to explicitly justify their logic, utilizing collaborative critique to override hallucinations. We evaluate our approach on public benchmarks. Preliminary experiments guided the selection of the optimal VLM backbone, while extensive main and ablation studies suggest that scaling to a seven‐agent pool with rationale‐driven debate synthesizes higher‐order reasoning. Experimental results show that MAD‐HAR significantly improves macro‐F1, while maximizing consensus and yielding consistent net error rectification.

Förderung

  • National Natural Science Foundation of China
  • Guangxi Key Research and Development Program
  • Guangdong Provincial Pearl River Talents Program

Zitieren

APA

Zhou, X., Gu, Z., Zuo, C., Jiang, S., Zhang, M., & Chen, J. (2026). MAD‐HAR: Privacy‐Preserving On‐Device Human Action Recognition via Multiagent LLM Debate. IET Software, 2026(1). https://doi.org/10.1049/sfw2/8714926

Vancouver

Zhou X, Gu Z, Zuo C, Jiang S, Zhang M, Chen J. MAD‐HAR: Privacy‐Preserving On‐Device Human Action Recognition via Multiagent LLM Debate. IET Software. 2026;2026(1). doi:10.1049/sfw2/8714926

BibTeX
@article{Zhou2026,
  author = {Zhou, Xuecheng and Gu, Zepeng and Zuo, Chenyu and Jiang, Shan and Zhang, Mingjin and Chen, Jianguo},
  title = {MAD‐HAR: Privacy‐Preserving On‐Device Human Action Recognition via Multiagent LLM Debate},
  journal = {IET Software},
  year = {2026},
  volume = {2026},
  number = {1},
  doi = {10.1049/sfw2/8714926}
}
Kostenlos starten →