IMJP-Net: inertial–music joint prediction for emotion-aware recommendation via smart-glasses sensing
CCF Transactions on Pervasive Computing and Interaction · 20.07.2026
DOI: 10.1007/s42486-026-00240-4 ↗Kurz gefasst
Fachartikel in der Zeitschrift CCF Transactions on Pervasive Computing and Interaction, online erschienen am 20.07.2026. Verfasst von Ying Hao und 5 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Guangdong Provincial Department of Science and Technology, Guangdong Provincial Key Laboratory of Human Digital Twin.
Abstract (Originalsprache)
Emotion fluctuations during music listening are closely tied to a listener’s current emotional state, yet most recommendation systems rely on historical behavior data, which struggle with cold-start issues and real-time adaptability. In this work, we propose IMJP-Net, a framework that leverages smart glasses IMU signals as a privacy-preserving implicit feedback channel for emotion-aware music recommendation. To resolve the non-stationarity of head-worn dynamics, the system integrates an IMU Evolution Module (IEM) for temporal inertial encoding and an IMU-Music Mutual Attentive Alignment (IMMAA) mechanism for cross-modal feature fusion. Evaluated on 1164 valid trials ( $$N=30$$ ), IMJP-Net achieves 19.6% improvement over baselines in joint prediction of music preference and post-listening emotional states. Ablation studies demonstrate that excluding IMU signals results in a 37.7% increase in mean MAE, confirming the critical contribution of inertial sensing to real-time affect inference. An in-the-wild user study ( $$N=10$$ ) validates practical utility, with participants highlighting enhanced emotional resonance, as well as privacy and non-intrusiveness. These results demonstrate the potential of IMJP-Net for pervasive emotion-aware music recommendation.
Förderung
- National Natural Science Foundation of China
- Guangdong Provincial Department of Science and Technology
- Guangdong Provincial Key Laboratory of Human Digital Twin
- Guangzhou Basic Research Program
Zitieren
APA
Hao, Y., She, D., Li, W., Luo, S., Gao, Y., & Jin, Z. (2026). IMJP-Net: inertial–music joint prediction for emotion-aware recommendation via smart-glasses sensing. CCF Transactions on Pervasive Computing and Interaction. https://doi.org/10.1007/s42486-026-00240-4
Vancouver
Hao Y, She D, Li W, Luo S, Gao Y, Jin Z. IMJP-Net: inertial–music joint prediction for emotion-aware recommendation via smart-glasses sensing. CCF Transactions on Pervasive Computing and Interaction. 2026. doi:10.1007/s42486-026-00240-4
BibTeX
@article{Hao2026,
author = {Hao, Ying and She, Dong and Li, Wenba and Luo, Shuyu and Gao, Yang and Jin, Zhanpeng},
title = {IMJP-Net: inertial–music joint prediction for emotion-aware recommendation via smart-glasses sensing},
journal = {CCF Transactions on Pervasive Computing and Interaction},
year = {2026},
doi = {10.1007/s42486-026-00240-4}
}
EUVIMED