Multimodal Smart-Skin for Real-Time Sitting Posture Recognition with Cross-Session Validation
Multimodal Technologies and Interaction · 09.04.2026 · 10 (4) · 39
DOI: 10.3390/mti10040039 ↗Kurz gefasst
Fachartikel in der Zeitschrift Multimodal Technologies and Interaction, online erschienen am 09.04.2026. Verfasst von Giva Andriana Mutiara und 4 weiteren Autor:innen. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: BRIN RIIM, Directorate of Research and Community Service Telkom University.
Abstract (Originalsprache)
Prolonged sitting with poor posture is associated with musculoskeletal disorders, reduced productivity, and long-term health risks. Many existing posture monitoring systems predominantly rely on single-modality sensing, such as pressure or vision-based approaches, limiting their ability to capture both static alignment and dynamic micro-movements. This study proposes a multimodal smart-skin system integrating pressure, temperature, and vibration sensors for sitting posture recognition. A total of 42 sensors distributed across 14 anatomical locations were deployed, generating 15,037 samples collected over three independent sessions to evaluate cross-session temporal generalization across nine posture classes under controlled experimental conditions. Two deep learning architectures—Temporal Convolutional Networks with Attention (TCN + Attn) and Convolutional Neural Network–Long Short-Term Memory (CNN − LSTM)—were compared under Leave-One-Session-Out (LOSO) cross-validation. TCN + Attn achieved 85.23% LOSO accuracy, outperforming CNN − LSTM by 2.56 percentage points while reducing training time by 36.7% and inference latency by 33.9%. Ablation analysis revealed that temperature sensing was the most discriminative unimodal modality (71.5% accuracy), and full multimodal fusion improved LOSO accuracy by 22.93% compared to pressure-only configurations. These results demonstrate the feasibility of multimodal smart-skin sensing combined with temporal convolutional modeling for cross-session posture recognition and indicate potential for efficient real-time, privacy-preserving ergonomic monitoring. This study should be interpreted as a controlled, single-subject proof-of-concept, and further validation in multi-subject and real-world environments is required to establish broader generalizability.
Förderung
- BRIN RIIM
- Directorate of Research and Community Service Telkom University
Zitieren
APA
Mutiara, G. A., Alfarisi, M. R., Mayadewi, P., Meisaroh, L., & Periyadi (2026). Multimodal Smart-Skin for Real-Time Sitting Posture Recognition with Cross-Session Validation. Multimodal Technologies and Interaction, 10(4), 39. https://doi.org/10.3390/mti10040039
Vancouver
Mutiara GA, Alfarisi MR, Mayadewi P, Meisaroh L, Periyadi. Multimodal Smart-Skin for Real-Time Sitting Posture Recognition with Cross-Session Validation. Multimodal Technologies and Interaction. 2026;10(4):39. doi:10.3390/mti10040039
BibTeX
@article{Mutiara2026,
author = {Mutiara, Giva Andriana and Alfarisi, Muhammad Rizqy and Mayadewi, Paramita and Meisaroh, Lisda and Periyadi},
title = {Multimodal Smart-Skin for Real-Time Sitting Posture Recognition with Cross-Session Validation},
journal = {Multimodal Technologies and Interaction},
year = {2026},
volume = {10},
number = {4},
pages = {39},
doi = {10.3390/mti10040039}
}
EUVIMED