EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Knowledge transfer-driven estimation of knee moments and ground reaction forces from smartphone videos via temporal-spatial modeling of augmented joint kinematics

Md Sanzid Bin Hossain iD, Hwan Choi, Zhishan Guo iD, Sunyong Yoo iD, Min-Keun Song, Hyunjun Shin, Dexter Hadley

PLOS One · 2025

DOI: 10.1371/journal.pone.0335257 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS One, 2025. Verfasst von Md Sanzid Bin Hossain und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Clinical Science, University of Central Florida, College of Medicine, Orlando, Florida, United States of America. Hauptthemen laut MEDLINE: Knee Joint, Smartphone. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The knee adduction and flexion moment provides critical information about knee joint health, while 3D ground reaction forces (GRFs) help identify force and energy characteristics for maneuvering the entire human body. Existing methods of acquiring joint moments and GRFs require expensive equipment, time-consuming pre-processing, and limited accessibility. This study proposes to tackle these limitations by utilizing only smartphone videos to estimate joint moments and 3D GRFs accurately. We also propose the augmentation of joint kinematics by generating additional modalities of 2D joint center velocity and acceleration from 2D joint center position acquired from the videos. This augmented joint kinematics helps to apply a multi-modal fusion module to learn the importance of inter-modal interactions. Additionally, we utilize recurrent neural networks and graph convolutional networks to perform temporal-spatial modeling of joint center dynamics for enhanced accuracy. To overcome another challenge of video-based estimation, particularly the lack of inertial information related to body segments, we propose multi-modal knowledge transfer to train the video-only student model from a teacher model that integrates both video and inertial measurement unit (IMU) data. The student model significantly reduces the normalized root mean square error (NRMSE) from 5.71 to 4.68 and increases the Pearson correlation coefficient (PCC) from 0.929 to 0.951. These results demonstrate that knowledge transfer, augmentation of joint kinematics for multi-modal fusion, and temporal-spatial modeling significantly enhance smartphone video-based estimation, offering a potential cost-effective alternative to traditional motion capture for clinical assessments, rehabilitation, and sports applications.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Knee JointSmartphoneHumansBiomechanical PhenomenaVideo RecordingNeural Networks, ComputerMaleRange of Motion, ArticularFemale

Autor:innen und Institutionen

  • Department of Clinical Science, University of Central Florida, College of Medicine, Orlando, Florida, United States of America.
  • Center for Data Science, Nell Hodgson Woodruff School of Nursing, Emory University, Atlanta, Georgia, United States of America.
  • Department of Mechanical and Aerospace Engineering, University of Central Florida, Orlando, Florida, United States of America.
  • Department of Computer Science, North Carolina State University, Raleigh, North Carolina, United States of America.
  • Department of Intelligent Electronics and Computer Engineering, Chonnam National University, Gwangju, Republic of Korea.
  • Department of Physical and Rehabilitation Medicine, Chonnam National University Medical School, Gwangju, Republic of Korea.

ORCID-Profile: Md Sanzid Bin Hossain, Zhishan Guo, Sunyong Yoo

Förderung

  • National Science Foundation

Zitieren

APA

Hossain, M. S. B., Choi, H., Guo, Z., Yoo, S., Song, M. K., Shin, H., & Hadley, D. (2025). Knowledge transfer-driven estimation of knee moments and ground reaction forces from smartphone videos via temporal-spatial modeling of augmented joint kinematics. PLOS One. https://doi.org/10.1371/journal.pone.0335257

Vancouver

Hossain MSB, Choi H, Guo Z, Yoo S, Song MK, Shin H, et al. Knowledge transfer-driven estimation of knee moments and ground reaction forces from smartphone videos via temporal-spatial modeling of augmented joint kinematics. PLOS One. 2025. doi:10.1371/journal.pone.0335257

BibTeX
@article{Hossain2025,
  author = {Hossain, Md Sanzid Bin and Choi, Hwan and Guo, Zhishan and Yoo, Sunyong and Song, Min-Keun and Shin, Hyunjun and Hadley, Dexter},
  title = {Knowledge transfer-driven estimation of knee moments and ground reaction forces from smartphone videos via temporal-spatial modeling of augmented joint kinematics},
  journal = {PLOS One},
  year = {2025},
  doi = {10.1371/journal.pone.0335257}
}
Kostenlos starten →