EUVIMEDEUVIMED entdecken
Open Access

mmPose-FK: A Forward Kinematics Approach to Dynamic Skeletal Pose Estimation Using mmWave Radars

Shuting Hu, Siyang Cao, Nima Toosizadeh, Jennifer Barton, Melvin G Hector, Mindy J Fain

IEEE Sensors Journal · 01.03.2024 · 24 (5) · 6469-6481

DOI: 10.1109/jsen.2023.3348199 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Sensors Journal, erschienen am 01.03.2024. Verfasst von Shuting Hu und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, The University of Arizona, Tucson, AZ, 85721 USA. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NIBIB NIH HHS, National Institute of Biomedical Imaging and Bioengineering (NIBIB), National Institutes of Health.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this paper, we propose mmPose-FK, a novel millimeter wave (mmWave) radar-based pose estimation method that employs a dynamic forward kinematics (FK) approach to address the challenges posed by low resolution, specularity, and noise artifacts commonly associated with mmWave radars. These issues often result in unstable joint poses that vibrate over time, reducing the effectiveness of traditional pose estimation techniques. To overcome these limitations, we integrate the FK mechanism into the deep learning model and develop an end-to-end solution driven by data. Our comprehensive experiments using various matrices and benchmarks highlight the superior performance of mmPose-FK, especially when compared to our previous research methods. The proposed method provides more accurate pose estimation and ensures increased stability and consistency, which underscores the continuous improvement of our methodology, showcasing superior capabilities over its antecedents. Moreover, the model can output joint rotations and human bone lengths, which could be further utilized for various applications such as gait parameter analysis and height estimation. This makes mmPose-FK a highly promising solution for a wide range of applications in the field of human pose estimation and beyond.

Schlagwörter

Stichwörter der Autor:innen

Forward KinematicsPose EstimationmmWave Radars

Autor:innen und Institutionen

  • Department of Electrical and Computer Engineering, The University of Arizona, Tucson, AZ, 85721 USA.
  • Department of Rehabilitation and Movement Sciences, Rutgers University, Newark, NJ, 07107 USA.
  • Department of Biomedical Engineering, The University of Arizona, Tucson, AZ, 85721 USA.
  • Department of Medicine, The University of Arizona, Tucson, AZ, 85724 USA.

Förderung

  • NIBIB NIH HHS
  • National Institute of Biomedical Imaging and Bioengineering (NIBIB), National Institutes of Health

Zitieren

APA

Hu, S., Cao, S., Toosizadeh, N., Barton, J., Hector, M. G., & Fain, M. J. (2024). mmPose-FK: A Forward Kinematics Approach to Dynamic Skeletal Pose Estimation Using mmWave Radars. IEEE Sensors Journal, 24(5), 6469-6481. https://doi.org/10.1109/jsen.2023.3348199

Vancouver

Hu S, Cao S, Toosizadeh N, Barton J, Hector MG, Fain MJ. mmPose-FK: A Forward Kinematics Approach to Dynamic Skeletal Pose Estimation Using mmWave Radars. IEEE Sensors Journal. 2024;24(5):6469-6481. doi:10.1109/jsen.2023.3348199

BibTeX
@article{Hu2024,
  author = {Hu, Shuting and Cao, Siyang and Toosizadeh, Nima and Barton, Jennifer and Hector, Melvin G and Fain, Mindy J},
  title = {mmPose-FK: A Forward Kinematics Approach to Dynamic Skeletal Pose Estimation Using mmWave Radars},
  journal = {IEEE Sensors Journal},
  year = {2024},
  volume = {24},
  number = {5},
  pages = {6469--6481},
  doi = {10.1109/jsen.2023.3348199}
}
Kostenlos starten →