EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Two-step deep-learning identification of heel keypoints from video-recorded gait

Kjartan Halvorsen, Wei Peng, Fredrik Olsson, Anna Cristina Åberg

Medical & Biological Engineering & Computing · 2025

DOI: 10.1007/s11517-024-03189-7 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Medical & Biological Engineering & Computing, 2025. Verfasst von Kjartan Halvorsen und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Health and Welfare, Dalarna University, Falun, Sweden. khr@du.se. Hauptthemen laut MEDLINE: Deep Learning, Video Recording, Gait, Heel. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Stiftelsen Promobilia, UU Innovation, Svenska Handelsbankens Forskningsstiftelse.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurate and fast extraction of step parameters from video recordings of gait allows for richer information to be obtained from clinical tests such as Timed Up and Go. Current deep-learning methods are promising, but lack in accuracy for many clinical use cases. Extracting step parameters will often depend on extracted landmarks (keypoints) on the feet. We hypothesize that such keypoints can be determined with an accuracy relevant for clinical practice from video recordings by combining an existing general-purpose pose estimation method (OpenPose) with custom convolutional neural networks (convnets) specifically trained to identify keypoints on the heel. The combined method finds keypoints on the posterior and lateral aspects of the heel of the foot in side-view and frontal-view images from which step length and step width can be determined for calibrated cameras. Six different candidate convnets were evaluated, combining three different standard architectures as networks for feature extraction (backbone), and with two different networks for predicting keypoints on the heel (head networks). Using transfer learning, the backbone networks were pre-trained on the ImageNet dataset, and the combined networks (backbone + head) were fine-tuned on data from 184 trials of older, unimpaired adults. The data was recorded at three different locations and consisted of 193 k side-view images and 110 k frontal-view images. We evaluated the six different models using the absolute distance on the floor between predicted keypoints and manually labelled keypoints. For the best-performing convnet, the median error was 0.55 cm and the 75% quartile was below 1.26 cm using data from the side-view camera. The predictions are overall accurate, but show some outliers. The results indicate potential for future clinical use by automating a key step in marker-less gait parameter extraction. Graphical abstract

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Deep LearningVideo RecordingGaitHeelNeural Networks, ComputerHumansImage Processing, Computer-AssistedFemaleMaleAged

Stichwörter der Autor:innen

Convolutional neural networksGait analysisMarker-less motion capture

Autor:innen und Institutionen

  • School of Health and Welfare, Dalarna University, Falun, Sweden. khr@du.se.
  • Department of Public Health and Caring Sciences, Uppsala University, Uppsala, Sweden.
  • Stardots AB, Uppsala, Sweden.
  • School of Health and Welfare, Dalarna University, Falun, Sweden.

Förderung

  • Stiftelsen Promobilia
  • UU Innovation
  • Svenska Handelsbankens Forskningsstiftelse

Zitieren

APA

Halvorsen, K., Peng, W., Olsson, F., & Åberg, A. C. (2025). Two-step deep-learning identification of heel keypoints from video-recorded gait. Medical & Biological Engineering & Computing. https://doi.org/10.1007/s11517-024-03189-7

Vancouver

Halvorsen K, Peng W, Olsson F, Åberg AC. Two-step deep-learning identification of heel keypoints from video-recorded gait. Medical & Biological Engineering & Computing. 2025. doi:10.1007/s11517-024-03189-7

BibTeX
@article{Halvorsen2025,
  author = {Halvorsen, Kjartan and Peng, Wei and Olsson, Fredrik and Åberg, Anna Cristina},
  title = {Two-step deep-learning identification of heel keypoints from video-recorded gait},
  journal = {Medical & Biological Engineering & Computing},
  year = {2025},
  doi = {10.1007/s11517-024-03189-7}
}
Kostenlos starten →