EUVIMEDEUVIMED entdecken
Crossref

Human activity recognition using a single-photon direct time-of-flight sensor

Germán Mora-Martín, Stirling Scholes, Robert K Henderson, Jonathan Leach, Istvan Gyongy

Optics Express · 06.05.2024 · 32 (10) · 16645

DOI: 10.1364/oe.516681 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Optics Express, online erschienen am 22.04.2024. Verfasst von Germán Mora-Martín und 4 weiteren Autor:innen. Hauptthemen laut MEDLINE: Photons. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 29 Literaturangaben. Gefördert von: Defence Science and Technology Laboratory.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Single-Photon Avalanche Diode (SPAD) direct Time-of-Flight (dToF) sensors provide depth imaging over long distances, enabling the detection of objects even in the absence of contrast in colour or texture. However, distant objects are represented by just a few pixels and are subject to noise from solar interference, limiting the applicability of existing computer vision techniques for high-level scene interpretation. We present a new SPAD-based vision system for human activity recognition, based on convolutional and recurrent neural networks, which is trained entirely on synthetic data. In tests using real data from a 64×32 pixel SPAD, captured over a distance of 40 m, the scheme successfully overcomes the limited transverse resolution (in which human limbs are approximately one pixel across), achieving an average accuracy of 89% in distinguishing between seven different activities. The approach analyses continuous streams of video-rate depth data at a maximal rate of 66 FPS when executed on a GPU, making it well-suited for real-time applications such as surveillance or situational awareness in autonomous systems.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

PhotonsHumansHuman ActivitiesNeural Networks, ComputerPattern Recognition, AutomatedEquipment Design

Förderung

  • Defence Science and Technology Laboratory

Zitieren

APA

Mora-Martín, G., Scholes, S., Henderson, R. K., Leach, J., & Gyongy, I. (2024). Human activity recognition using a single-photon direct time-of-flight sensor. Optics Express, 32(10), 16645. https://doi.org/10.1364/oe.516681

Vancouver

Mora-Martín G, Scholes S, Henderson RK, Leach J, Gyongy I. Human activity recognition using a single-photon direct time-of-flight sensor. Optics Express. 2024;32(10):16645. doi:10.1364/oe.516681

BibTeX
@article{MoraMartn2024,
  author = {Mora-Martín, Germán and Scholes, Stirling and Henderson, Robert K and Leach, Jonathan and Gyongy, Istvan},
  title = {Human activity recognition using a single-photon direct time-of-flight sensor},
  journal = {Optics Express},
  year = {2024},
  volume = {32},
  number = {10},
  pages = {16645},
  doi = {10.1364/oe.516681}
}
Kostenlos starten →