Human activity recognition using a single-photon direct time-of-flight sensor
Optics Express · 06.05.2024 · 32 (10) · 16645
DOI: 10.1364/oe.516681 ↗Kurz gefasst
Fachartikel in der Zeitschrift Optics Express, online erschienen am 22.04.2024. Verfasst von Germán Mora-Martín und 4 weiteren Autor:innen. Hauptthemen laut MEDLINE: Photons. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 29 Literaturangaben. Gefördert von: Defence Science and Technology Laboratory.
Abstract (Originalsprache)
Single-Photon Avalanche Diode (SPAD) direct Time-of-Flight (dToF) sensors provide depth imaging over long distances, enabling the detection of objects even in the absence of contrast in colour or texture. However, distant objects are represented by just a few pixels and are subject to noise from solar interference, limiting the applicability of existing computer vision techniques for high-level scene interpretation. We present a new SPAD-based vision system for human activity recognition, based on convolutional and recurrent neural networks, which is trained entirely on synthetic data. In tests using real data from a 64×32 pixel SPAD, captured over a distance of 40 m, the scheme successfully overcomes the limited transverse resolution (in which human limbs are approximately one pixel across), achieving an average accuracy of 89% in distinguishing between seven different activities. The approach analyses continuous streams of video-rate depth data at a maximal rate of 66 FPS when executed on a GPU, making it well-suited for real-time applications such as surveillance or situational awareness in autonomous systems.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- Defence Science and Technology Laboratory
Zitieren
APA
Mora-Martín, G., Scholes, S., Henderson, R. K., Leach, J., & Gyongy, I. (2024). Human activity recognition using a single-photon direct time-of-flight sensor. Optics Express, 32(10), 16645. https://doi.org/10.1364/oe.516681
Vancouver
Mora-Martín G, Scholes S, Henderson RK, Leach J, Gyongy I. Human activity recognition using a single-photon direct time-of-flight sensor. Optics Express. 2024;32(10):16645. doi:10.1364/oe.516681
BibTeX
@article{MoraMartn2024,
author = {Mora-Martín, Germán and Scholes, Stirling and Henderson, Robert K and Leach, Jonathan and Gyongy, Istvan},
title = {Human activity recognition using a single-photon direct time-of-flight sensor},
journal = {Optics Express},
year = {2024},
volume = {32},
number = {10},
pages = {16645},
doi = {10.1364/oe.516681}
}
EUVIMED