Image-free single-pixel keypoint detection for privacy preserving human pose estimation
Optics Letters · 01.02.2024 · 49 (3) · 546
DOI: 10.1364/ol.514213 ↗Kurz gefasst
Fachartikel in der Zeitschrift Optics Letters, online erschienen am 19.01.2024. Verfasst von Aleksandr Tsoy und 8 weiteren Autor:innen. Hauptthemen laut MEDLINE: Privacy, Algorithms. Die Arbeit wurde bisher 37-mal zitiert (Crossref) und nennt 11 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Basic and Applied Basic Research Foundation of Guangdong Province, Science, Technology and Innovation Commission of Shenzhen Municipality.
Abstract (Originalsprache)
Computer vision technology has been applied in various fields such as identification, surveillance, and robot vision. However, computer vision algorithms used for human-related tasks operate on human images, which raises data security and privacy concerns. In this Letter, we propose an image-free human keypoint detection technique using a few coded illuminations and a single-pixel detector. Our proposed method can complete the keypoint detection task at an ultralow sampling rate on a measured one-dimensional sequence without image reconstruction, thus protecting privacy from the data collection stage and preventing the acquisition of detailed visual information from the source. The network is designed to optimize both the illumination patterns and the human keypoint predictor with an encoder–decoder framework. For model training and validation, we used 2000 images from Leeds Sport Dataset and COCO Dataset. By incorporating EfficientNet backbone, the inference time is reduced from 4 s to 0.10 s. In the simulation, the proposed network achieves 91.7% average precision. Our experimental results show an average precision of 88.4% at a remarkably low sampling rate of 0.015. In summary, our proposed method has the advantages of privacy protection and resource efficiency, which can be applied to many monitoring and healthcare tasks, such as clinical monitoring, construction site monitoring, and home service robots.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- National Natural Science Foundation of China
- Basic and Applied Basic Research Foundation of Guangdong Province
- Science, Technology and Innovation Commission of Shenzhen Municipality
Zitieren
APA
Tsoy, A., Liu, Z., Zhang, H., Zhou, M., Yang, W., Geng, H., Jiang, K., Yuan, X., & Geng, Z. (2024). Image-free single-pixel keypoint detection for privacy preserving human pose estimation. Optics Letters, 49(3), 546. https://doi.org/10.1364/ol.514213
Vancouver
Tsoy A, Liu Z, Zhang H, Zhou M, Yang W, Geng H, et al. Image-free single-pixel keypoint detection for privacy preserving human pose estimation. Optics Letters. 2024;49(3):546. doi:10.1364/ol.514213
BibTeX
@article{Tsoy2024,
author = {Tsoy, Aleksandr and Liu, Zonghao and Zhang, Huan and Zhou, Mi and Yang, Wenming and Geng, Hongya and Jiang, Kui and Yuan, Xin and Geng, Zihan},
title = {Image-free single-pixel keypoint detection for privacy preserving human pose estimation},
journal = {Optics Letters},
year = {2024},
volume = {49},
number = {3},
pages = {546},
doi = {10.1364/ol.514213}
}
EUVIMED