Ultrafast dynamic machine vision with spatiotemporal photonic computing
Science Advances · 09.06.2023 · 9 (23)
DOI: 10.1126/sciadv.adg4391 ↗Kurz gefasst
Fachartikel in der Zeitschrift Science Advances, erschienen am 09.06.2023. Verfasst von Tiankuang Zhou und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electronic Engineering, Tsinghua University, Beijing 100084, China. Die Arbeit wurde bisher 58-mal zitiert (Crossref) und nennt 76 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Ultrafast dynamic machine vision in the optical domain can provide unprecedented perspectives for high-performance computing. However, owing to the limited degrees of freedom, existing photonic computing approaches rely on the memory’s slow read/write operations to implement dynamic processing. Here, we propose a spatiotemporal photonic computing architecture to match the highly parallel spatial computing with high-speed temporal computing and achieve a three-dimensional spatiotemporal plane. A unified training framework is devised to optimize the physical system and the network model. The photonic processing speed of the benchmark video dataset is increased by 40-fold on a space-multiplexed system with 35-fold fewer parameters. A wavelength-multiplexed system realizes all-optical nonlinear computing of dynamic light field with a frame time of 3.57 nanoseconds. The proposed architecture paves the way for ultrafast advanced machine vision free from the limits of memory wall and will find applications in unmanned systems, autonomous driving, ultrafast science, etc.
Autor:innen und Institutionen
- Department of Electronic Engineering, Tsinghua University, Beijing 100084, China.
- Department of Automation, Tsinghua University, Beijing 100084, China.
- Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China.
- Shenzhen International Graduate School, Tsinghua University, Shenzhen 518071, China.
- Research Center for Intelligent Optoelectronic Computing, Zhejiang Laboratory, Hangzhou 311100, China.
- Institute for Brain and Cognitive Sciences, Tsinghua University, Beijing 100084, China.
ORCID-Profile: Tiankuang Zhou, Wei Wu, Shaoliang Yu, Lu Fang
Zitieren
APA
Zhou, T., Wu, W., Zhang, J., Yu, S., & Fang, L. (2023). Ultrafast dynamic machine vision with spatiotemporal photonic computing. Science Advances, 9(23). https://doi.org/10.1126/sciadv.adg4391
Vancouver
Zhou T, Wu W, Zhang J, Yu S, Fang L. Ultrafast dynamic machine vision with spatiotemporal photonic computing. Science Advances. 2023;9(23). doi:10.1126/sciadv.adg4391
BibTeX
@article{Zhou2023,
author = {Zhou, Tiankuang and Wu, Wei and Zhang, Jinzhi and Yu, Shaoliang and Fang, Lu},
title = {Ultrafast dynamic machine vision with spatiotemporal photonic computing},
journal = {Science Advances},
year = {2023},
volume = {9},
number = {23},
doi = {10.1126/sciadv.adg4391}
}
EUVIMED