Neuromorphic Optical Tracking and Imaging of Randomly Moving Targets Through Dynamic Dense Scattering Media
Advanced Science · 2026-11 · 13 (63)
DOI: 10.1002/advs.77082 ↗At a glance
Journal article in Advanced Science, published online on 2026-08-24. Written by Ning Zhang and 1 co-authors. Institution: School of Engineering, Brown University, Providence, Rhode Island, USA. 51 references. The full text is freely available (open access, CC BY 4.0). Funded by: Office of Naval Research, NIH HHS, National Science Foundation.
Abstract (original language)
Imaging and tracking objects moving along random, unpredictable trajectories through dense scattering media remains an open challenge with direct applications in autonomous navigation, underwater robotics, and biomedical sensing. Here we present, to our knowledge, the first end‐to‐end brain‐inspired neuromorphic system that accomplishes both tasks simultaneously. A dynamic vision sensor (DVS) captures photons interacting with dynamic targets while suppressing the static “foggy” scattering background, yielding sparse spike trains. These feed directly into a deep spiking neural network (SNN) with dual modules: an Object Tracking Module for real‐time localization and an Object Reconstruction Module with residual refinement for high‐fidelity spatial recovery. Temporal memory in leaky integrate‐and‐fire neurons lets the network accumulate evidence across time steps, reconstructing consistent target geometry despite substantial motion‐induced variation in spike patterns. We validate the system in transmission and reflection geometries using solid optical phantoms, turbid water, and dynamic fog, with two‐dimensional targets of increasing complexity—MNIST digits, Kanji characters, and birds executing naturalistic trajectories. The system achieves structural similarity indices up to 0.96 and mean squared errors as low as 0.004, with full‐sequence inference completing in under 15 ms. Energy analysis indicates 18‐fold reductions relative to equivalent artificial neural networks, positioning the approach for emerging ultralow‐power neuromorphic hardware.
Subjects
Author keywords
Authors and institutions
- School of Engineering, Brown University, Providence, Rhode Island, USA.
ORCID profiles: Ning Zhang, Arto Nurmikko
Funding
- Office of Naval Research
- NIH HHS
- National Science Foundation
- Intel Laboratories
- National Institutes of Health
Cite
APA
Zhang, N., & Nurmikko, A. (2026). Neuromorphic Optical Tracking and Imaging of Randomly Moving Targets Through Dynamic Dense Scattering Media. Advanced Science, 13(63). https://doi.org/10.1002/advs.77082
Vancouver
Zhang N, Nurmikko A. Neuromorphic Optical Tracking and Imaging of Randomly Moving Targets Through Dynamic Dense Scattering Media. Advanced Science. 2026;13(63). doi:10.1002/advs.77082
BibTeX
@article{Zhang2026,
author = {Zhang, Ning and Nurmikko, Arto},
title = {Neuromorphic Optical Tracking and Imaging of Randomly Moving Targets Through Dynamic Dense Scattering Media},
journal = {Advanced Science},
year = {2026},
volume = {13},
number = {63},
doi = {10.1002/advs.77082}
}
EUVIMED