EUVIMEDEUVIMED entdecken
Crossref

Stereoscopic artificial compound eyes for spatiotemporal perception in three-dimensional space

Byungjoon Bae iD, Doeon Lee, Minseong Park iD, Yujia Mu iD, Yongmin Baek, Inbo Sim, Cong Shen iD, Kyusang Lee iD

Science Robotics · 2024

DOI: 10.1126/scirobotics.adl3606 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Science Robotics, 2024. Verfasst von Byungjoon Bae und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, University of Virginia, Charlottesville, VA 22904, USA. Hauptthemen laut MEDLINE: Depth Perception, Compound Eye, Arthropod, Biomimetics. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 54 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Arthropods’ eyes are effective biological vision systems for object tracking and wide field of view because of their structural uniqueness; however, unlike mammalian eyes, they can hardly acquire the depth information of a static object because of their monocular cues. Therefore, most arthropods rely on motion parallax to track the object in three-dimensional (3D) space. Uniquely, the praying mantis (Mantodea) uses both compound structured eyes and a form of stereopsis and is capable of achieving object recognition in 3D space. Here, by mimicking the vision system of the praying mantis using stereoscopically coupled artificial compound eyes, we demonstrated spatiotemporal object sensing and tracking in 3D space with a wide field of view. Furthermore, to achieve a fast response with minimal latency, data storage/transportation, and power consumption, we processed the visual information at the edge of the system using a synaptic device and a federated split learning algorithm. The designed and fabricated stereoscopic artificial compound eye provides energy-efficient and accurate spatiotemporal object sensing and optical flow tracking. It exhibits a root mean square error of 0.3 centimeter, consuming only approximately 4 millijoules for sensing and tracking. These results are more than 400 times lower than conventional complementary metal-oxide semiconductor–based imaging systems. Our biomimetic imager shows the potential of integrating nature’s unique design using hardware and software codesigned technology toward capabilities of edge computing and sensing.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Depth PerceptionCompound Eye, ArthropodBiomimeticsAnimalsAlgorithmsMantodeaImaging, Three-DimensionalEquipment DesignBiomimetic Materials

Autor:innen und Institutionen

  • Department of Electrical and Computer Engineering, University of Virginia, Charlottesville, VA 22904, USA.
  • Department of Material Science and Engineering, University of Virginia, Charlottesville, VA 22904, USA.

ORCID-Profile: Byungjoon Bae, Minseong Park, Yujia Mu, Cong Shen, Kyusang Lee

Zitieren

APA

Bae, B., Lee, D., Park, M., Mu, Y., Baek, Y., Sim, I., Shen, C., & Lee, K. (2024). Stereoscopic artificial compound eyes for spatiotemporal perception in three-dimensional space. Science Robotics. https://doi.org/10.1126/scirobotics.adl3606

Vancouver

Bae B, Lee D, Park M, Mu Y, Baek Y, Sim I, et al. Stereoscopic artificial compound eyes for spatiotemporal perception in three-dimensional space. Science Robotics. 2024. doi:10.1126/scirobotics.adl3606

BibTeX
@article{Bae2024,
  author = {Bae, Byungjoon and Lee, Doeon and Park, Minseong and Mu, Yujia and Baek, Yongmin and Sim, Inbo and Shen, Cong and Lee, Kyusang},
  title = {Stereoscopic artificial compound eyes for spatiotemporal perception in three-dimensional space},
  journal = {Science Robotics},
  year = {2024},
  doi = {10.1126/scirobotics.adl3606}
}
Kostenlos starten →