Estimating Power, Performance, and Area for On-Sensor Deployment of AR/VR Workloads Using an Analytical Framework
ACM Transactions on Design Automation of Electronic Systems · 30.11.2024 · 29 (6) · 1-27
DOI: 10.1145/3670404 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Design Automation of Electronic Systems, online erschienen am 18.09.2024. Verfasst von Xiaoyu Sun und 13 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Augmented Reality and Virtual Reality have emerged as the next frontier of intelligent image sensors and computer systems. In these systems, 3D die stacking stands out as a compelling solution, enabling in situ processing capability of the sensory data for tasks such as image classification and object detection at low power, low latency, and a small form factor. These intelligent 3D CMOS Image Sensor (CIS) systems present a wide design space, encompassing multiple domains (e.g., computer vision algorithms, circuit design, system architecture, and semiconductor technology, including 3D stacking) that have not been explored in-depth so far. This article aims to fill this gap. We first present an analytical evaluation framework, STAR-3DSim, dedicated to rapid pre-RTL evaluation of 3D-CIS systems capturing the entire stack from the pixel layer to the on-sensor processor layer. With STAR-3DSim, we then propose several knobs for PPA (power, performance, area) improvement of the Deep Neural Network (DNN) accelerator that can provide up to 53%, 41%, and 63% reduction in energy, latency, and area, respectively, across a broad set of relevant AR/VR workloads. Last, we present full-system evaluation results by taking image sensing, cross-tier data transfer, and off-sensor communication into consideration.
Zitieren
APA
Sun, X., Peng, X., Zhang, S. Q., Gomez, J., Khwa, W., Sarwar, S. S., Li, Z., Cao, W., Wang, Z., Liu, C., Chang, M., Salvo, B. D., Akarvardar, K., & Wong, H. P. (2024). Estimating Power, Performance, and Area for On-Sensor Deployment of AR/VR Workloads Using an Analytical Framework. ACM Transactions on Design Automation of Electronic Systems, 29(6), 1-27. https://doi.org/10.1145/3670404
Vancouver
Sun X, Peng X, Zhang SQ, Gomez J, Khwa W, Sarwar SS, et al. Estimating Power, Performance, and Area for On-Sensor Deployment of AR/VR Workloads Using an Analytical Framework. ACM Transactions on Design Automation of Electronic Systems. 2024;29(6):1-27. doi:10.1145/3670404
BibTeX
@article{Sun2024,
author = {Sun, Xiaoyu and Peng, Xiaochen and Zhang, Sai Qian and Gomez, Jorge and Khwa, Win-San and Sarwar, Syed Shakib and Li, Ziyun and Cao, Weidong and Wang, Zhao and Liu, Chiao and Chang, Meng-Fan and Salvo, Barbara De and Akarvardar, Kerem and Wong, H.-S. Philip},
title = {Estimating Power, Performance, and Area for On-Sensor Deployment of AR/VR Workloads Using an Analytical Framework},
journal = {ACM Transactions on Design Automation of Electronic Systems},
year = {2024},
volume = {29},
number = {6},
pages = {1--27},
doi = {10.1145/3670404}
}
EUVIMED