EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Estimating Power, Performance, and Area for On-Sensor Deployment of AR/VR Workloads Using an Analytical Framework

Xiaoyu Sun, Xiaochen Peng, Sai Qian Zhang, Jorge Gomez, Win-San Khwa, Syed Shakib Sarwar, Ziyun Li, Weidong Cao, Zhao Wang, Chiao Liu, Meng-Fan Chang, Barbara De Salvo and 2 more

ACM Transactions on Design Automation of Electronic Systems · 2024-11-30 · 29 (6) · 1-27

DOI: 10.1145/3670404 ↗

At a glance

Journal article in ACM Transactions on Design Automation of Electronic Systems, published online on 2024-09-18. Written by Xiaoyu Sun and 13 co-authors. Cited 8 times so far (Crossref); 59 references. The full text is freely available (open access, CC BY 4.0).

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Augmented Reality and Virtual Reality have emerged as the next frontier of intelligent image sensors and computer systems. In these systems, 3D die stacking stands out as a compelling solution, enabling in situ processing capability of the sensory data for tasks such as image classification and object detection at low power, low latency, and a small form factor. These intelligent 3D CMOS Image Sensor (CIS) systems present a wide design space, encompassing multiple domains (e.g., computer vision algorithms, circuit design, system architecture, and semiconductor technology, including 3D stacking) that have not been explored in-depth so far. This article aims to fill this gap. We first present an analytical evaluation framework, STAR-3DSim, dedicated to rapid pre-RTL evaluation of 3D-CIS systems capturing the entire stack from the pixel layer to the on-sensor processor layer. With STAR-3DSim, we then propose several knobs for PPA (power, performance, area) improvement of the Deep Neural Network (DNN) accelerator that can provide up to 53%, 41%, and 63% reduction in energy, latency, and area, respectively, across a broad set of relevant AR/VR workloads. Last, we present full-system evaluation results by taking image sensing, cross-tier data transfer, and off-sensor communication into consideration.

Cite

APA

Sun, X., Peng, X., Zhang, S. Q., Gomez, J., Khwa, W., Sarwar, S. S., Li, Z., Cao, W., Wang, Z., Liu, C., Chang, M., Salvo, B. D., Akarvardar, K., & Wong, H. P. (2024). Estimating Power, Performance, and Area for On-Sensor Deployment of AR/VR Workloads Using an Analytical Framework. ACM Transactions on Design Automation of Electronic Systems, 29(6), 1-27. https://doi.org/10.1145/3670404

Vancouver

Sun X, Peng X, Zhang SQ, Gomez J, Khwa W, Sarwar SS, et al. Estimating Power, Performance, and Area for On-Sensor Deployment of AR/VR Workloads Using an Analytical Framework. ACM Transactions on Design Automation of Electronic Systems. 2024;29(6):1-27. doi:10.1145/3670404

BibTeX
@article{Sun2024,
  author = {Sun, Xiaoyu and Peng, Xiaochen and Zhang, Sai Qian and Gomez, Jorge and Khwa, Win-San and Sarwar, Syed Shakib and Li, Ziyun and Cao, Weidong and Wang, Zhao and Liu, Chiao and Chang, Meng-Fan and Salvo, Barbara De and Akarvardar, Kerem and Wong, H.-S. Philip},
  title = {Estimating Power, Performance, and Area for On-Sensor Deployment of AR/VR Workloads Using an Analytical Framework},
  journal = {ACM Transactions on Design Automation of Electronic Systems},
  year = {2024},
  volume = {29},
  number = {6},
  pages = {1--27},
  doi = {10.1145/3670404}
}
Start for free →