A Predictive, Per-Engine Energy Roofline of the Apple Neural Engine
ACM Transactions on Architecture and Code Optimization · 19.11.2026
DOI: 10.1145/3864456 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Architecture and Code Optimization, online erschienen am 19.11.2026. Verfasst von Spencer Bryngelson. Die Arbeit nennt 33 Literaturangaben.
Abstract (Originalsprache)
The Apple Neural Engine (ANE) is in over a billion devices, but is characterized indirectly via CoreML. Using a CoreML-free fused-graph dispatch path, we measure the ANE, along with the Apple GPU and CPU on the same device, with per-engine energy accounting. The consumer-available roofline does not predict the ANE in practice. A critical correction is that the ANE sees two effective memory bandwidths: a slow activation path and a fast weight-stream path. Two roofline ridges follow, and the weight-stream ridge is below that of the GPU. The ANE single-operand compute peak decreases instead of plateauing. Its weight stream is byte-bound in fp16 but limited by the dequantizer’s element rate in int8. As a result, int8 compression saves energy at unchanged throughput and an int4 lookup-table stream raises throughput and efficiency at a cost of 2.55 points of ImageNet top-1. The corrected roofline identifies the lower-energy ANE paths and bounds it from below. A constructed device map reproduces across four unique ANE generations. Results show that operators should be placed by arithmetic intensity and fused for optimal performance.
Zitieren
APA
Bryngelson, S. (2026). A Predictive, Per-Engine Energy Roofline of the Apple Neural Engine. ACM Transactions on Architecture and Code Optimization. https://doi.org/10.1145/3864456
Vancouver
Bryngelson S. A Predictive, Per-Engine Energy Roofline of the Apple Neural Engine. ACM Transactions on Architecture and Code Optimization. 2026. doi:10.1145/3864456
BibTeX
@article{Bryngelson2026,
author = {Bryngelson, Spencer},
title = {A Predictive, Per-Engine Energy Roofline of the Apple Neural Engine},
journal = {ACM Transactions on Architecture and Code Optimization},
year = {2026},
doi = {10.1145/3864456}
}
EUVIMED