Catch Non-determinism If You Can: Intermittent Inference of Dynamic Neural Networks
ACM Transactions on Embedded Computing Systems · 30.11.2025 · 24 (5s) · 1-24
DOI: 10.1145/3757917 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Embedded Computing Systems, online erschienen am 26.09.2025. Verfasst von Chih-Hsuan Yen und 3 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 53 Literaturangaben.
Abstract (Originalsprache)
Guaranteeing reliable deep neural network (DNN) inference despite intermittent power is the cornerstone of enabling intelligent systems in energy-harvesting environments. Existing intermittent inference approaches support static neural networks with deterministic execution characteristics, accumulating progress across power cycles. However, dynamic neural networks adapt their structures at runtime. We observe that because intermittent inference approaches are unaware of this non-deterministic execution behavior, they suffer from incorrect progress recovery, degrading inference accuracy and performance. This work proposes non-deterministic inference progress accumulation to enable dynamic neural network inference on intermittent systems. Our middleware, NodPA, realizes this methodology by strategically selecting additional progress information to capture the non-determinism of the power-interrupted computation while preserving only the changed portions of the progress information to maintain low runtime overhead. Evaluations are conducted on a Texas Instruments device with both static and dynamic neural networks under time-varying power sources. Compared to intermittent inference approaches reliant on determinism, NodPA is less prone to inference non-termination and achieves an average inference speedup of 1.57 times without compromising accuracy, with greater improvements for highly dynamic networks under weaker power.
Zitieren
APA
Yen, C., Mendis, H. R., Kuo, T., & Hsiu, P. (2025). Catch Non-determinism If You Can: Intermittent Inference of Dynamic Neural Networks. ACM Transactions on Embedded Computing Systems, 24(5s), 1-24. https://doi.org/10.1145/3757917
Vancouver
Yen C, Mendis HR, Kuo T, Hsiu P. Catch Non-determinism If You Can: Intermittent Inference of Dynamic Neural Networks. ACM Transactions on Embedded Computing Systems. 2025;24(5s):1-24. doi:10.1145/3757917
BibTeX
@article{Yen2025,
author = {Yen, Chih-Hsuan and Mendis, Hashan Roshantha and Kuo, Tei-Wei and Hsiu, Pi-Cheng},
title = {Catch Non-determinism If You Can: Intermittent Inference of Dynamic Neural Networks},
journal = {ACM Transactions on Embedded Computing Systems},
year = {2025},
volume = {24},
number = {5s},
pages = {1--24},
doi = {10.1145/3757917}
}
EUVIMED