EUVIMEDEUVIMED entdecken
Crossref

Catch Non-determinism If You Can: Intermittent Inference of Dynamic Neural Networks

Chih-Hsuan Yen, Hashan Roshantha Mendis, Tei-Wei Kuo, Pi-Cheng Hsiu

ACM Transactions on Embedded Computing Systems · 30.11.2025 · 24 (5s) · 1-24

DOI: 10.1145/3757917 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Embedded Computing Systems, online erschienen am 26.09.2025. Verfasst von Chih-Hsuan Yen und 3 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 53 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Guaranteeing reliable deep neural network (DNN) inference despite intermittent power is the cornerstone of enabling intelligent systems in energy-harvesting environments. Existing intermittent inference approaches support static neural networks with deterministic execution characteristics, accumulating progress across power cycles. However, dynamic neural networks adapt their structures at runtime. We observe that because intermittent inference approaches are unaware of this non-deterministic execution behavior, they suffer from incorrect progress recovery, degrading inference accuracy and performance. This work proposes non-deterministic inference progress accumulation to enable dynamic neural network inference on intermittent systems. Our middleware, NodPA, realizes this methodology by strategically selecting additional progress information to capture the non-determinism of the power-interrupted computation while preserving only the changed portions of the progress information to maintain low runtime overhead. Evaluations are conducted on a Texas Instruments device with both static and dynamic neural networks under time-varying power sources. Compared to intermittent inference approaches reliant on determinism, NodPA is less prone to inference non-termination and achieves an average inference speedup of 1.57 times without compromising accuracy, with greater improvements for highly dynamic networks under weaker power.

Zitieren

APA

Yen, C., Mendis, H. R., Kuo, T., & Hsiu, P. (2025). Catch Non-determinism If You Can: Intermittent Inference of Dynamic Neural Networks. ACM Transactions on Embedded Computing Systems, 24(5s), 1-24. https://doi.org/10.1145/3757917

Vancouver

Yen C, Mendis HR, Kuo T, Hsiu P. Catch Non-determinism If You Can: Intermittent Inference of Dynamic Neural Networks. ACM Transactions on Embedded Computing Systems. 2025;24(5s):1-24. doi:10.1145/3757917

BibTeX
@article{Yen2025,
  author = {Yen, Chih-Hsuan and Mendis, Hashan Roshantha and Kuo, Tei-Wei and Hsiu, Pi-Cheng},
  title = {Catch Non-determinism If You Can: Intermittent Inference of Dynamic Neural Networks},
  journal = {ACM Transactions on Embedded Computing Systems},
  year = {2025},
  volume = {24},
  number = {5s},
  pages = {1--24},
  doi = {10.1145/3757917}
}
Kostenlos starten →