RAMS: Runtime Adaptive Memory Scaling for Tiny Deep Learning on IoT Devices
IEEE Transactions on Mobile Computing · 2026-06 · 25 (6) · 9237-9250
DOI: 10.1109/tmc.2026.3651722 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2026-06. Verfasst von Haolin Chu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Xiaomi Young Talents Program of Xiaomi Foundation and Shandong Key Laboratory of Advanced Computing.
Abstract (Originalsprache)
Deploying Tiny Deep Learning (TinyDL) on Internet of Things (IoT) devices is gaining popularity. To accommodate the limited memory, recent methods split tensors into fine-grained parts and plan memory offline to minimize its footprint. However, they fail to adapt to dynamic memory, missing the opportunity to utilize temporarily available memory for faster inference. Additionally, existing approaches focus solely on minimizing memory size while neglecting cache usage characteristics, resulting in frequent cache misses and increased latency. In this paper, we propose RAMS, an efficient framework supporting runtime adaptive memory scaling to fully utilize the dynamic memory. We design a size-controllable tensor generation method, thereby enabling memory scaling at runtime. We also propose a cache-friendly memory management approach that minimizes cache miss times. RAMS includes an offline planner to minimize the memory footprint essential for inference and an online manager to determine memory sizes and generate layouts for size-controllable tensors based on available memory. RAMS significantly reduces inference latency while maintaining a compact memory footprint. Extensive experiments on commercial devices running RTOS and Android systems demonstrate that, compared to the state-of-the-art methods, RAMS can efficiently reduce latency by up to 1.57× and 1.48× compared to TFLM and TinyTS, respectively using a comparable memory footprint, while reducing power consumption by 67.74% and 15.97%.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Xiaomi Young Talents Program of Xiaomi Foundation and Shandong Key Laboratory of Advanced Computing
Zitieren
APA
Chu, H., Xin, H., Zheng, X., Liu, L., & Ma, H. (2026). RAMS: Runtime Adaptive Memory Scaling for Tiny Deep Learning on IoT Devices. IEEE Transactions on Mobile Computing, 25(6), 9237-9250. https://doi.org/10.1109/tmc.2026.3651722
Vancouver
Chu H, Xin H, Zheng X, Liu L, Ma H. RAMS: Runtime Adaptive Memory Scaling for Tiny Deep Learning on IoT Devices. IEEE Transactions on Mobile Computing. 2026;25(6):9237-9250. doi:10.1109/tmc.2026.3651722
BibTeX
@article{Chu2026,
author = {Chu, Haolin and Xin, Haiteng and Zheng, Xiaolong and Liu, Liang and Ma, Huadong},
title = {RAMS: Runtime Adaptive Memory Scaling for Tiny Deep Learning on IoT Devices},
journal = {IEEE Transactions on Mobile Computing},
year = {2026},
volume = {25},
number = {6},
pages = {9237--9250},
doi = {10.1109/tmc.2026.3651722}
}
EUVIMED