EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

TMO: Transparent Memory Offloading in Datacenters

Johannes Weiner, Niket Agarwal, Dan Schatzberg, Leon Yang, Hao Wang, Blaise Sanouillet, Bikash Sharma, Tejun Heo, Mayank Jain, Chunqiang Tang, Dimitrios Skarlatos

Communications of the ACM · 2025-09 · 68 (9) · 102-110

DOI: 10.1145/3746651 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Communications of the ACM, online erschienen am 28.08.2025. Verfasst von Johannes Weiner und 10 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The unrelenting growth in the memory demands of datacenter applications, combined with DRAM’s volatile prices and ever-increasing costs, has made DRAM a major infrastructure expense. Alternative technologies, such as NVMe SSDs and emerging NVM devices, offer higher capacity than DRAM at a fraction of the cost and power. A promising approach is to transparently offload colder memory to cheaper memory technologies via kernel or hypervisor techniques. The key challenge, however, is to develop a datacenter-scale solution that is robust in dealing with diverse workloads and large performance variance of different offload devices, such as compressed memory, SSD, and NVM. This paper presents TMO, Meta’s transparent memory offloading solution for heterogeneous datacenter environments. TMO introduces a new Linux kernel mechanism that directly measures, in realtime, process stalls due to resource shortages across CPU, memory, and I/O. Guided by this information and without any prior application knowledge, TMO automatically adjusts how much memory to offload to heterogeneous devices (e.g., compressed memory or SSD) according to the device’s performance characteristics and the application’s sensitivity to memory-access slowdown. To maximize memory savings, TMO targets both anonymous memory and file cache, balancing the swap-in rate of anonymous memory and the reload rate of file pages that were recently evicted from the file cache. Moreover, it identifies offloading opportunities not only from the application containers but also from the sidecar containers that provide infrastructure-level functions. TMO has been in production since 2021, saving 20–32% of total memory across millions of servers in our hyperscale datacenter fleet. We have successfully upstreamed TMO into the Linux kernel.

Zitieren

APA

Weiner, J., Agarwal, N., Schatzberg, D., Yang, L., Wang, H., Sanouillet, B., Sharma, B., Heo, T., Jain, M., Tang, C., & Skarlatos, D. (2025). TMO: Transparent Memory Offloading in Datacenters. Communications of the ACM, 68(9), 102-110. https://doi.org/10.1145/3746651

Vancouver

Weiner J, Agarwal N, Schatzberg D, Yang L, Wang H, Sanouillet B, et al. TMO: Transparent Memory Offloading in Datacenters. Communications of the ACM. 2025;68(9):102-110. doi:10.1145/3746651

BibTeX
@article{Weiner2025,
  author = {Weiner, Johannes and Agarwal, Niket and Schatzberg, Dan and Yang, Leon and Wang, Hao and Sanouillet, Blaise and Sharma, Bikash and Heo, Tejun and Jain, Mayank and Tang, Chunqiang and Skarlatos, Dimitrios},
  title = {TMO: Transparent Memory Offloading in Datacenters},
  journal = {Communications of the ACM},
  year = {2025},
  volume = {68},
  number = {9},
  pages = {102--110},
  doi = {10.1145/3746651}
}
Kostenlos starten →