MSCH: Microbatch-Based Selective Activation Checkpointing With Recomputation Hidden for Efficient Training of LLM Models
IEEE Access · 2024 · 12 · 178460-178475
DOI: 10.1109/access.2024.3456788 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2024. Verfasst von Cheng Zhang und 10 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Kein Abstract verfügbar.
Zitieren
APA
Zhang, C., Yu, M., Yu, L., Cong, P., Yan, Y., Bao, J., Jiang, J., Wang, X., Ye, X., Tang, T., & Xiao, L. (2024). MSCH: Microbatch-Based Selective Activation Checkpointing With Recomputation Hidden for Efficient Training of LLM Models. IEEE Access, 12, 178460-178475. https://doi.org/10.1109/access.2024.3456788
Vancouver
Zhang C, Yu M, Yu L, Cong P, Yan Y, Bao J, et al. MSCH: Microbatch-Based Selective Activation Checkpointing With Recomputation Hidden for Efficient Training of LLM Models. IEEE Access. 2024;12:178460-178475. doi:10.1109/access.2024.3456788
BibTeX
@article{Zhang2024,
author = {Zhang, Cheng and Yu, Minjun and Yu, Li and Cong, Pengyu and Yan, Yuchao and Bao, Jie and Jiang, Jian and Wang, Xiaozheng and Ye, Xiaolong and Tang, Tao and Xiao, Liang},
title = {MSCH: Microbatch-Based Selective Activation Checkpointing With Recomputation Hidden for Efficient Training of LLM Models},
journal = {IEEE Access},
year = {2024},
volume = {12},
pages = {178460--178475},
doi = {10.1109/access.2024.3456788}
}
EUVIMED