EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

MSCH: Microbatch-Based Selective Activation Checkpointing With Recomputation Hidden for Efficient Training of LLM Models

Cheng Zhang, Minjun Yu, Li Yu, Pengyu Cong, Yuchao Yan, Jie Bao, Jian Jiang, Xiaozheng Wang, Xiaolong Ye, Tao Tang, Liang Xiao

IEEE Access · 2024 · 12 · 178460-178475

DOI: 10.1109/access.2024.3456788 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2024. Verfasst von Cheng Zhang und 10 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Kein Abstract verfügbar.

Zitieren

APA

Zhang, C., Yu, M., Yu, L., Cong, P., Yan, Y., Bao, J., Jiang, J., Wang, X., Ye, X., Tang, T., & Xiao, L. (2024). MSCH: Microbatch-Based Selective Activation Checkpointing With Recomputation Hidden for Efficient Training of LLM Models. IEEE Access, 12, 178460-178475. https://doi.org/10.1109/access.2024.3456788

Vancouver

Zhang C, Yu M, Yu L, Cong P, Yan Y, Bao J, et al. MSCH: Microbatch-Based Selective Activation Checkpointing With Recomputation Hidden for Efficient Training of LLM Models. IEEE Access. 2024;12:178460-178475. doi:10.1109/access.2024.3456788

BibTeX
@article{Zhang2024,
  author = {Zhang, Cheng and Yu, Minjun and Yu, Li and Cong, Pengyu and Yan, Yuchao and Bao, Jie and Jiang, Jian and Wang, Xiaozheng and Ye, Xiaolong and Tang, Tao and Xiao, Liang},
  title = {MSCH: Microbatch-Based Selective Activation Checkpointing With Recomputation Hidden for Efficient Training of LLM Models},
  journal = {IEEE Access},
  year = {2024},
  volume = {12},
  pages = {178460--178475},
  doi = {10.1109/access.2024.3456788}
}
Kostenlos starten →