EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Erasure Codes for Cold Data in Distributed Storage Systems

Chao Yin, Zhiyuan Xu, Wei Li, Tongfang Li, Sihao Yuan, Yan Liu

Applied Sciences · 08.02.2023 · 13 (4) · 2170

DOI: 10.3390/app13042170 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 08.02.2023. Verfasst von Chao Yin und 5 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Science and Technology Project of Jiangxi Provincial Department of Education.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Replication and erasure codes are always used for storing large amounts of data in distributed storage systems. Erasure code technology can maximize the storage space of distributed storage systems as well as guaranteeing their availability and reliability, but it will decrease the performance of the system when encoding and decoding. Since cold data do not require high real-time data availability, we focus on the cold data using erasure codes. We propose a new erasure code process named NewLib code based on the Liberation code, which designs the data alignment after stripping the encoding data. The NewLib code improves the performance of reading and writing in the distributed storage systems. At the same time, we developed a node scheduling scheme called N-Schedule, which divides the data nodes into multiple virtual nodes according to the storage space and computing power. The virtual nodes are dispersed into a hash ring by a consistent hash to construct a fully symmetric and decentralized hash ring in order to achieve uniform data distribution and task scheduling. The experimental results show our scheme can improve the performance of the system.

Förderung

  • National Natural Science Foundation of China
  • Science and Technology Project of Jiangxi Provincial Department of Education

Zitieren

APA

Yin, C., Xu, Z., Li, W., Li, T., Yuan, S., & Liu, Y. (2023). Erasure Codes for Cold Data in Distributed Storage Systems. Applied Sciences, 13(4), 2170. https://doi.org/10.3390/app13042170

Vancouver

Yin C, Xu Z, Li W, Li T, Yuan S, Liu Y. Erasure Codes for Cold Data in Distributed Storage Systems. Applied Sciences. 2023;13(4):2170. doi:10.3390/app13042170

BibTeX
@article{Yin2023,
  author = {Yin, Chao and Xu, Zhiyuan and Li, Wei and Li, Tongfang and Yuan, Sihao and Liu, Yan},
  title = {Erasure Codes for Cold Data in Distributed Storage Systems},
  journal = {Applied Sciences},
  year = {2023},
  volume = {13},
  number = {4},
  pages = {2170},
  doi = {10.3390/app13042170}
}
Kostenlos starten →