EUVIMEDEUVIMED entdecken
Crossref

Toward Efficient Block Replication Management in Distributed Storage

Jianwei Liao, Zhibing Sha, Zhigang Cai, Zhiming Liu, Kenli Li, Wei-Keng Liao, Alok N. Choudhary, Yutaka Ishiakwa

ACM Transactions on Modeling and Performance Evaluation of Computing Systems · 30.09.2020 · 5 (3) · 1-27

DOI: 10.1145/3412450 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Modeling and Performance Evaluation of Computing Systems, online erschienen am 19.10.2020. Verfasst von Jianwei Liao und 7 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 53 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities, Natural Science Foundation Project of CQ CSTC.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Distributed/parallel file systems commonly suffer from load imbalance and resource contention due to the bursty characteristic exhibited in scientific applications. This article presents an adaptive scheme supporting dynamic block data replication and an efficient replica placement policy to improve the I/O performance of a distributed file system. Our goal is not only to yield a balanced data replication among storage servers but also a high degree of data access parallelism for the applications. We first present mathematical cost models to formulate the cost of data block replication by considering both the overhead and reduced data access time to the replicated data. To verify the validity and feasibility of the proposed cost model, we implement our proposal in a prototype distributed file system and evaluate it using a set of representative database-relevant application benchmarks. Our results demonstrate that the proposed approach can boost the usage efficiency of the data replicas with acceptable overhead of data replication management. Consequently, the overall data throughput of storage system can be noticeably improved. In summary, the proposed replication management scheme works well, especially for the database-relevant applications that exhibit an uneven access frequency and pattern to different parts of files.

Förderung

  • National Natural Science Foundation of China
  • Fundamental Research Funds for the Central Universities
  • Natural Science Foundation Project of CQ CSTC
  • Hunan Provincial Natural Science Foundation of China

Zitieren

APA

Liao, J., Sha, Z., Cai, Z., Liu, Z., Li, K., Liao, W., Choudhary, A. N., & Ishiakwa, Y. (2020). Toward Efficient Block Replication Management in Distributed Storage. ACM Transactions on Modeling and Performance Evaluation of Computing Systems, 5(3), 1-27. https://doi.org/10.1145/3412450

Vancouver

Liao J, Sha Z, Cai Z, Liu Z, Li K, Liao W, et al. Toward Efficient Block Replication Management in Distributed Storage. ACM Transactions on Modeling and Performance Evaluation of Computing Systems. 2020;5(3):1-27. doi:10.1145/3412450

BibTeX
@article{Liao2020,
  author = {Liao, Jianwei and Sha, Zhibing and Cai, Zhigang and Liu, Zhiming and Li, Kenli and Liao, Wei-Keng and Choudhary, Alok N. and Ishiakwa, Yutaka},
  title = {Toward Efficient Block Replication Management in Distributed Storage},
  journal = {ACM Transactions on Modeling and Performance Evaluation of Computing Systems},
  year = {2020},
  volume = {5},
  number = {3},
  pages = {1--27},
  doi = {10.1145/3412450}
}
Kostenlos starten →