Exploring Fault Tolerance Strategies in Big Data Infrastructures and Their Impact on Processing Efficiency
International Journal of Computer Science and Information Technology · 28.12.2024 · 16 (6) · 35-40
DOI: 10.5121/ijcsit.2024.16603 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Science and Information Technology, online erschienen am 28.12.2024. Verfasst von Akaash Vishal Hazarika und 1 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref).
Abstract (Originalsprache)
As big data systems continue to grow in scale and complexity, ensuring fault tolerance while maintaining processing efficiency has become increasingly challenging. This paper presents a comprehensive analysis of fault tolerance strategies in distributed big data infrastructures, examining three primary approaches: replication, checkpointing, and consensus algorithms. Through a systematic review of current implementations and case studies across major platforms including Apache Hadoop, Spark, and Flink, we evaluate the performance implications of these strategies using key metrics such as throughput, latency, and resource utilization. Our analysis reveals significant trade-offs between reliability and performance, particularly in write-intensive workloads where replication factors directly impact system performance. The paper also examines how different architectures, including client-server, peer-to-peer, and serviceoriented models, influence the effectiveness of fault tolerance mechanisms. Based on our findings, we propose recommendations for implementing fault tolerance at scale and identify emerging research directions, including the integration of machine learning for adaptive fault tolerance and the potential of hybrid approaches in managing the reliability-performance balance. This research contributes to the understanding of how organizations can optimize their fault tolerance strategies while maintaining acceptable processing efficiency in large-scale distributed systems.
Zitieren
APA
Hazarika, A. V., & Shah, M. (2024). Exploring Fault Tolerance Strategies in Big Data Infrastructures and Their Impact on Processing Efficiency. International Journal of Computer Science and Information Technology, 16(6), 35-40. https://doi.org/10.5121/ijcsit.2024.16603
Vancouver
Hazarika AV, Shah M. Exploring Fault Tolerance Strategies in Big Data Infrastructures and Their Impact on Processing Efficiency. International Journal of Computer Science and Information Technology. 2024;16(6):35-40. doi:10.5121/ijcsit.2024.16603
BibTeX
@article{Hazarika2024,
author = {Hazarika, Akaash Vishal and Shah, Mahak},
title = {Exploring Fault Tolerance Strategies in Big Data Infrastructures and Their Impact on Processing Efficiency},
journal = {International Journal of Computer Science and Information Technology},
year = {2024},
volume = {16},
number = {6},
pages = {35--40},
doi = {10.5121/ijcsit.2024.16603}
}
EUVIMED