EUVIMEDSkopri EUVIMED
Open access · CC BY 4.0

Robust-DSN: A Hybrid Distributed Replication and Encoding Network Grouped with a Distributed Swarm Workflow Scheduler

Zeeshan Hameed, Hamid R. Barzegar, Nabil El Ioini, Claus Pahl

Electronics · 2024-05-10 · 13 (10) · 1861

DOI: 10.3390/electronics13101861 ↗

At a glance

Journal article in Electronics, published online on 2024-05-10. Written by Zeeshan Hameed and 3 co-authors. Cited 4 times so far (Crossref); 37 references. The full text is freely available (open access, CC BY 4.0).

AstrattDettalji biblijografiċiCiteRelated studies

Abstract (original language)

In many distributed applications such as the Internet of Things (IoT), large amounts of data are being generated that require robust storage solutions. Traditional cloud solutions, although efficient, often lack trust and transparency because of centralized management. To address these issues, we present Robust-DSN, a distributed storage network leveraging the hybrid distributed replication and encoding network (HYDREN) and the distributed swarm workflow scheduler (DSWS) as its main components. Our system uses an interplanetary file system (IPFS) as an underlay storage network and segments it into multiple regions to distribute the failure domain and improve the data’s proximity to users. HYDREN incorporates Reed–Solomon encoding and distributed replication to improve file availability, while DSWS optimizes resource allocation across the network. The uploaded file is encoded into chunks and distributed across distinct optimal nodes leveraging lightweight multithreading. Additionally, Robust-DSN verifies the integrity of all chunks by preserving the hashes when uploading and validating each chunk while downloading. The proposed system provides a comprehensive solution for resilient distributed data storage, focusing on the key challenges of data availability, integrity, and performance. The results reveal that compared with a state-of-the-art system, the proposed system improves file recovery by 15%, even with a 50% peer failure rate. Furthermore, with replication factor 4 and the same failure resilience as IPFS, it saves 50% storage and enhances file recovery by 8%. Robust-DSN acts as a distributed storage platform for emerging technologies, expanding storage system capabilities in a wide range of distributed applications.

Cite

APA

Hameed, Z., Barzegar, H. R., Ioini, N. E., & Pahl, C. (2024). Robust-DSN: A Hybrid Distributed Replication and Encoding Network Grouped with a Distributed Swarm Workflow Scheduler. Electronics, 13(10), 1861. https://doi.org/10.3390/electronics13101861

Vancouver

Hameed Z, Barzegar HR, Ioini NE, Pahl C. Robust-DSN: A Hybrid Distributed Replication and Encoding Network Grouped with a Distributed Swarm Workflow Scheduler. Electronics. 2024;13(10):1861. doi:10.3390/electronics13101861

BibTeX
@article{Hameed2024,
  author = {Hameed, Zeeshan and Barzegar, Hamid R. and Ioini, Nabil El and Pahl, Claus},
  title = {Robust-DSN: A Hybrid Distributed Replication and Encoding Network Grouped with a Distributed Swarm Workflow Scheduler},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {10},
  pages = {1861},
  doi = {10.3390/electronics13101861}
}
Start for free →