Cybermycelium: a reference architecture for domain-driven distributed big data systems
Frontiers in Big Data · 05.11.2024 · 7
DOI: 10.3389/fdata.2024.1448481 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Big Data, online erschienen am 05.11.2024. Verfasst von Pouya Ataei. Beteiligte Einrichtung: School of Engineering, Computer and Mathematical Sciences, Auckland University of Technology, Auckland, New Zealand. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 98 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Introduction
The ubiquity of digital devices, the infrastructure of today, and the ever-increasing proliferation of digital products have dawned a new era, the era of big data (BD). This era began when the volume, variety, and velocity of data overwhelmed traditional systems that used to analyze and store that data. This precipitated a new class of software systems, namely, BD systems. Whereas BD systems provide a competitive advantage to businesses, many have failed to harness the power of them. It has been estimated that only 20% of companies have successfully implemented a BD project.
Methods
This study aims to facilitate BD system development by introducing Cybermycelium, a domain-driven decentralized BD reference architecture (RA). The artifact was developed following the guidelines of empirically grounded RAs and evaluated through implementation in a real-world scenario using the Architecture Tradeoff Analysis Method (ATAM).
Results
The evaluation revealed that Cybermycelium successfully addressed key architectural qualities: performance (achieving <1,000 ms response times), availability (through event brokers and circuit breaking), and modifiability (enabling rapid service deployment and configuration). The prototype demonstrated effective handling of data processing, scalability challenges, and domain-specific requirements in a large-scale international company setting.
Discussion
The results highlight important architectural trade-offs between event backbone implementation and service mesh design. While the domain-driven distributed approach improved scalability and maintainability compared to traditional monolithic architectures, it requires significant technical expertise for implementation. This contribution advances the field by providing a validated reference architecture that addresses the challenges of adopting BD in modern enterprises.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Engineering, Computer and Mathematical Sciences, Auckland University of Technology, Auckland, New Zealand.
Zitieren
APA
Ataei, P. (2024). Cybermycelium: a reference architecture for domain-driven distributed big data systems. Frontiers in Big Data, 7. https://doi.org/10.3389/fdata.2024.1448481
Vancouver
Ataei P. Cybermycelium: a reference architecture for domain-driven distributed big data systems. Frontiers in Big Data. 2024;7. doi:10.3389/fdata.2024.1448481
BibTeX
@article{Ataei2024,
author = {Ataei, Pouya},
title = {Cybermycelium: a reference architecture for domain-driven distributed big data systems},
journal = {Frontiers in Big Data},
year = {2024},
volume = {7},
doi = {10.3389/fdata.2024.1448481}
}
EUVIMED