EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Cybermycelium: a reference architecture for domain-driven distributed big data systems

Pouya Ataei

Frontiers in Big Data · 05.11.2024 · 7

DOI: 10.3389/fdata.2024.1448481 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Big Data, online erschienen am 05.11.2024. Verfasst von Pouya Ataei. Beteiligte Einrichtung: School of Engineering, Computer and Mathematical Sciences, Auckland University of Technology, Auckland, New Zealand. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 98 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

The ubiquity of digital devices, the infrastructure of today, and the ever-increasing proliferation of digital products have dawned a new era, the era of big data (BD). This era began when the volume, variety, and velocity of data overwhelmed traditional systems that used to analyze and store that data. This precipitated a new class of software systems, namely, BD systems. Whereas BD systems provide a competitive advantage to businesses, many have failed to harness the power of them. It has been estimated that only 20% of companies have successfully implemented a BD project.

Methods

This study aims to facilitate BD system development by introducing Cybermycelium, a domain-driven decentralized BD reference architecture (RA). The artifact was developed following the guidelines of empirically grounded RAs and evaluated through implementation in a real-world scenario using the Architecture Tradeoff Analysis Method (ATAM).

Results

The evaluation revealed that Cybermycelium successfully addressed key architectural qualities: performance (achieving <1,000 ms response times), availability (through event brokers and circuit breaking), and modifiability (enabling rapid service deployment and configuration). The prototype demonstrated effective handling of data processing, scalability challenges, and domain-specific requirements in a large-scale international company setting.

Discussion

The results highlight important architectural trade-offs between event backbone implementation and service mesh design. While the domain-driven distributed approach improved scalability and maintainability compared to traditional monolithic architectures, it requires significant technical expertise for implementation. This contribution advances the field by providing a validated reference architecture that addresses the challenges of adopting BD in modern enterprises.

Schlagwörter

Stichwörter der Autor:innen

big data architecturebig data reference architecturebig data software engineeringbig data systemsdecentralized systemdistributed systemsdomain-driven designreference architecture

Autor:innen und Institutionen

  • School of Engineering, Computer and Mathematical Sciences, Auckland University of Technology, Auckland, New Zealand.

Zitieren

APA

Ataei, P. (2024). Cybermycelium: a reference architecture for domain-driven distributed big data systems. Frontiers in Big Data, 7. https://doi.org/10.3389/fdata.2024.1448481

Vancouver

Ataei P. Cybermycelium: a reference architecture for domain-driven distributed big data systems. Frontiers in Big Data. 2024;7. doi:10.3389/fdata.2024.1448481

BibTeX
@article{Ataei2024,
  author = {Ataei, Pouya},
  title = {Cybermycelium: a reference architecture for domain-driven distributed big data systems},
  journal = {Frontiers in Big Data},
  year = {2024},
  volume = {7},
  doi = {10.3389/fdata.2024.1448481}
}
Kostenlos starten →