EUVIMEDEUVIMED entdecken
Crossref

Designing Real-time Data Pipelines for Predictive Analytics in Large-scale Systems

Divya Kodi

FMDB Transactions on Sustainable Computing Systems · 2024

DOI: 10.69888/ftscs.2024.000294 ↗

Kurz gefasst

Fachartikel in der Zeitschrift FMDB Transactions on Sustainable Computing Systems, 2024. Verfasst von Divya Kodi. Die Arbeit wurde bisher 4-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the age of data decision-making, real-time data pipelines have become an integral building block for predictive analytics in big-scale systems. The article outlines the design, deployment, and challenge of creating reliable real-time data pipelines for predictive analytics at scale. Data used in this research is sourced from an e-commerce site, involving transactional information, customer behaviour, product surfing, and purchasing interactions. The data set consists of many structured and unstructured data and perfectly signifies the complexity involved while processing high-velocity, big-scale data for predictive analytics. We touch upon key domains such as ingestion, processing, storage, and analytics and also talk about varied architectures such as Lambda and Kappa that offer fault-tolerant scalability. We talk about employing machine learning models and consuming streams of real-time data and predictive models for deriving actionable insight for big systems. Apart from technology and operations-based needs, this paper also describes the best practices, tools, and frameworks necessary to correctly implement real-time data pipelines for predictive analytics. The study emphasizes pipeline optimization with low latency, high throughput, and fault tolerance to enable long-term and precise predictions.

Zitieren

APA

Kodi, D. (2024). Designing Real-time Data Pipelines for Predictive Analytics in Large-scale Systems. FMDB Transactions on Sustainable Computing Systems. https://doi.org/10.69888/ftscs.2024.000294

Vancouver

Kodi D. Designing Real-time Data Pipelines for Predictive Analytics in Large-scale Systems. FMDB Transactions on Sustainable Computing Systems. 2024. doi:10.69888/ftscs.2024.000294

BibTeX
@article{Kodi2024,
  author = {Kodi, Divya},
  title = {Designing Real-time Data Pipelines for Predictive Analytics in Large-scale Systems},
  journal = {FMDB Transactions on Sustainable Computing Systems},
  year = {2024},
  doi = {10.69888/ftscs.2024.000294}
}
Kostenlos starten →