EUVIMEDEUVIMED entdecken
Crossref

Scheduling Storms and Streams in the Cloud

Javad Ghaderi, Sanjay Shakkottai, R. Srikant

ACM Transactions on Modeling and Performance Evaluation of Computing Systems · 2016

DOI: 10.1145/2904080 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Modeling and Performance Evaluation of Computing Systems, 2016. Verfasst von Javad Ghaderi und 2 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 35 Literaturangaben. Gefördert von: NSF CNS, Simons Foundation Chair at UT Austin, NSF ECCS.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Motivated by emerging big streaming data processing paradigms (e.g., Twitter Storm, Streaming MapReduce), we investigate the problem of scheduling graphs over a large cluster of servers. Each graph is a job, where nodes represent compute tasks and edges indicate data flows between these compute tasks. Jobs (graphs) arrive randomly over time and, upon completion, leave the system. When a job arrives, the scheduler needs to partition the graph and distribute it over the servers to satisfy load balancing and cost considerations. Specifically, neighboring compute tasks in the graph that are mapped to different servers incur load on the network; thus a mapping of the jobs among the servers incurs a cost that is proportional to the number of “broken edges.” We propose a low-complexity randomized scheduling algorithm that, without service preemptions, stabilizes the system with graph arrivals/departures; more importantly, it allows a smooth tradeoff between minimizing average partitioning cost and average queue lengths. Interestingly, to avoid service preemptions, our approach does not rely on a Gibbs sampler; instead, we show that the corresponding limiting invariant measure has an interpretation stemming from a loss system.

Förderung

  • NSF CNS
  • Simons Foundation Chair at UT Austin
  • NSF ECCS
  • US DOT supported D-STOP Tier 1 UTC

Zitieren

APA

Ghaderi, J., Shakkottai, S., & Srikant, R. (2016). Scheduling Storms and Streams in the Cloud. ACM Transactions on Modeling and Performance Evaluation of Computing Systems. https://doi.org/10.1145/2904080

Vancouver

Ghaderi J, Shakkottai S, Srikant R. Scheduling Storms and Streams in the Cloud. ACM Transactions on Modeling and Performance Evaluation of Computing Systems. 2016. doi:10.1145/2904080

BibTeX
@article{Ghaderi2016,
  author = {Ghaderi, Javad and Shakkottai, Sanjay and Srikant, R.},
  title = {Scheduling Storms and Streams in the Cloud},
  journal = {ACM Transactions on Modeling and Performance Evaluation of Computing Systems},
  year = {2016},
  doi = {10.1145/2904080}
}
Kostenlos starten →