EUVIMEDEUVIMED entdecken
Crossref

Low Latency Geo-distributed Data Analytics

Qifan Pu, Ganesh Ananthanarayanan, Peter Bodik, Srikanth Kandula, Aditya Akella, Paramvir Bahl, Ion Stoica

ACM SIGCOMM Computer Communication Review · 22.09.2015 · 45 (4) · 421-434

DOI: 10.1145/2829988.2787505 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM SIGCOMM Computer Communication Review, online erschienen am 17.08.2015. Verfasst von Qifan Pu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 162-mal zitiert (Crossref) und nennt 62 Literaturangaben. Gefördert von: NSF.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Low latency analytics on geographically distributed datasets (across datacenters, edge clusters) is an upcoming and increasingly important challenge. The dominant approach of aggregating all the data to a single datacenter significantly inflates the timeliness of analytics. At the same time, running queries over geo-distributed inputs using the current intra-DC analytics frameworks also leads to high query response times because these frameworks cannot cope with the relatively low and variable capacity of WAN links. We present Iridium, a system for low latency geo-distributed analytics. Iridium achieves low query response times by optimizing placement of both data and tasks of the queries. The joint data and task placement optimization, however, is intractable. Therefore, Iridium uses an online heuristic to redistribute datasets among the sites prior to queries' arrivals, and places the tasks to reduce network bottlenecks during the query's execution. Finally, it also contains a knob to budget WAN usage. Evaluation across eight worldwide EC2 regions using production queries show that Iridium speeds up queries by 3× -- 19× and lowers WAN usage by 15% -- 64% compared to existing baselines.

Förderung

  • NSF

Zitieren

APA

Pu, Q., Ananthanarayanan, G., Bodik, P., Kandula, S., Akella, A., Bahl, P., & Stoica, I. (2015). Low Latency Geo-distributed Data Analytics. ACM SIGCOMM Computer Communication Review, 45(4), 421-434. https://doi.org/10.1145/2829988.2787505

Vancouver

Pu Q, Ananthanarayanan G, Bodik P, Kandula S, Akella A, Bahl P, et al. Low Latency Geo-distributed Data Analytics. ACM SIGCOMM Computer Communication Review. 2015;45(4):421-434. doi:10.1145/2829988.2787505

BibTeX
@article{Pu2015,
  author = {Pu, Qifan and Ananthanarayanan, Ganesh and Bodik, Peter and Kandula, Srikanth and Akella, Aditya and Bahl, Paramvir and Stoica, Ion},
  title = {Low Latency Geo-distributed Data Analytics},
  journal = {ACM SIGCOMM Computer Communication Review},
  year = {2015},
  volume = {45},
  number = {4},
  pages = {421--434},
  doi = {10.1145/2829988.2787505}
}
Kostenlos starten →