EUVIMEDEUVIMED entdecken
Crossref

From Logs to Causal Inference: Diagnosing Large Systems

Markos Markakis, Brit Youngmann, Trinity Gao, Ziyu Zhang, Rana Shahout, Peter Baile Chen, Chunwei Liu, Ibrahim Sabek, Michael Cafarella

Proceedings of the VLDB Endowment · 2024-10 · 18 (2) · 158-172

DOI: 10.14778/3705829.3705836 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 28.02.2025. Verfasst von Markos Markakis und 8 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 123 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Causal inference can quantify cause-effect relationships in domains as varied as medicine, economics and public policy. Production computer systems exhibit a similar level of complexity and a recurring need to diagnose problems quickly. However, systems are only observed imperfectly, often via long, messy, semi-structured logs. In this work, we want to accelerate large systems debugging by applying causal inference over logs, enabling engineers to diagnose problems and assess interventions in a principled manner. Our framework achieves this through two human-in-the-loop modules: (1) The Candidate Cause Ranker , through which one can determine the causes of a variable without running a full causal discovery algorithm; and (2) the Interactive Causal Graph Refiner , which helps engineers compute an unbiased estimation of their effect of interest without extensive manual causal graph verification. Both modules are powered by the insight that only part of the causal graph of the system is needed to correctly quantify a given effect of interest. We also provide a data preparation pipeline, the Log Converter , which transforms raw, messy, real-world logs into an appropriate tabular input for causal inference, using methods drawn from data transformation, cleaning, and extraction. We evaluate LOGos, a prototype implementation, on both real-world and synthetic logs and find that: (1) The Candidate Cause Ranker achieved an average precision 1.08×-18× higher than the baselines, in interactive time; (2) The Interactive Causal Graph Refiner required a number of causal judgments 1.61 × - 16.83× lower than the baselines; and (3) The latency of Log Converter scaled linearly with three measures of the complexity of a log: length, distinct templates, and fraction of tokens that are variables.

Zitieren

APA

Markakis, M., Youngmann, B., Gao, T., Zhang, Z., Shahout, R., Chen, P. B., Liu, C., Sabek, I., & Cafarella, M. (2024). From Logs to Causal Inference: Diagnosing Large Systems. Proceedings of the VLDB Endowment, 18(2), 158-172. https://doi.org/10.14778/3705829.3705836

Vancouver

Markakis M, Youngmann B, Gao T, Zhang Z, Shahout R, Chen PB, et al. From Logs to Causal Inference: Diagnosing Large Systems. Proceedings of the VLDB Endowment. 2024;18(2):158-172. doi:10.14778/3705829.3705836

BibTeX
@article{Markakis2024,
  author = {Markakis, Markos and Youngmann, Brit and Gao, Trinity and Zhang, Ziyu and Shahout, Rana and Chen, Peter Baile and Liu, Chunwei and Sabek, Ibrahim and Cafarella, Michael},
  title = {From Logs to Causal Inference: Diagnosing Large Systems},
  journal = {Proceedings of the VLDB Endowment},
  year = {2024},
  volume = {18},
  number = {2},
  pages = {158--172},
  doi = {10.14778/3705829.3705836}
}
Kostenlos starten →