Collaborative Knowledge Distillation and Reinforcement Learning for Automated Ticket Triage in Large-Scale Production Systems
ACM Transactions on Software Engineering and Methodology · 30.11.2026 · 35 (11) · 1-27
DOI: 10.1145/3820774 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 04.11.2026. Verfasst von Ruowei Fu und 9 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities, Tianjin Key Research and Development Program.
Abstract (Originalsprache)
In large-scale enterprise environments, growing system complexity makes failures inevitable, threatening business continuity and customer satisfaction. To maintain system stability, efficient ticket triage is crucial for timely incident resolution. However, it remains a knowledge-intensive task requiring substantial domain expertise and detailed analysis, revealing the limitations of traditional rule-based and text-based methods. Recent advances in large language models (LLMs) offer new possibilities for automating triage through their remarkable reasoning and language capabilities. Yet, in industrial settings, LLMs often struggle to leverage domain-knowledge essential for accurate triage. We present CoTriage , a practical and scalable end-to-end automated ticket triage system, designed and deployed for real-world industrial scenarios. CoTriage leverages novel collaboration between large and small models: a small set of labeled tickets is used to distill high-quality LLM reasoning into a lightweight model, which is further optimized through a self-reinforcement mechanism. The refined triager then acts as a reward model to fine-tune a ticket summarizer using reinforcement learning. Comprehensive experiments conducted in the production environment of ByteDance, a leading global online video service provider, demonstrate the effectiveness of CoTriage, reducing the average triage time to 15.0 seconds and significantly enhancing operational efficiency and accelerating incident resolution in practice.
Förderung
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
- Tianjin Key Research and Development Program
Zitieren
APA
Fu, R., Zhang, Y., Zhang, S., Wu, X., Gu, W., Wang, F., Che, Z., Liu, X., Sun, Y., & Zhang, Y. (2026). Collaborative Knowledge Distillation and Reinforcement Learning for Automated Ticket Triage in Large-Scale Production Systems. ACM Transactions on Software Engineering and Methodology, 35(11), 1-27. https://doi.org/10.1145/3820774
Vancouver
Fu R, Zhang Y, Zhang S, Wu X, Gu W, Wang F, et al. Collaborative Knowledge Distillation and Reinforcement Learning for Automated Ticket Triage in Large-Scale Production Systems. ACM Transactions on Software Engineering and Methodology. 2026;35(11):1-27. doi:10.1145/3820774
BibTeX
@article{Fu2026,
author = {Fu, Ruowei and Zhang, Yang and Zhang, Shenglin and Wu, Xin and Gu, Wenwei and Wang, Feng and Che, Zeyu and Liu, Xiaozhou and Sun, Yongqian and Zhang, Yu},
title = {Collaborative Knowledge Distillation and Reinforcement Learning for Automated Ticket Triage in Large-Scale Production Systems},
journal = {ACM Transactions on Software Engineering and Methodology},
year = {2026},
volume = {35},
number = {11},
pages = {1--27},
doi = {10.1145/3820774}
}
EUVIMED