EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

Integration of Natural Language Processing for Intent Classification on ISP Customer Service Telegram Chatbots

Nugraha Nugraha, Gina Purnama Insany, Akmal Nuur Fauzan

bit-Tech · 10.08.2026 · 9 (1) · 1186-1197

DOI: 10.32877/bt.v9i1.4074 ↗

Kurz gefasst

Fachartikel in der Zeitschrift bit-Tech, online erschienen am 10.08.2026. Verfasst von Nugraha Nugraha und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Internet service providers receive customer complaints through instant-messaging platforms, yet manual handling can delay responses and create message backlogs. This study develops and evaluates a Telegram chatbot for classifying Indonesian ISP complaints submitted as text or voice notes. Its primary contribution is a lightweight multimodal architecture integrating Telegram, Whisper-based transcription, TF-IDF, and Logistic Regression for six operational intents; analysis of speech-recognition error propagation is treated as a secondary exploratory contribution. The corpus contained 1,500 messages: 500 historical complaints collected from January to April 2026 and 1,000 simulated messages created to balance the classes. The combined corpus was partitioned using an 80:20 split, yielding 1,200 training messages and 300 test messages. Because simulated instances were not explicitly restricted to training, the results represent internal test performance rather than conclusive evidence of real-world generalization. Quantitative evaluation on the 300-message test set produced 91.00% accuracy and a macro-average F1-score of approximately 0.92. Router Error showed the lowest precision because of overlap with semantically related complaint categories. Functional verification comprised eight predefined black-box scenarios, all of which passed, whereas the voice pathway was assessed only through an illustrative case in which transcription errors removed discriminative terms and reduced classification confidence. The findings support the technical feasibility of lightweight multimodal complaint triage while emphasizing the need for real-only external testing, systematic audio evaluation using Word Error Rate and downstream intent metrics, confidence-based escalation, and operational validation before large-scale deployment.

Zitieren

APA

Nugraha, N., Insany, G. P., & Fauzan, A. N. (2026). Integration of Natural Language Processing for Intent Classification on ISP Customer Service Telegram Chatbots. bit-Tech, 9(1), 1186-1197. https://doi.org/10.32877/bt.v9i1.4074

Vancouver

Nugraha N, Insany GP, Fauzan AN. Integration of Natural Language Processing for Intent Classification on ISP Customer Service Telegram Chatbots. bit-Tech. 2026;9(1):1186-1197. doi:10.32877/bt.v9i1.4074

BibTeX
@article{Nugraha2026,
  author = {Nugraha, Nugraha and Insany, Gina Purnama and Fauzan, Akmal Nuur},
  title = {Integration of Natural Language Processing for Intent Classification on ISP Customer Service Telegram Chatbots},
  journal = {bit-Tech},
  year = {2026},
  volume = {9},
  number = {1},
  pages = {1186--1197},
  doi = {10.32877/bt.v9i1.4074}
}
Kostenlos starten →