EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

LARGE LANGUAGE MODELS FOR ENTERPRISE WORKFLOW AUTOMATION IN FINANCIAL OPERATIONS

BingJie Zi

Innovation and Technology Studies · 05.01.2024 · 1 (1) · 24-29

DOI: 10.61784/its3023 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Innovation and Technology Studies, online erschienen am 05.01.2024. Verfasst von BingJie Zi. Die Arbeit wurde bisher 6-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Intent classification is a key component of customer-query routing in financial workflow automation. While large language models (LLMs) have attracted substantial interest, their cost, latency, and on-premises deployment constraints motivate efficient routing systems that can operate reliably on standard CPU-based infrastructure. This study examines whether lightweight CPU-based classifiers can serve as a cost-effective routing layer in LLM-era enterprise automation systems. We present a reproducible benchmark on the public Banking77 dataset (13,083 queries, 77 fine-grained intents) comparing five CPU-only pipelines built from term-frequency–inverse-document-frequency (TF-IDF) features and linear classifiers. Our proposed pipeline, LR-Fusion, combines word- and character-level TF-IDF representations within a single logistic regression classifier and attains 0.9123 accuracy and 0.9124 macro-F1 (95% CI [0.9017, 0.9219]) with a median single-query latency of 7.0 ms on a single CPU core. Paired-bootstrap tests indicate that the improvement of LR-Fusion over each baseline is consistent across resamples at the 0.05 significance level. Error analysis identifies semantically overlapping intent pairs (e.g., verify_my_identity vs. why_verify_identity) as the primary residual failure mode, suggesting a potential role for selective LLM-based reranking in future hybrid systems. The implementation package is provided to support reproducibility of the reported experiments.

Zitieren

APA

Zi, B. (2024). LARGE LANGUAGE MODELS FOR ENTERPRISE WORKFLOW AUTOMATION IN FINANCIAL OPERATIONS. Innovation and Technology Studies, 1(1), 24-29. https://doi.org/10.61784/its3023

Vancouver

Zi B. LARGE LANGUAGE MODELS FOR ENTERPRISE WORKFLOW AUTOMATION IN FINANCIAL OPERATIONS. Innovation and Technology Studies. 2024;1(1):24-29. doi:10.61784/its3023

BibTeX
@article{Zi2024,
  author = {Zi, BingJie},
  title = {LARGE LANGUAGE MODELS FOR ENTERPRISE WORKFLOW AUTOMATION IN FINANCIAL OPERATIONS},
  journal = {Innovation and Technology Studies},
  year = {2024},
  volume = {1},
  number = {1},
  pages = {24--29},
  doi = {10.61784/its3023}
}
Kostenlos starten →