Language Model-Enhanced Feature Engineering Framework for Customer Churn Analysis
Journal of Eastern Europe Research in Business and Economics · 10.04.2026
DOI: 10.5171/2025.4526625 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Eastern Europe Research in Business and Economics, online erschienen am 10.04.2026. Verfasst von Maryam SHAHABIKARGAR und 5 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).
Abstract (Originalsprache)
Customer churn remains a major concern across industries, especially with the rising importance of customer retention over acquisition. While prior research has focused heavily on structured data, the potential of customer-generated textual data, such as chat logs and feedback, remains underutilized. This study addresses this gap by introducing a novel feature engineering framework that leverages Language Models (LMs), to extract meaningful insights from unstructured text data for churn prediction. We propose a multi-stage pipeline that combines domain expertise with LM capabilities to generate interaction features, sentiment labels, emotional tone scores, and topic- based features from customer chat data. Additionally, we introduce a new composite metric, the Normalized-weighted Churn Score, which integrates expert-assigned topic weights with language model outputs. The framework was evaluated using a churn dataset containing structured and unstructured data. Results show that incorporating LM-enhanced features significantly boosts model performance across multiple classifiers. Notably, models using our enriched feature outperformed traditional baselines, achieving an F1-score increase of over 26%. The findings emphasize the critical role of text analytics and hybrid feature engineering in advancing churn pre- diction and offer a scalable approach for integrating domain knowledge with modern NLP techniques.
Zitieren
APA
SHAHABIKARGAR, M., BEHESHTI, A., AFZOON, S., FOO, J., ZHANG, X., & SHABANI, N. (2026). Language Model-Enhanced Feature Engineering Framework for Customer Churn Analysis. Journal of Eastern Europe Research in Business and Economics. https://doi.org/10.5171/2025.4526625
Vancouver
SHAHABIKARGAR M, BEHESHTI A, AFZOON S, FOO J, ZHANG X, SHABANI N. Language Model-Enhanced Feature Engineering Framework for Customer Churn Analysis. Journal of Eastern Europe Research in Business and Economics. 2026. doi:10.5171/2025.4526625
BibTeX
@article{SHAHABIKARGAR2026,
author = {SHAHABIKARGAR, Maryam and BEHESHTI, Amin and AFZOON, Saleh and FOO, Jin and ZHANG, Xuyun and SHABANI, Nasrin},
title = {Language Model-Enhanced Feature Engineering Framework for Customer Churn Analysis},
journal = {Journal of Eastern Europe Research in Business and Economics},
year = {2026},
doi = {10.5171/2025.4526625}
}
EUVIMED