The causes of bank customer churn based on XGBoost and LightGBMmodels: the evidence from the Kaggle dataset
DOI:
https://doi.org/10.61173/ggw4ga77Keywords:
customer churn, predictors of churn, churn prediction models, machine learningAbstract
As the digital economy continues to grow, the expansion of Internet finance introduces new challenges for the conventional banking industry. Banks must deal with multiple pressures, such as digital transformation, declining customer loyalty, and fintech competition. Analyzing the potential factors of bank customer churn from multiple perspectives and constructing models for predicting churn can help bank managers understand the causes of churn, identify problems, detect potential churn customers promptly, and develop efficient retention strategies based on customer characteristics and preferences. In this paper, we used a combination of visualization, data mining, and machine learning methods to analyze the factors used to predict bank customer churn from multiple perspectives, such as feature selection (Random Forest Feature Importance Ranking), feature extraction (PCA), visualization, etc. We also constructed two churn prediction models based on the gradient boosting tree algorithms, XGBoost and LightGBM, compared the evaluation measures before and after feature selection and before and after tuning parameters, and interpreted the model through SHAP methods. After the paper, the following conclusions were drawn: (1) Total Trans Amt, Total Trans Ct, and Total Revolving Bal are pivotal in analyzing and predicting customer churn; (2) the SHAP Summary Plot can react to the visual analysis of predictors of customer churn to a certain extent; (3) the effect of feature selection on the assessment of the results is sometimes insignificant; (4) tuning parameter settings can enhance model performance to a certain extent, but the optimal parameters may vary based on the preprocessing method employed. These conclusions will assist banks in comprehending customer churn factors more deeply, constructing a higher performance churn prediction model, and conducting a comprehensive result synthesis analysis.
References
[1] Cuadros-Solas, P. J., Cubillas, E., & Salvador, C. 2023. Does alternative digital lending affect bank performance? Crosscountry and bank-level evidence. International Review of Financial Analysis, 90
[2] Murinde, V., Rizopoulos, E., & Zachariadis, M. 2022. The impact of the FinTech revolution on the future of banking: Opportunities and risks. International Review of Financial Analysis, 81.
[3] Rühl, A., & Zurdo, R. P. 2020. Does technology contribute to financial democratization? The collaborative economy and fintechs as catalysts for change. Revesco-Revista De Estudios Cooperativos(133).
[4] Langley, P., & Leyshon, A. 2021. The Platform Political Economy of FinTech: Reintermediation, Consolidation and Capitalisation. New Political Economy, 26(3): 376-388.
[5] Gao, C. Y., & Wang, Q. 2023. Does digital finance aggravate bank competition? Evidence from China. Research in International Business and Finance, 66.
[6] Kowalewski, O., & Pisany, P. 2022. Banks‘ consumer lending reaction to fintech and big tech credit emergence in the context of soft versus hard credit information processing. International Review of Financial Analysis, 81.
[7] Liem, N. T., Son, T. H., Tin, H. H., & Canh, N. T. 2022. Fintech credit, credit information sharing, and bank stability: some international evidence. Cogent Business & Management, 9(1).
[8] Varma, P., Nijjer, S., Sood, K., Grima, S., & Rupeika-Apoga, R. 2022. Thematic Analysis of Financial Technology (Fintech) Influence on the Banking Industry. Risks, 10(10).
[9] Elsaid, H. M. 2021. A review of literature directions regarding the impact of fintech firms on the banking industry. Qualitative Research in Financial Markets.
[10] Wang, Y. H., Shih, K. H., & Huang, Y. C. 2012. Measurement of Switching Cost on the Customer Retention in the Banking Industry. Journal of Testing and Evaluation, 40(6): 923-930.
[11] Lemos, R. A. D., Silva, T. C., & Tabak, B. M. 2022. Propension to customer churn in a financial institution: a machine learning approach. Neural Computing & Applications, 34(14): 11751-11768.
[12] <2018 customergauge nps & cx benchmarks report.pdf>.
[13] Domingos, E., Ojeme, B., & Daramola, O. 2021. Experimental Analysis of Hyperparameters for Deep Learning- Based Churn Prediction in the Banking Sector. Computation, 9(3).
[14] Park, W., & Ahn, H. 2022. Not All Churn Customers Are the Same: Investigating the Effect of Customer Churn Heterogeneity on Customer Value in the Financial Sector. Sustainability, 14(19). Dean&Francis
[15] De, S. M., & Prabu, P. 2022. Predicting customer churn: A systematic literature review. Journal of Discrete Mathematical Sciences & Cryptography, 25(7): 1965-1985.
[16] Rasool, A., Shah, F. A., & Tanveer, M. 2021. Relational dynamics between customer engagement, brand experience, and customer loyalty: An empirical investigation (vol 20, pg 273, 2021). Journal of Internet Commerce, 20(4): 508-508.
[17] Hübner, F., Herberger, T. A., & Charifzadeh, M. 2023. Determinants of customer recovery in retail banking-lessons from a German banking case study. Journal of Financial Services Marketing.
[18] Geiler, L., Affeldt, S., & Nadif, M. 2022. A survey on machine learning methods for churn prediction. International Journal of Data Science and Analytics, 14(3): 217-242.
[19] Khodadadi, A., Hosseini, S., Pajouheshgar, E., Mansouri, F., & Rabiee, H. R. 2022. ChOracle: A Unified Statistical Framework for Churn Prediction. Ieee Transactions on Knowledge and Data Engineering, 34(4): 1656-1666.
[20] Oskarsdóttir, M., Van Calster, T., Baesensa, B., Lemahieu, W., & Vanthienen, J. 2018. Time series for early churn detection: Using similarity based classification for dynamic networks. Expert Systems with Applications, 106: 55-65.
[21] Salas-Eljatib, C., Fuentes-Ramirez, A., Gregoire, T. G., Altamirano, A., & Yaitul, V. 2018. A study on the effects of unbalanced data when fitting logistic regression models in ecology. Ecological Indicators, 85: 502-508.
[22] Branco, P., Torgo, L., & Ribeiro, R. P. 2016. A Survey of Predictive Modeling on Im balanced Domains. Acm Computing Surveys, 49(2).
[23] Wang, S. J., Liu, W., Wu, J., Cao, L. B., Meng, Q. X., Kennedy, P. J., & Ieee. 2016. Training Deep Neural Networks on Imbalanced Data Sets. Paper presented at the International Joint Conference on Neural Networks (IJCNN), Vancouver, CANADA.
[24] Zhou, F. N., Yang, S., Fujita, H., Chen, D. M., & Wen, C. L. 2020. Deep learning fault diagnosis method based on global optimization GAN for unbalanced data. Knowledge-Based Systems, 187.
[25] Yang, C., Shi, X. L., Luo, J., Han, J. W., & Acm. 2018. I Know You‘ll Be Back: Interpretable New User Clustering and Churn Prediction on a Mobile Social Application. Paper presented at the 24th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), London, ENGLAND.
[26] Zhao, Z., Peng, H., Lan, C. W., Zheng, Y., Fang, L., & Li, J. Y. 2018. Imbalance learning for the prediction of N6 SUP>-Methylation sites in mRNAs. Bmc Genomics, 19.
[27] Luo, R. S., Dian, S. Y., Wang, C., Cheng, P., Tang, Z. D., Yu, Y. M., Wang, S. X., & Iop. 2018. Bagging of Xgboost Classifiers with Random Under-sampling and Tomek Link for Noisy Label-imbalanced Data. Paper presented at the 3rd International Conference on Automation, Control and Robotics Engineering (CACRE), Chengdu, PEOPLES R CHINA.
[28] Khoh, W. H., Pang, Y. H., Ooi, S. Y., Wang, L. Y. K., & Poh, Q. W. 2023. Predictive Churn Modeling for Sustainable Business in the Telecommunication Industry: Optimized Weighted Ensemble Machine Learning. Sustainability, 15(11).
[29] Haridasan, V., Muthukumaran, K., & Hariharanath, K. 2023. Arithmetic Optimization with Deep Learning Enabled Churn Prediction Model for Telecommunication Industries. Intelligent Automation and Soft Computing, 35(3): 3531-3544.
[30] Thakkar, H. K., Desai, A., Ghosh, S., Singh, P., & Sharma, G. 2022. Clairvoyant: AdaBoost with Cost-Enabled Cost-Sensitive Classifier for Customer Churn Prediction. Computational Intelligence and Neuroscience, 2022.
[31] Arshad, S., Iqbal, K., Naz, S., Yasmin, S., & Rehman, Z. 2022. A Hybrid System for Customer Churn Prediction and Retention Analysis via Supervised Learning. Cmc-Computers Materials & Continua, 72(3): 4283-4301.
[32] Anjana, K. V., & Urolagin, S. 2021. Churn Prediction in Telecom Industry Using Machine Learning Algorithms with K-Best and Principal Component Analysis, Singapore.
[33] Tékouabou, S. C. K., Gherghina, S. C., Toulni, H., Mata, P. N., & Martins, J. M. 2022. Towards Explainable Machine Learning for Bank Churn Prediction Using Data Balancing and Ensemble-Based Methods. Mathematics, 10(14).
[34] Liu, Z. H., Lai, Z. H., Ou, W. H., Zhang, K. B., & Zheng, R. J. 2020. Structured optimal graph based sparse feature extraction for semi-supervised learning. Signal Processing, 170.
[35] Mirabdolbaghi, S. M. S., & Amiri, B. 2022. Model Optimization Analysis of Customer Churn Prediction Using Machine Learning Algorithms with Focus on Feature Reductions. Discrete Dynamics in Nature and Society, 2022.
[36] Lappeman, J., Franco, M., Warner, V., & Sierra-Rubia, L. 2022. What social media sentiment tells us about why customers churn. Journal of Consumer Marketing, 39(5): 385-403.
[37] Boo, Y., & Choi, Y. 2022. Comparison of mortality prediction models for road traffic accidents: an ensemble technique for imbalanced data. Bmc Public Health, 22(1).
[38] Wu, S. L., Yau, W. C., Ong, T. S., & Chong, S. C. 2021. Integrated Churn Prediction and Customer Segmentation Framework for Telco Business. Ieee Access, 9: 62118-62136.
[39] Sana, J. K., Abedin, M. Z., Rahman, M. S., & Rahman, M. S. 2022. A novel customer churn prediction model for the telecommunication industry using data transformation methods and feature selection. Plos One, 17(12).
[40] Xiao, J., Xiao, Y., Huang, A. Q., Liu, D. H., & Wang, S. Y. 2015. Feature-selection-based dynamic transfer ensemble model for customer churn prediction. Knowledge and Information Systems, 43(1): 29-51.
[41] Li, J. F., Bai, X., Xu, Q., & Yang, D. X. 2023. Identification of Customer Churn Considering Difficult Case Mining. Systems, 11(7).
Downloads
Published
Issue
Section
License
Copyright (c) 2023 by the authors.
This work is licensed under a Creative Commons Attribution 4.0 International License.
