Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Machine Learning or Econometrics for Credit Scoring: Let's Get the Best of Both Worlds

Abstract : In the context of credit scoring, ensemble methods based on decision trees, such as the random forest method, provide better classification performance than standard logistic regression models. However, logistic regression remains the benchmark in the credit risk industry mainly because the lack of interpretability of ensemble methods is incompatible with the requirements of financial regulators. In this paper, we pro- pose to obtain the best of both worlds by introducing a high-performance and interpretable credit scoring method called penalised logistic tree regression (PLTR), which uses information from decision trees to improve the performance of logistic regression. Formally, rules extracted from various short-depth decision trees built with pairs of predictive variables are used as predictors in a penalised logistic regression model. PLTR allows us to capture non-linear effects that can arise in credit scoring data while preserving the intrinsic interpretability of the logistic regression model. Monte Carlo simulations and empirical applications using four real credit default datasets show that PLTR predicts credit risk significantly more accurately than logistic regression and compares competitively to the random forest method. JEL Classification: G10 C25, C53
Document type :
Preprints, Working Papers, ...
Complete list of metadatas
Contributor : Sullivan Hué <>
Submitted on : Friday, January 15, 2021 - 8:48:27 AM
Last modification on : Tuesday, January 19, 2021 - 3:28:14 AM


Files produced by the author(s)


  • HAL Id : hal-02507499, version 3



Elena Dumitrescu, Sullivan Hué, Christophe Hurlin, Sessi Tokpavi. Machine Learning or Econometrics for Credit Scoring: Let's Get the Best of Both Worlds. 2021. ⟨hal-02507499v3⟩



Record views


Files downloads