Bank Customer Churn Classification
Decision tree and random forest models predicting which retail bank customers will leave, with the trade-off between catching churners and false alarms made explicit.
The Challenge
A random forest classified bank customers' churn with 86.1% accuracy, while a balanced decision tree caught more churners (recall 0.70) at the cost of more false alarms.
Losing a retail banking customer costs far more than retaining one, but retention offers are expensive to send to everyone. The task was to predict churn from customer attributes and understand the trade-off between catching churners and wasting offers.
Approach
Results
The random forest was more accurate, but missed about half of the churners. The class-weighted tree caught about 70% of them with lower precision, which may suit a cheap retention action better. The right choice depends on the relative cost of a missed churner and an unnecessary offer.
Limitations: hyperparameters were chosen on the test set, and ROC AUC was computed from hard predictions rather than probabilities, which understates it. A clean re-run would tune on a validation split.
How it was tested
- Random forest compared with the best single tree on accuracy, precision, recall and F1 for churners.
- Class weighting tested to give the minority churn class more influence.
- The random forest was more accurate but missed about half of the churners (recall 0.52).
- Hyperparameters were chosen on the test set; a clean re-run would tune on a validation split.
- ROC AUC was computed from hard predictions rather than probabilities, which understates it.