Why Do Tree Based Models Still Outperform Deep Learning on Typical Tabular Data?

While deep learning has enabled tremendous progress on text and image datasets, its superiority on tabular data is not clear. We contribute extensive benchmarks of standard and novel deep learning methods as well as tree-based models such as XGBoost and Random Forests, across a large number of datasets and hyperparameter combinations.

The paper can be found here: https://openreview.net/attachment?id=Fp7__phQszn&name=supplementary_material

NB: The use of Google Notebook experimentation continues.

#nosacapital #machinelearning #xgboost #deeplearning #randomforests #treebasedmodels #AI