The unreasonable effectiveness of decision trees for tabular data
Gradient-boosted decision trees dominated the 2010s on tabular data, and are still extremely prevalent today. We examine the reasons behind their success, and continued relevance in the 2020s.