Notes on complex systems, reasoning, and the art of pre-training.https://blazstojanovic.github.io/bstojanovic/en-ushttps://blazstojanovic.github.io/bstojanovic/blog/tabular-incumbents/https://blazstojanovic.github.io/bstojanovic/blog/tabular-incumbents/Gradient-boosted decision trees dominated the 2010s on tabular data, and are still extremely prevalent today. We examine the reasons behind their success, and continued relevance in the 2020s.Mon, 04 May 2026 00:00:00 GMTtabulargbdtxgboostlightgbmcatboost