My post discusses the limitations and capabilities of decision trees and more advanced tree-based methods. While much of this may seem critical, decision trees can often be useful and surprisingly effective at approximating complex non-linearities and discarding irrelevant predictors with limited analyst input all while being fairly robust to missing and non-sensical values. I enjoy decision trees mostly for exploratory analysis.