Gradient Boosting

Compared to Adaboost

• Gradient Boost also have multiple classifier but this type the depth can be more than 1, in other words they are not Stump, they can be tree (but still limited depth - usually 8-32)
• Gradient Boost also scales the classifier but unlike Adaboost it scales all the tree to same value

There are 2 types of gradient boost depending on the task

1. Gradient Boost (Regression)
2. Gradient Boost (Classification)