Gradient Boost／Boosting - Multiple Additive Regression／Decision Trees - Stochastic Gradient Boosting Machines

Gradient Boosting - Multiple Additive Regression Trees - Stochastic Gradient Boosting - Gradient Boosting Machines

• is a boosting technique that can be used for either (continuous or categorical) regression models
• produces a prediction model in the form of an ensemble of weak prediction models (typically decision tree models)

Implementation

• eXtreme Gradient Boost (XGBoost)

Resource

• https://machinelearningmastery.com/gentle-introduction-gradient-boosting-algorithm-machine-learning/
• StatQuest - Gradient Boost - Regression
• StatQuest - Gradient Boost - Regression Mathematics
• StatQuest - Gradient Boost - Classification
• StatQuest - Gradient Boost - Classification Details