Regression Tree | Gbdt| Gradient boosting| Gradient boosting Classifier

has not written for a long time, just recently need to do to share so come up to write two, this is about the decision tree, the next is to fill out the pit of SVM.

Reference documents:

1. http://stats.stackexchange.com/questions/5452/r-package-gbm-bernoulli-deviance/209172#209172
2. Http://stats.stackexchange.com/questions/157870/scikit-binomial-deviance-loss-function
3. Http://scikit-learn.org/stable/modules/generated/sklearn.ensemble.GradientBoostingClassifier.html
4. Http://www.ccs.neu.edu/home/vip/teach/MLcourse/4_boosting/slides/gradient_boosting.pdf
5. Http://wenku.baidu.com/link?url=RY7xuKESw-lQ5pKfU_ ip-gdonh4cfd1twnr3w2jwygndu6w4qdpsygntwaibsyttlu2xdpu9uftf0byvf41fmsa_yhwphe4zawafpunmg1w
6. Https://en.wikipedia.org/wiki/Gradient_boosting

Regression Tree | Gbdt| Gradient boosting| Gradient boosting Classifier