Integrated Learning Algorithms
In statistics and machine learning, the integrated approach uses a variety of learning algorithms to obtain better predictive performance than a single learning algorithm from any composition. the effect of Ensemble methods (combination method) is often the best, of course, the training time that needs to be expended will also lengthen.
The so-called Ensemble methods, is to combine several machine learning algorithms together, or to combine the different parameters of an algorithm.
a Blending and Bagging
- Motivation of Aggregation
- Uniform Blending
- Linear and any Blending
- Bagging (Bootstrap Aggregation
Selection by Validation
Bootstrap sample D? t:re-sample N examples from d uniformly with replacement -can also use arbitrary n ' instead of original n
two AdaBoost
Three decisionTree
Two definitions of the decision tree:
Random Forest
Gradient Boosted decision Tree
Integrated learning Algorithms