xgboost machine learning

In machine learning, often need to calculate the distance between each sample, used for classification, according to distance, different samples grouped into a class; But in the current machine learning algorithm, the distance calculation mode is endless, then this blog is mainly to comb the current

A brief introduction to Learning _note1 against Sample machine Machine learning methods, such as SVM, neural network, etc., although in the problem such as image classification has been outperform the ability of human beings to deal with similar problems, but also has its inherent defects, that our training sets are fe

The Ames Razor principle (Occam ' s Razor)One sentence is said, "an explanation of the data should is mad as simple as possible,but no simpler".The meaning of machine learning is that the simplest explanation of the data is the best explanation (the simplest model, fits the data is also and the most plausible).For example, the picture above, the right is not better than the left to explain? That's obviously

Simple examples are used to understand what machine learning is, and examples are used to understand machine learning. 1. What is machine learning? What is machine

Original: http://blog.csdn.net/abcjennifer/article/details/7834256This column (machine learning) includes linear regression with single parameters, linear regression with multiple parameters, Octave Tutorial, Logistic Regression, regularization, neural network, design of the computer learning system, SVM (Support vector machines), clustering, dimensionality reduc

Original handout of Stanford Machine Learning Course This resource is the original handout of the Stanford machine learning course, which is AndrewNg said that a total of 20 PDF files cover some important models, algorithms, and concepts in machine

Machine learning practices in python3.x and python machine learning practices Machine Learning Practice this book is written in the python2.x environment, while many functions and 2 in python3.x. the names or usage methods in x ar

findF1scoreThe algorithm with the largest value. 5. Data for Machine Learning ( Machine Learning data ) In machine learning, many methods can be used to predict the problem. Generally, when the data size increases, the accura

some time ago on the Internet to see the Coursera Open Classroom Big Machine learning Cornerstone Course, more comprehensive and clear machine learning needs of the basic knowledge, theoretical basis to explain. There are several more important concepts and ideas in foundation, first review, and then open the follow-up

to the right in this image. We can generally see the two learning curves, the two curves of blue and red are approaching each other. Therefore, if we extend the curve to the right, it seems that the training set error is likely to increase gradually. The cross-validation set error will continue to decline. Of course, we are most concerned with cross-validation set errors or test set errors. So from this picture, we can basically predict that if we co

1. Decision Tree　　applicable conditions: The data of different class boundary is non-linear, and by continuously dividing the feature space into a matrix to simulate. There is a certain correlation between features. The number of feature values should be similar, because the information gain is biased towards more numerical characteristics.　　Advantages: 1. Intuitive decision-making rules; 2. Nonlinear characteristics can be handled; 3. The interaction between variables is considered.　　Disadvanta

Gradient descent algorithm minimization of cost function J gradient descent Using the whole machine learning minimization first look at the General J () function problem We have J (θ0,θ1) we want to get min J (θ0,θ1) gradient drop for more general functions J (Θ0,θ1,θ2 .....) θn) min J (θ0,θ1,θ2 .....) Θn) How this algorithm works. : Starting from the initial assumption Starting from 0, 0 (or any other valu

http://blog.csdn.net/zhangyingchengqi/article/details/50969064First, machine learning1. Includes nearly 400 datasets of different sizes and types for classification, regression, clustering, and referral system tasks. The data set list is located at:http://archive.ics.uci.edu/ml/2. Kaggle datasets, Kagle data sets for various competitionsHttps://www.kaggle.com/competitions3.Second, computer vision"Machine

a good effect, basically do not know what method of time can first try random forest.SVM (Support vector machine) The core idea of SVM is to find the interface between different categories, so that the two types of samples as far as possible on both sides of the surface, and the separation of the interface as much as possible. The earliest SVM was planar and limited in size. But using the kernel function (kernel functions), we can make the plane proj

Definition of successive descent method: For a given set of equations, use the formula:where k is the number of iterations (k=0,1,2,... ）The method of finding approximate solution by stepwise generation is called iterative method If it exists (recorded as), it is said that this iterative method converges, obviously is the solution of the equations, otherwise called this iterative method divergence. Study the convergence of {}. Introducing Error Vectors:Get:Recursion gets:To inve

July online April machine learning algorithm class notes--no.1 Objective Machine learning is a multidisciplinary interdisciplinary, including probability theory, statistics, convex analysis, feature engineering and so on. Recently followed the July algorithm to learn the knowledge of

Experimental purposes Recently intend to systematically start learning machine learning, bought a few books, but also find a lot of practicing things, this series is a record of their learning process, from the most basic KNN algorithm began; experiment Introduction Language: Python GitHub Address: LUUUYI/KNNExperiment

Customer Churn "Loss rate" is a business term that describes the customer's departure or stop payment of a product or service rate. This is a key figure in many organizations, as it is usually more expensive to get new customers than to retain the existing costs (in some cases, 5 to 20 times times the cost). Therefore, it is invaluable to understand that it is valuable to maintain customer engagement because it is a reasonable basis for developing retention policies and implementing operational

To share and develop code in the distributed machine learning field, the distributed machine learning community (dmlc) has recently been officially released. As an open-source project, dmlc-related code is directly hosted on GitHub and maintained using the apache2.0 protocol. Chen Tianxin (network name), the initiator

A probe into machine learning1. What is machine learningLearning refers to the skill that a person refines in the course of observing things, rather than learning, machine learning refers to the ability of a computer to gain some experience (i.e. a mathematical model) in a p