advanced machine learning coursera

This is a machine learning course that coursera on fire, and the instructor is Andrew Ng. In the process of looking at the neural network, I did find that I had a problem with a weak foundation and some basic concepts, so I wanted to take this course to find a leak. The current plan is to see the end of the neural network, the back is not necessarily seen.Of cour

regression. The root number can also be selected based on the actual situation.Regular Equation In addition to Iteration Methods, linear algebra can be used to directly calculate $ \ matrix {\ Theta} $. For example, four groups of property price forecasts: Least Squares $ \ Theta = (\ matrix {x} ^ t \ matrix {x}) ^ {-1} \ matrix {x} ^ t \ matrix {y} $Gradient Descent, advantages and disadvantages of regular equations Gradient Descent: Desired stride $ \ Alpha $; Multiple iterations are requ

m>=10n and uses multiple Gaussian distributions.In practical applications, the original model is more commonly used, the average person will manually add additional variables.If the σ matrix is found to be irreversible in practical applications, there are 2 possible reasons for this:1. The condition of M greater than N is not satisfied.2. There are redundant variables (at least 2 variables are exactly the same, XI=XJ,XK=XI+XJ). is actually caused by the linear correlation of the characteristic

different lambda, the calculated training error and cross-validation error are as follows:Lambda Train error Validation error 0.000000 0.173616 22.066602 0.001000 0.156653 18.597638 0.003000 0.190298 19.981503 0.010000 0.221975 16.969087 0.030000 0.281852 12.829003 0.100000 0.459318 7.587013 0.300000 0.921760 1.000000 2.076188 4.260625 3.000000 4.901351 3.822907 10.000000 16.092213 9.945508The graphic is represented as follows:As

Overview Cost Function and BackPropagation Cost Function BackPropagation algorithm BackPropagation Intuition Back propagation in practice Implementation Note:unrolling Parameters Gradient Check Random initialization Put It together Application of Neural Networks Autonomous Driving Review Log 2/10/2017:all the videos; Puzzled about Backprogation 2/11/2017:reviewed backpropaga

, i.e., all of our training examples lie perfectly on some straigh T line. If J (θ0,θ1) =0, that means the line defined by the equation "y=θ0+θ1x" perfectly fits all of our data. For the To is true, we must has Y (i) =0 for every value of i=1,2,..., m. So long as any of our training examples lie on a straight line, we'll be able to findθ0 andθ1 so, J (θ0,θ1) =0. It is not a necessary that Y (i) =0 for all of our examples. We can perfectly predict the value o

-Learning RateIn the gradient descent algorithm, the number of iterations required for the algorithm convergence varies according to the model. Since we cannot predict in advance, we can plot the corresponding graphs of iteration times and cost functions to observe when the algorithm tends to converge.Of course, there are some ways to automatically detect convergence, for example, we compare the change value of a cost function with a predetermined thr

-Gradient descentThe gradient descent algorithm is an algorithm for calculating the minimum value of a function, and here we will use the gradient descent algorithm to find the minimum value of the cost function.The idea of a gradient descent is that we randomly select a combination of parameters and calculate the cost function at the beginning, and then we look for the next combination of parameters that will reduce the value of the cost function.We continue this process until a local minimum (

, the weight of the high-weighted data is increased by 1000 times times the probability, which is equivalent to replication. However, if you are traversing the entire test set (not sampling) to calculate the error, there is no need to modify the call probability, just add the weights of the corresponding errors and divide by N. So far, we have expanded the VC Bound, which is also set up on the issue of multiple classifications!SummaryFor more discussion and exchange on

use of MATLAB. *.4.gradientdescent.mfunction [Theta, j_history] =gradientdescent (X, y, theta, Alpha, num_iters)%gradientdescent performs gradient descent to learn theta% theta = gradientdescent (X, y, theta, Alpha, num_iters) up Dates theta by% taking num_iters gradient steps with learning rate alpha% Initialize Some useful valuesm= Length (y);%Number of training examplesj_history= Zeros (Num_iters,1); forITER =1: Num_iters% ======================