Machine learning (one)--classification:advanced optimization

• Other methods that are faster than gradient descent and are widely used in some cases to find the minimum value of cost function

Conjugate gradient, Bfgs,l-bfgs is very complex, can be applied without understanding the detailed principle.

It can be applied directly using octave and MATLAB function libraries, and the build-in libarary in these softwares are well implemented by these algorithms.

When you want to use other languages to implement these algorithms, such as C,c++,java, and so on, we should try several implementations, because the different implementation methods in the performance of a large difference.

Machine learning (one)--classification:advanced optimization