Summary of resources for gradient descent method and its optimization algorithm

1. Three forms of gradient descent method Batch Gradient desecnt, Stochastic Gradient desecnt, Min-batch Gradient desecnt and its summary

See: Poll's notes are written very clearly and can be understood at a glance

2. Optimization algorithm for gradient descent

See: Machine Heart depth interpretation of the most popular optimization algorithms: Gradient descent

See in English: "An overview of gradient descent optimization Algorithms" written by Dr. Sebastian Ruder

3. The two forms of understanding in sgd+momentum are actually one thing

See: Two forms of understanding in Sgd+momentum

Summary of resources for gradient descent method and its optimization algorithm