Machine learning on Spark

Machine learning in Today

Introbuction to Spark

Machine learning on Spark

Large Scale Neural Network

Optimization

Machine learning in Today

Old Time:before Mobile Internet booming era:data scale is small:

-Shallow analysis is enough, no need complex algorithm

-Limited data set could not get precise training model

-Computing Capability is limited by technology

Today:big Data laid a foundation of machine learning:

The widespread of smart phones and the development of IoT provides comprehensive data sources for big data.

Data is the greatest strategic Resources for Internet Companies.

In the past couple of decades, Computing Power was growing exponentially by following the Moore's law

With the rapid development of science and the technology, more Complex Models is extracted, built-up and deploy in Indust Ry

More and more efficient algorithms of machined learning is researched and developed by scientists and domain experts.

Ml:big Data + Computing Power + Complex Model + efficient algorithm

Create User Experiences

Create Commercial Values

Machine learning Phase-1

650) this.width=650; "src=" Https://s5.51cto.com/oss/201710/26/fd22bb7084340218907c9863ffe8807a.png "style=" float: none; "title=" 1-1.png "alt=" Fd22bb7084340218907c9863ffe8807a.png "/>

650) this.width=650; "src=" Https://s5.51cto.com/oss/201710/26/ce2a6dd0f4cc5e3f3198f223c8d23b6e.png "style=" float: none; "title=" 1-2.png "alt=" Ce2a6dd0f4cc5e3f3198f223c8d23b6e.png "/>

Machine learning Phase-1

650) this.width=650; "src=" Https://s1.51cto.com/oss/201710/26/c7cc0c6a0a65f73813dc7ead50b8055f.png "style=" float: none; "title=" 2-1.png "alt=" C7cc0c6a0a65f73813dc7ead50b8055f.png "/>

650) this.width=650; "src=" Https://s1.51cto.com/oss/201710/26/673fa4013ad0e53faac69826203ad5b1.png "style=" float: none; "title=" 2-2.png "alt=" 673fa4013ad0e53faac69826203ad5b1.png "/>

Machine learning Phase-1

650) this.width=650; "src=" Https://s5.51cto.com/oss/201710/26/e6727dcd74293207edb1c9a35315ab06.png "style=" float: none; "title=" 3-1.png "alt=" E6727dcd74293207edb1c9a35315ab06.png "/>

650) this.width=650; "src=" Https://s5.51cto.com/oss/201710/26/f253cb53496f43939fc874e64914c2f4.png "style=" float: none; "title=" 3-2.png "alt=" F253cb53496f43939fc874e64914c2f4.png "/>

Machine learning Phase-1

This article is from the "Operation and maintenance Automation" blog, please make sure to keep this source http://shower.blog.51cto.com/4926872/1976234

Machine learning on Spark