Where to Go for Big Data Cloud Computing Training?

As for the big data development technology, we still need to analyze it from the Internet.
I believe that Snowden ’s things have not been completely forgotten: at that time, a former US Central Intelligence Agency (CIA) employee named Edward Snowden appeared in Hong Kong and disclosed some confidential documents to the media, resulting in the inclusion of "prisms" Many secret intelligence surveillance projects of the US government, including the project, have been exposed to the public eye. It is understood that the "Prism" project involves US intelligence agencies monitoring 10 types of major information in many countries including China on the Internet, including email messages, instant messages, videos, photos, stored data, social network details . For a time, public opinion gave much condemnation about the existence of the "Prism" project. But many people neglected a key issue. It was the existence of "big data" that enabled the implementation of the "Prism" project.

In fact, the original intention of the existence of big data is to achieve accurate analysis by obtaining a large amount of user behavior data and to serve users more efficiently. But big data is also a double-edged sword: on the one hand, the objectivity of big data allows many decision makers to make the right decisions more rationally. For example, Tencent ’s computer housekeeper uses “big data” as the concept of network security services. The “Panorama Network Security Defense System” launched by the Tencent Computer Housekeeper ’s “Cloud Big Data” and 700 million users via Tencent ’s instant messaging software QQ And search engines such as SOSO, WeChat, and Weibo to capture the whereabouts of phishing websites.
On the other hand, while big data provides more accurate and objective data analysis for all walks of life, the collected user data has become a valuable "whole", whether it is user privacy or the use of the data itself, has become The controversial "gray zone". According to the data, a stock speculator on Wall Street used a computer program to analyze the messages of the 340 million Weibo accounts around the world at that time to judge public sentiment. If most people show excitement, then buy stocks, if everyone's anxiety rises, then sell. This method helped the stock speculator obtain a quarterly rate of return of 7%, but for many Weibo users who provided data, they became the objects of personal use but did not benefit. How to effectively use the advantages of big data to avoid the negative effects of big data has once become a focus topic for experts and the public.

Big data engineers have multiple explanations, one is to use big data, that is, the data scientist, and the other is to develop a big data platform, that is, a platform development engineer, such as an engineer who writes a component of hadoop or hive. If you are taking this route, the skills required include: sql, java, mapreduce job writing, some relatively simple script writing, plus some data analysis fields, such as statistics, machine learning and so on. If you follow the path of low-level development, the skills required are basically hard development skills. Many of them need to understand the advanced features of the language, software development models, abstractions, how to use the operating system, compile, test. This development learning curve is a bit steeper.