0. How does one learn hadoop? How to get started with hadoop

What is the basis for learning hadoop? As the main engine in the big data industry, hadoop is like a key in the big data world. To enter the data world, you must first get this key to open the door.

What is the basis for learning hadoop? Hadoop is a distributed computing architecture, and more importantly, it is a scalable ecosystem, such as IBM, EMC, Amazon, Microsoft, oracle and other large IT companies already have hadoop-based commercial big data products. Although there is still a more advanced distributed architecture (such as dremel and Dataflow) than hadoop, it is also based on hadoop improvements and upgrades. Therefore, hadoop is also the foundation of big data, the solid foundation determines how far the future can go !!

In today's society, big data is still a fire, and hadoop, as the foundation of big data, will naturally receive much attention. What are the use cases of hadoop? Let me introduce it to you.

1. Large Data Storage: Distributed Storage

2. log processing: hadoop is good at this

3. Massive computing: Parallel Computing

4. ETL: extract data to Oracle, MySQL, DB2, mongdb, and mainstream databases.

5. Using hbase for data analysis: Using extensibility to cope with a large number of write operations-Facebook built a real-time hbase-based Data Analysis System

6. Machine Learning: for example, Apache mahout Project

7. Search Engine: hadoop + Lucene implementation

8. Data Mining: currently popular ad recommendations, 9. User segmentation feature modeling

10. Personalized ad recommendations,

11. Recommended smart instruments

TIPS: Let me introduce some things about hadoop learning. I hope it will be helpful for beginners to learn hadoop.

What does hadoop learn?

We mainly learn the core components of hadoop: HDFS, mapreduce, and yarn. They are the core of hadoop. On the basis of these tools, we can also selectively learn the log collection tools flume, data warehouse hive, distributed database hbase, and data import and export tool sqoop in the hadoop ecosystem.

What is the basis for learning hadoop?

Hadoop requires the basic knowledge of javase and has no requirements for javaee (JSP/servlet/three frameworks. Be familiar with Linux. In general, this preparation is enough. Some people also say that it is enough to have knowledge of javase.

After learning hadoop, Will javaee work be affected?

Strictly speaking, hadoop and javaee are two different development ideas. hadoop tends to process data at the underlying layer. javaee is responsible for system development. The two are successive, without overlap and complement each other. Big Data hadoop Learning Group 142973723

Is hadoop highly demanding on algorithms and data structures?

Generally, massive data processing uses a custom storage structure to implement your own algorithms. This is a common processing concept in the industry. This is very demanding for common programmers. The advantage of hadoop is that it is encapsulated and the written algorithms are business-oriented and do not need to be created. Therefore, you can rest assured. However, if a company does not use hadoop to manage big data, the requirements for algorithms and data structures are high.

0. How does one learn hadoop? How to get started with hadoop