Hadoop Ecosystem technology Introduction to speed of light (shortest path algorithm Mr Implementation, Mr Two ordering, PageRank, social friend referral algorithm)
Share the network disk download--https://pan.baidu.com/s/1i5mzhip password: vv4x
This course will have a better explanation from the basic environment building to the deeper knowledge learning. Help learners quickly get started with the use of the Hadoop ecosystem's big Data processing framework, using the Hadoop ecosystem for modular, project-functional development, primarily including installation of Hadoop, Hive, HBase, Hue, Oozie, Flume and other eco-related software environment, and in the well-established environment to carry out the relevant knowledge points and function of the development. Project/module mainly involves the use of Mr Development related real business functions, including the shortest path calculation, social friend recommendation algorithm implementation, distributed lock implementation, etc., these modules can be used in the actual build environment, can be very simple to integrate the code of these modules directly into the relevant actual production environment code.
First, Hadoop:
First: Hadoop origins, architecture, and ecosystem introduction
Second Lecture: Hadoop installation
Third: Eclipse Environment Building under Windows platform
Part IV: HDFS architecture
Five: HDFS SHELL API Introduction
Introduction to HDFS Java API
Seventh: Hadoop 2.x HDFs new features
Eighth Lecture: Yarn Architecture
Nineth: Introduction to the MR Programming model
Tenth Lecture: Map-reduce Programming Example: WordCount
11th Lecture: The MR Data type
12th Lecture: Mr Input format
13th Lecture: Mr Output format
14th: Case: Using custom input and output formats
15th Lecture: MR Shuffle components explained
16th: Case: Two order
17th: Introduction of Combinatorial Mr Task
18th: Mr Task multi-data Source connection Introduction
19th: case: Inverted index
Second, zookeeper:
20th: Zookeeper origin and architecture introduction
21st Lecture: Zookeeper Installation
22nd Lecture: Zookeeper shell command
23rd Lecture: Zookeeper Java API
24th: Zookeeper Case: Implementing shared locks in a distributed environment
Three, HBase:
25th: HBase Origins, architecture, and data model introduction
26th Lecture: HBase Installation
27th Lecture: HBase shell command
28th Lecture: HBase Java API
29th: HBase coprocessor Introduction
30th Lecture: HBase and MapReduce integration
31st: HBase Case: Creation of Level two indexes
Iv. Hive:
32nd: Hive Origin and architecture introduction
33rd: Hive Installation
34th: On the Hive shell command
35th: Hive shell command
36th: Hive function
V. Hue:
37th: About Hue
Six, Oozie:
38th Lecture: Oozie Introduction
39th Lecture: Oozie Installation
40th Lecture: Oozie case
41st Lecture: Oozie java Client
42nd Lecture: Oozie Hue Integration
Seven, Flume:
43rd Lecture: Flume Introduction and Installation
The 44th Lecture: Flume Case Introduction
The 45th Lecture: Flume Case Introduction
46th: Flume Custom Source
47th Lecture: Flume Custom Interceptor
Eight, Sqoop:
48th Lecture: Sqoop Introduction and Installation
The 49th Lecture: Sqoop Case Introduction
The 50th Lecture: Sqoop Case Introduction
Nine, Kafka:
51st Lecture: Kafka Introduction and Installation
52nd Lecture: Kafka case
Ten, Mr Extension:
53rd: MapReduce case: Shortest Path algorithm
54th: MapReduce case: PageRank algorithm
55th: MapReduce case: Social friend referral algorithm
56th Lecture Flume Taildir Source
57th Lecture Flume HBase Integration
Hadoop Ecosystem technology Introduction to speed of light (shortest path algorithm Mr Implementation, social friend referral algorithm)