Hadoop Ecosystem technology Introduction to speed of light (shortest path algorithm Mr Implementation, social friend referral algorithm)

Source: Internet
Author: User
Tags zookeeper hadoop ecosystem sqoop

Hadoop Ecosystem technology Introduction to speed of light (shortest path algorithm Mr Implementation, Mr Two ordering, PageRank, social friend referral algorithm)
Share the network disk download--https://pan.baidu.com/s/1i5mzhip password: vv4x


This course will have a better explanation from the basic environment building to the deeper knowledge learning. Help learners quickly get started with the use of the Hadoop ecosystem's big Data processing framework, using the Hadoop ecosystem for modular, project-functional development, primarily including installation of Hadoop, Hive, HBase, Hue, Oozie, Flume and other eco-related software environment, and in the well-established environment to carry out the relevant knowledge points and function of the development. Project/module mainly involves the use of Mr Development related real business functions, including the shortest path calculation, social friend recommendation algorithm implementation, distributed lock implementation, etc., these modules can be used in the actual build environment, can be very simple to integrate the code of these modules directly into the relevant actual production environment code.


First, Hadoop:
First: Hadoop origins, architecture, and ecosystem introduction
Second Lecture: Hadoop installation
Third: Eclipse Environment Building under Windows platform
Part IV: HDFS architecture
Five: HDFS SHELL API Introduction
Introduction to HDFS Java API
Seventh: Hadoop 2.x HDFs new features
Eighth Lecture: Yarn Architecture
Nineth: Introduction to the MR Programming model
Tenth Lecture: Map-reduce Programming Example: WordCount
11th Lecture: The MR Data type
12th Lecture: Mr Input format
13th Lecture: Mr Output format
14th: Case: Using custom input and output formats
15th Lecture: MR Shuffle components explained
16th: Case: Two order
17th: Introduction of Combinatorial Mr Task
18th: Mr Task multi-data Source connection Introduction
19th: case: Inverted index

Second, zookeeper:
20th: Zookeeper origin and architecture introduction
21st Lecture: Zookeeper Installation
22nd Lecture: Zookeeper shell command
23rd Lecture: Zookeeper Java API
24th: Zookeeper Case: Implementing shared locks in a distributed environment

Three, HBase:
25th: HBase Origins, architecture, and data model introduction
26th Lecture: HBase Installation
27th Lecture: HBase shell command
28th Lecture: HBase Java API
29th: HBase coprocessor Introduction
30th Lecture: HBase and MapReduce integration
31st: HBase Case: Creation of Level two indexes

Iv. Hive:
32nd: Hive Origin and architecture introduction
33rd: Hive Installation
34th: On the Hive shell command
35th: Hive shell command
36th: Hive function

V. Hue:
37th: About Hue

Six, Oozie:
38th Lecture: Oozie Introduction
39th Lecture: Oozie Installation
40th Lecture: Oozie case
41st Lecture: Oozie java Client
42nd Lecture: Oozie Hue Integration

Seven, Flume:
43rd Lecture: Flume Introduction and Installation
The 44th Lecture: Flume Case Introduction
The 45th Lecture: Flume Case Introduction
46th: Flume Custom Source
47th Lecture: Flume Custom Interceptor

Eight, Sqoop:
48th Lecture: Sqoop Introduction and Installation
The 49th Lecture: Sqoop Case Introduction
The 50th Lecture: Sqoop Case Introduction

Nine, Kafka:
51st Lecture: Kafka Introduction and Installation
52nd Lecture: Kafka case

Ten, Mr Extension:
53rd: MapReduce case: Shortest Path algorithm
54th: MapReduce case: PageRank algorithm
55th: MapReduce case: Social friend referral algorithm
56th Lecture Flume Taildir Source
57th Lecture Flume HBase Integration




Hadoop Ecosystem technology Introduction to speed of light (shortest path algorithm Mr Implementation, social friend referral algorithm)

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.