hadoop ecosystem components

first, the core components of Hadoop The components of Hadoop are shown in the figure, but the core components are: MapReduce and HDFs. 1, the system structure of HDFSWe first introduce the architecture of HDFs, which uses a master-slave (Master/slave) architecture model,

for analysis and processing(5)/app-non-data files, such as: Configuration files, jar files, SQL files, etc. Mastering the above four steps for the application of HDFs has important role and significance, but we should be based on their own situation gradually, pay attention to practice, can continue to make progress. I usually like to find some case analysis, so as to exercise to improve their skills, this is more like "Big Data CN" This service platform. But the truth is more from practice, on

final String Input_path = "Hdfs://liaozhongmin:9000/hello"; //define Output path private static final String Out_path = "Hdfs://liaozhongmin:9000/out"; public static void Main (string[] args) { try { //Create configuration information Configuration conf = new configuration (); /**********************************************/ //Compress the map-side output //conf.setboolean ("Mapred.compress.map.output", true); //Set the compression class used for map-side outp

with no intermediate state.6, Sequential: For all servers, the same message is published in a consistent order.Basic principle650) this.width=650; "Src=" Http://s1.51cto.com/wyfs02/M00/85/4C/wKiom1efTNnA4ZCeAAX4DF7vo0w159.png-wh_500x0-wm_3 -wmp_4-s_1223101739.png "title=" Zookeeper2. PNG "alt=" Wkiom1eftnna4zceaax4df7vo0w159.png-wh_50 "/>Server many, there are master and slave points, but there is a leader, the other is follower,Each server, in memory, holds a piece of data that, when launched,