A word about Hadoop technology

&http://www.aliyun.com/zixun/aggregation/37954.html ">nbsp; Hadoop is a distributed system platform, it can easily build an efficient, high-quality distribution system, and it has many other related subprojects, that is, its function of a great expansion, including Zookeeper,hive,hbase.

MapReduce is an algorithm proposed by Google that is used in parallel operations for very large datasets. It is one of the core components of Hadoop, Hadoop to distributed includes two parts, one is the Distributed File System HDFs, a distributed computing box, is MapReduce, indispensable, that is to say, Distributed computing programming can easily be done on the Hadoop platform through MapReduce.

Pig is a query language (sql-like) built on MapReduce that is suitable for a large number of parallel computations.

Chukwa is based on a Hadoop cluster monitoring system that allows him to analyze and collect data from the system (log)

Hive is datawarehouse and Map reduce intersection, suitable for ETL work

HBase is a column-oriented distributed database.

HDFS can support tens large distributed file systems.

The functions provided by Zookeeper include: Configuration maintenance, Name service, distributed synchronization, group service and so on, which are used in the reliable coordination system of distributed system.

Avro is a data serialization system designed to support the applications of mass data interchange

Sqoop is a tool that can import data from a relational database into the Hadoop file system (HDFS). For example, MySQL data migrated to Hive/hbase. Support Hsqldb, MySQL, Oracle, PostgreSQL, etc.