Hadoop Ecology Map

Hadoop has grown into a huge system, as long as it can see Hadoop in areas related to http://www.aliyun.com/zixun/aggregation/13584.html "> massive data, Here are a variety of data tools that appear in the Hadoop ecosystem.

1, all this, originated from the advent of the Web data explosion era

2, Data capture system: Nutch

3, mass data how to save, of course, with Distributed File system: HDFS

4, how to use the data, analysis, processing

5, the MapReduce frame, lets you write the code to realize to the big data analysis work

6. Unstructured data (log) collection and processing: Fuse/webdav/chukwa/flume/scribe

7, data import into the HDFs, so RDBSM can also join Hdfs:hiho, Sqoop

8, MapReduce too much trouble, let you use familiar way to manipulate the data in Hadoop: PIG,HIVE,JAQL

9. Make your data visible: Drilldown,intellicus

10. Manage your task flow with advanced language: oozie,cascading

11, Hadoop certainly has its own monitoring management tools: Hue, Karmasphere, Eclipse plugin, cacti, ganglia

12, data serialization processing and task scheduling: Avro, zookeeper

13. More services built on top of Hadoop: Mahout, Elastic map Reduce

14. OLTP online transaction processing system: Hbase

This article is from the "Zorro CTO" blog, please be sure to keep this source http://zorro.blog.51cto.com/2139862/1432215