HBase
HBase is a distributed, column-oriented open source database that comes from the Google paper "Bigtable: A distributed storage system for structured data" Fay Chang wrote. Just as BigTable leverages the distributed data storage provided by the Google File system, HBase provides a bigtable-like capability over Hadoop. HBase is a subproject of the Apache Hadoop project. Unlike a generic relational database, HBase is a database suitable for unstructured data storage. Another difference is that HBase is based on columns rather than on a row based pattern.
Hadoop family
Hadoop family members:
Hadoop Common
A module at the bottom of the Hadoop system that provides various tools for Hadoop subprojects, such as configuration files and log operations.
Avro
Avro is the RPC project hosted by Doug Cutting, a bit like Google's Protobuf and Facebook's thrift. Avro is used to do later RPC of Hadoop, make Hadoop RPC module communicate faster, data structure is more compact.
Chukwa
Chukwa is a large cluster monitoring system based on Hadoop, which is contributed by Yahoo.
HBase
Based on the Hadoop distributed File System, it is an open source, distributed database based on the column storage model.
Hdfs
Distributed File System
Hive
Hive is similar to Cloudbase, and is based on the Hadoop distributed computing platform to provide data Warehouse SQL functions of a set of software. The summary of the massive data stored in Hadoop, the simplicity of the ad hoc query. Hive provides a set of QL query languages, based on SQL, and is easy to use.
Mapreduce
Implements the MapReduce programming framework
Pig
Pig is a sql-like language, an advanced query language built on MapReduce, that compiles some operations into the MapReduce model's map and reduce, and that users can define their own capabilities. Yahoo Grid Computing department developed another clone of Google's project Sawzall.
Zookeeper
Zookeeper is an open-source implementation of Google's chubby. It is a reliable coordination system for large distributed systems, including configuration maintenance, name service, distributed synchronization, group service, etc. Zookeeper's goal is to encapsulate complex and error-prone key services, delivering easy-to-use interfaces and high-performance, functionally stable systems to users.
HBase System Architecture Diagram
The architecture is as follows:
See more highlights of this column: http://www.bianceng.cnhttp://www.bianceng.cn/Servers/cloud-computing/