Open source software Pk:hadoop, Apache who is to contend with?

With the advent of the data age, open source software more and more attention, especially in the Web application server, application architecture and large data processing is widely used, including Hadoop, Apache, MySQL and other open source software is well-known, in the enterprise large-scale network applications to assume an important role. Free, fast and so the advantages of the rapid development of open source software, nearly a year in the server domain application is increasingly extensive, below we look at the future will be a period of time in the server industry software leading role.

I. HBase

HBase is a distributed, column-oriented open source database, HBase provides a bigtable-like capability over Hadoop. HBase is a subproject of the Apache Hadoop project. Unlike a generic relational database, HBase is a database suitable for unstructured data storage. Another difference is that HBase is based on columns rather than on a row based pattern.

HBase (Hadoop Database) is a highly reliable, high-performance, column-oriented, scalable, distributed storage system that leverages HBase technology to build large structured storage clusters on inexpensive PC servers.

HBase is an open-source implementation of Google BigTable, similar to Google BigTable leveraging GFs as its file storage system, hbase using Hadoop HDFs as its file storage system Google runs mapreduce to handle massive amounts of data in BigTable, HBase also uses Hadoop mapreduce to handle massive amounts of data in HBase, and Google BigTable uses chubby as a collaborative service, HBase uses zookeeper as its counterpart.

HBase

The above illustration depicts the layers of systems in the Hadoop ecosystem, where HBase is located at the structured storage layer, and the Hadoop HDFs provides a high level of reliable underlying storage support for HBase, Hadoopmapreduce delivers high-performance computing power for HBase, Zookeeper provides stable service and failover mechanism for hbase.

In addition, pig and Hive also provide high-level language support for hbase, making it very easy to perform data statistics processing on hbase. Sqoop provides a convenient RDBMS data import function for HBase, which makes it easy to migrate traditional database data to hbase.