HBase quick data import-BulkLoad
Apache HBase is a distributed, column-oriented open source database that allows us to access big data at random and in real time. But how can we effectively import data to HBase? HBase has multiple data import methods. The most direct method is to use TableOutputFormat as the output in
Download: http://mirror.bit.edu.cn/apache/hbase/stable/
Official Guide: http://abloz.com/hbase/book.html
Installation configuration:
Unzip:
TAR-XZVF hbase-0.96.0-hadoop1-bin.tar.gz
Go to $hbase/lib and look at the related Hadoop package to see which version of Hadoop it is.
only the installation of the pseudo-distrib
HBase is an open source implementation of Google Big table, and there are a lot of basics and architecture on the web, so here's not one of them, so let's talk about how I personally think about HBase.1, query: All know hbase query fast, because in fact, based on memory query, HBas
Hqueue: hbase-based message queue Ling Bai? 1. hqueue Introduction
Hqueue is a distributed and persistent Message Queue developed by the offline system team of Taobao search web page capturing Based on hbase. It uses htable to store message data, uses hbase coprocessor to encapsulate the original keyValue data into the message data format for storage, and encapsu
1. What are the basic features of hbase?
2. What are the issues that hbase can solve relative to a relational database?
3. What is the data model for HBase? How to express. What are the forms of operation.
4. Some concepts and principles of the HBase schema schema design
5. What is the topological structure of
use and its use of restrictions3. Best practices for using Partitioner4, Hadoop built-in sorting algorithm analysis5. Custom sorting algorithm6. Hadoop built-in grouping algorithm7. Custom Grouping algorithm8. MapReduce Common scenario and algorithm implementation4th topic:Hadoop Cluster Advanced practices (actual capabilities of specific Hadoop Enterprise Admins)1. Dynamically increase the slave node of Hadoop2. Dynamically modify the number of replication in Hadoop3. Using commands to manage
1. The design of the table
1.1 pre-creating regions By default, a region partition is created automatically when the HBase table is created, and when the data is imported, all HBase clients write the data to this region until the region is large enough to be split.
One way to speed up batch writes is to create some empty regions, so that when data is written to HBase
use and its use of restrictions3. Best practices for using Partitioner4, Hadoop built-in sorting algorithm analysis5. Custom sorting algorithm6. Hadoop built-in grouping algorithm7. Custom Grouping algorithm8. MapReduce Common scenario and algorithm implementation4th topic:Hadoop Cluster Advanced practices (actual capabilities of specific Hadoop Enterprise Admins)1. Dynamically increase the slave node of Hadoop2. Dynamically modify the number of replication in Hadoop3. Using commands to manage
you specified and add the specified server number to it. For example, you specify the following configuration server.1 = master: 2888: 3888 for the hostname named master, so its number should be 1. Distribute the zookeeper-3.4.5 to another machine. Modify the content of the corresponding myid file to the ID specified previously. For example, if node is 2 and slave is 3, the zookeeper service is started separately. Switch to the zookeeper-3.4.5 directory on each machine and run $ bin/zkServer. s
The following error is reported when you log on to the server after setting up the HBase environment: Hadoop @ gpmasterlogs] $ hbaseshellSLF4J: Classpathcontainsmult
When you log on to the server after setting up the HBase Environment last time, the following error is reported: Hadoop @ gpmaster logs] $ hbase shell SLF4J: Class path contains mult
The followi
Recently in the study of the use of hbase, and carefully read an official recommended blog, here on the side of the translation as a summary of the way and everyone together to comb the HBase data model and basic table design ideas.
Official recommended Blog Original address: http://0b4af6cdc2f0c5998459-c0245c5c937c5dedcca3f1764ecc9b2f.r43.cf2.rackcdn.com/9353-login1210_ Khurana.pdf Click on the Open link
1. Enter the hbase shell command:
$ {Hbase_home}/bin/hbase Shell
2. Obtain the command list:
Hbase> help
3. Alter:
1) In the 't1' table, add or modify a columnfamily => 'f1' and keep its maxversions as 5:
Hbase> alter 't1', {name => 'f1', versions => 5}
2) Delete columnfamily whose value is 'f1 'in 't1:
trafodion:transactional SQL on HBaseReal-time Distributed transaction processing on HBaseIntroduced HBase's SQL capabilities have been inadequate. Phoenix lacks the ability to join, ebay's kylin is not concise enough, Facebook Presto hbase Connector is not public. So, here comes the trafodion. It provides standard SQL functionality on HBase and supports transactional OLTP. Trafodion is HP's Open Source init
Install xammp in the/OPT directory. The WWW directory is/opt/lampp/htdocs/
(1) create a web directory phphbase[Root @ gd02 htdocs] # mkdir-P/opt/lampp/htdocs/phphphbase/[Root @ gd02 htdocs] # cd/opt/lampp/htdocs/phphphbase{View the example file democlient. php used by PHP to access hbase.[Root @ gd02 phphphbase] # locate democlient. php/Root/software/hbase-0.20.6/src/examples/thrift/democlient. php[Root @ g
Enter HBase Shell Console$HBASE _home/bin/hbase ShellIf you have Kerberos authentication, you need to use the appropriate keytab for authentication (using the Kinit command), and then use the HBase shell to enter the certificate successfully. You can use the WhoAmI command to view the current user
Transferred from: http://www.cnblogs.com/nexiyi/p/hbase_shell.htmlTwo months ago used HBase, now the most basic commands are forgotten, leave a reference ~
Enter HBase Shell Console$HBASE _home/bin/hbase ShellIf you have Kerberos authentication, you need to use the appropriate keytab for authentication (us
HBase shell command.
Enter HBase Shell Console$HBASE _home/bin/hbase ShellIf you have Kerberos authentication, you need to use the appropriate keytab for authentication (using the Kinit command), and then use the HBase shell to enter the certificate successfully. You
Hbase Shell DetailsHBase provides users with a very convenient way to use it, which we call "HBase Shell." The HBase shell provides most hbase commands, which can be easily created, deleted, and modified by HBase shell users, as well as adding data to tables, listing related
Label:Questions Guide: 1 、--hbase-table 、--The role of Hbase-row-key 、--column-family and--hbase-create-table parameters?2. Sqoop the data in the relational database table into HBase, what is the default Rowkey?3. What if there are multiple keywords in the relational database table?Introduction and some important param
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.