One: HBase compression mainly divides into three kinds
1 hfile block compression on disk: This type of compression is mainly used for compression stored on the hard disk. Supports gzip, Lzo, snappy three kinds of data compression. The following two types require additional configuration and installation dependencies. HBase the first compression method is provided by default. Gzip compared with lzo compressi
Recently, some hbase things were introduced during the testing of XX Project, hoping to record the process from the testing perspective and hope to help you quickly understand it. As a person who first came into contact with it, they need to grasp the basic concepts urgently and will not go into detail here.
Hbase shell is a convenient access method provided by hbase
BlogThat Yi-Wipe smilecsdn Blog Address:http://blog.csdn.net/u012185296 itdog8 address link: http://www.itdog8.com/thread-203-1-1.html blog post title:Hbase-mapreduce-hbase As an example of an input source | That Yi-wipe smile Personality Signature:The furthest distance in the world is not the horizon, nor the cape, but I stand in front of you, but you do not feel my presenceTechnical Direction:Flume+kafka+storm+redis/
1.zookeeper InstallationMove the extracted files from the desktop to the installation directory softwareExtractShow FilesModify the Zoo.cfg fileMy Cong is the mainframe.Note: If more than one cluster machine should matchCreate DataDir specify directories and create myID filesI was on a machine, the host is the cluster machine, if you want to configure more than one cluster machine, use the following commandSend zookeeper to slave nodeModify the value from the node myIDStart the Zookeeper service
Original
To blur a lookup, you can write this. But Row_key can only be technical to the right of the query.
such as: row_1000, row_1001,row_1002,row_1003,row_1004,row_1005,row_1000,row_10006,
Scan followed by table name
Scan ' table ', {LIMIT = = 10000, StartRow = ' row_1004 '} will be found, row_1004,row_1005,row_1000,row_10006 and other records
Query number Interval
Count ' table ', {INTERVAL = 10000}
Count ' table ', 10000 same effect
HBase home pa
The Eclipse,hbase version is not currently found to be specifically specified.1: Copy an hbase deployment file from the HBase cluster, placed in a directory on the development side (as in the/app/hadoop/hbase096 directory).2: Create a new Java project in Eclipse HBase, then select the project Properties, Libraries->add
First, the HBase Foundation1. ConceptHBase is a column-oriented distributed database developed on HDFS for random, real-time access to ultra-large datasets, which is a column-family-oriented memory. Since both tuning and storage are performed at the column family level, it is best to have the same "access mode" and size characteristics for all members of the column family2. RegionalHBase automatically divides the table horizontally into regions.
eclipse,hbase version is not currently found to require special designation
1: Copy a hbase deployment file from the HBase cluster and place it in a directory on the development side (for example, under the/app/hadoop/hbase096 directory). 2: Create a new Java project hbase in Eclipse, then select the project Propertie
On hadoop2.5.2 Pseudo-distributed, the pseudo-distributed hbase1.0.1.1 is installed.When you create a TESTAPI table with the APIs of HBase, you are promptedException in thread "main" java.lang.noclassdeffounderror:org/apache/hadoop/hbase/hbaseconfigurationAt Com.wonderad.mr.ADReport2HBase.main (adreport2hbase.java:152)At Sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)At Sun.reflect.NativeMethod
Ubuntu14.04,eclipse operation of HBase. The following is a example that uses the HBase Java API to manipulate hbase to view the student1 column families in HBase:Import Java.io.ioexception;import Org.apache.hadoop.conf.configuration;import Org.apache.hadoop.hbase.hbaseconfiguration;import Org.apache.hadoop.hbase.hcolumndescriptor;import Org.apache.hadoop.hbase.ht
When using MapReduce and HBase, when running the program, it appearsJava.lang.noclassdeffounderror:org/apache/hadoop/hbase/xxx error, due to the lack of hbase supported jar packs in the running environment of Hadoop, you can resolve 1 by following these methods . Turn off the Hadoop process (all) 2. Add in the profile hadoop-env.sh of Hadoop:
hadoop_classpath=/
Let's take a look at some of the basic operations commands of the HBase shell, and I've listed several common hbase shell commands, as follows:
Name
Command-expression
Create a table
Create ' table name ', ' column name 1 ', ' Column Name 2 ', ' Column name n '
Add a record
Put ' table name ', ' Row name ', ' Column name: ', ' value '
View Record
to increase, when the increase to a threshold, the region will be divided into two new region. As the table gets bigger, the region grows more and more3. Each region is the smallest unit of distributed operation and load balancing in HBase, and different region may be distributed on different regionserver4, region, although the smallest unit of distributed operation, but not the smallest unit of storage, in region, but also divided into a lot of smal
define an available column family, which users can add or remove column families as needed, but must first be disable.3. HBase is a master/slave structure and relies on zookeeper,master to manage multiple regionserver.Third, installation (standalone)1. Java 1.6 or later must be installed.2, can be modified ~/.base_profile,export java_home point to the JAVA installation path, you can also modify the conf/hbase
Discover the defunct region server and reassign the region on it
Admin user to table additions and deletions to check operations
Region Server
regionserver maintenance region, processing IO requests for these region
regionserver is responsible for splitting the region that becomes too large during the operation.
Zookeeper function
by election to ensure that at any time, only one master,master in the cluster and regionservers will be registered with the zookeeper when it starts
Storage
Preparation of the development environment:eclipse3.5,jdk1.7,window8,hadoop2.2.0 , hbase0.98.0.2 , phoenix4.3.01. Copy the following files from the cluster:core-site.xml,hbase-site.xml,hdfs-site.xml files are put into the project src under2, the Phoenix-4.3.0-client.jar and phoenix-core-4.3.0.jar of Phoenix Add to Project Classpath3. Configure the hosts file for each node in the cluster to add the client's hostname:IP4. Join the hostname and IP of th
Preparation of the articleHadoop installationZK InstallationThe hbase version that is used in this article is 0.98.9Before installing HBase, make sure to rely on each version of the component, the Hadoop version of this article is 2.6, no support instructions on the official website, but we still use hadoop2.6 to try, the JDK is 7http://www.apache.org/dyn/closer.cgi/hba
BlogThat Yi-Wipe smilecsdn Blog Address:http://blog.csdn.net/u012185296 itdog8 address link: http://www.itdog8.com/thread-204-1-1.html blog post title:Hbase-mapreduce-hbase As an example of an output source | That Yi-wipe smile Personality Signature:The furthest distance in the world is not the horizon, nor the cape, but I stand in front of you, but you do not feel my presenceTechnical Direction:Flume+kafka+storm+redis/
HBase Tutorial (ii) HBase database Shell command
1 Hbase-shell Command
HBase is a distributed, column-oriented open source database, HBase also provides the shell command of the database to add, delete, change, check the basic operations, such as database creation, modifica
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.