The hive build is divided into three modes: 1, embedded,2, local,3, remote serverIn this case, the main configuration is the 3rd mode: remote Server modeMy environment is a total of three virtual machines: HOST0,HOST2,HOST3In remote server mode, the Host0:hive-server2Host2:hive-metastoreHost3:mysql Server1, respectively in the Host0,host2 and Host3 installed
data of the increase (delete and change is actually increased operation), characteristics and the data type inside see this blog: http://blog.csdn.net/chenxingzhen001/article/details/20901045
1, Build table: Create Tabletest (ID string, name string)
ROW FORMAT delimited fieldsterminated by ' | '
STORED as Textfile
2. Load the data file in HDFs into the table:
LOAD DATA LOCAL inpath './examples/files/test.txt ' OVERWRITE into TABLE test;
3. Insert the query results into the table, and filter
Original articles, reproduced please mark from http://blog.csdn.net/lsttoy/article/details/53406710.
The first step :Download the latest hive and go directly to Apache to find hive2.1.0 download on the line.
Step two , unzip to the server
Tar zxvf apache-hive-2.0.0-bin.tar.gz
mv apache-hive-2.0.0-bin/home/hive
The
Hive index, hive
1. Hive index Overview
Hive indexes aim to improve the query speed of specified columns in Hive tables.
If no index exists, a query similar to 'where tab1.col1 = 10', Hive loads the entire table or partition and
The purpose of configuring hive and HBase integration is to use the HQL syntax to implement additions and deletions of hbase database, the basic principle is to use the API interface between them to communicate with each other, the communication is mainly dependent on the Hive_hbase-handler.jar tool class. Note, however, that using hive to manipulate tables in HBase simply provides convenience, as described
Ruchunli's work notes , who says programmers can't have a literary fan?
Hive provides three service modes externally, the CLI (command line interface), Hive Web, and hive Client (such as JAVAAPI).1. Hive command line mode (CLI)There are two ways to start hive command-
Document directory
Create Table
ALTER TABLE
Select
Join
Hive discussion (4)-hive QL
Hive official documentation on the query language has a very detailed description, please refer to: http://wiki.apache.org/hadoop/Hive/LanguageManual, most of the content of this article translated from this page, some things need
This article summarizes the installation of hive + MySQL. Later, we will put some information about hive:
1. Installation objectives:
Hive with remote MySQL
2. Summary:
1). MySQL Configuration:
Assume that hive connects to MYSQL as a hive user and logs on to MYSQL as a root
Opening Remarks: Hive and HBase integration function is to use their own external API interface communication, mutual communication is mainly rely on hive_hbase-handler.jar tool class (HiveStorageHandlers: there is still some interest in hive_hbase-handler.jar this stuff, free to grind.
Opening Remarks: Hive and HBase integration function is to use their own external API interface communication, mutual comm
the test84.hadoop/10.1.77.84:10000 port
In addition, the Hadoop filesystem cache caches file system objects with a URI schema, authority, UGI (CurrentUser), and a unique combination as key. However, this results in Hive server memory leak, which can be seen by the "Jmap-histo pid" as a very large number of filesystem objects, so you need to add hive file system when you start disable server The cache param
QQ Exchange Group: 335671559, Welcome to Exchange
First, what is hive metadata. Hive metadata is some of the basic elements of hive, including the basic properties of hive tables, as follows (1) The database name, table name, field name and type of Hive table, partition fie
-I mysql-client-******** to install the mysql client.
(5) execute the command mysql_secure_installation to set the root user password
(6) by default, mysql does not allow hive connection. to authorize the connection on the mysql client, run the following command: grant all on hive. * to 'root' @ '%' identified by 'your password'; then, refresh the command: flush privileges;
4. Use mysql as the metastore of
Tags: hive videoHive detailed and practical (hive Environment deployment +zeus+sqoop sqoop+ User Behavior analysis case)Course Study Address: http://www.xuetuwuyou.com/course/187The course out of self-study, worry-free network: http://www.xuetuwuyou.comCourse Description:This course introduces basic hive architecture and environment deployment, and leads you to u
configured in 1
Hive-site.xml can be added to whether or not to verify the configuration, set here to none, for the time being no validation, testing.
Configuring Hadoop proxy users in the Core-site.xml file for Hadoop
This setting means that a task submitted by the root user can be executed on any machine as any user of any group.If not set, subsequent connections are reported
Org.apache.hadoop.ipc.RemoteException (org.apache.hadoop.security.autho
-default.xml.template Hive-site.xmlClear the content between Copy the MySQL JDBC driver package to the Lib directory of Hivecd/data/hadoop/hive/lib/Wget-c Http://114.242.101.2:808/hive/mysql-connector-java-5.1.44-bin.jar====== five. Hive's default storage path on HDFs ======Website Description:Hive uses Hadoop, so:You
The integration of hive and hbase is to use their own external API interface to communicate with each other, communication is mainly dependent on hive-hbase-handler.jar tools; hive-hbase-handler.jar in the hive lib package instead of in hbase Lib, hive0.6 version later;
Create an hbase table when creating a
The premise of integrating hive is that the Apache Hadoop cluster can start normally.Hadoop version apach2.6.0 hive version: 1.2.11. Install MySQL and give permissions:1.1: Create hive user and password:Create user ' hive ' identified by ' 123456 '1.2: Create the database: creates the databases
The parameters in hive are divided into three categories, the first system environment variable information, the environment variable information, the second is ENV environment variable information, is the current user environment variable information; The third is the hive parameter variable information, is the environment variable information defined by the Hive
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.