Document directory
Create Table
ALTER TABLE
Select
Join
Hive discussion (4)-hive QL
Hive official documentation on the query language has a very detailed description, please refer to: http://wiki.apache.org/hadoop/Hive/LanguageManual, most of the content of this article translated from this page, some things need
This article summarizes the installation of hive + MySQL. Later, we will put some information about hive:
1. Installation objectives:
Hive with remote MySQL
2. Summary:
1). MySQL Configuration:
Assume that hive connects to MYSQL as a hive user and logs on to MYSQL as a root
Hive index, hive
1. Hive index Overview
Hive indexes aim to improve the query speed of specified columns in Hive tables.
If no index exists, a query similar to 'where tab1.col1 = 10', Hive loads the entire table or partition and
Upgrade hive client and hive Client
Article from: http://blog.csdn.net/lili72
Background: when using hive of the old version, some bugs often occur and cannot be solved. For example, you cannot find partitions in tables. Due to high concurrency, the following common exceptions are:
Com. mysql. jdbc. exceptions. jdbc4.MySQLSyntaxErrorException: Table '
Label:Description: This document is translated/collated in Hive Official document https://cwiki.apache.org/confluence/display/Hive/SQL+Standard+Based+Hive+Authorization# Sqlstandardbasedhiveauthorization-objectprivilegecommands.status of authorization prior to Hive version 0.13 H
The purpose of configuring hive and HBase integration is to use the HQL syntax to implement additions and deletions of hbase database, the basic principle is to use the API interface between them to communicate with each other, the communication is mainly dependent on the Hive_hbase-handler.jar tool class. Note, however, that using hive to manipulate tables in HBase simply provides convenience, as described
Tags: hive videoHive detailed and practical (hive Environment deployment +zeus+sqoop sqoop+ User Behavior analysis case)Course Study Address: http://www.xuetuwuyou.com/course/187The course out of self-study, worry-free network: http://www.xuetuwuyou.comCourse Description:This course introduces basic hive architecture and environment deployment, and leads you to u
Opening Remarks: Hive and HBase integration function is to use their own external API interface communication, mutual communication is mainly rely on hive_hbase-handler.jar tool class (HiveStorageHandlers: there is still some interest in hive_hbase-handler.jar this stuff, free to grind.
Opening Remarks: Hive and HBase integration function is to use their own external API interface communication, mutual comm
The integration of hive and hbase is to use their own external API interface to communicate with each other, communication is mainly dependent on hive-hbase-handler.jar tools; hive-hbase-handler.jar in the hive lib package instead of in hbase Lib, hive0.6 version later;
Create an hbase table when creating a
The premise of integrating hive is that the Apache Hadoop cluster can start normally.Hadoop version apach2.6.0 hive version: 1.2.11. Install MySQL and give permissions:1.1: Create hive user and password:Create user ' hive ' identified by ' 123456 '1.2: Create the database: creates the databases
Hive date functions, Hive date functions1. unix timestamp to Time Function
Syntax: from_unixtime (bigint unixtime [, string format]) Return Value: string Description: converts a UNIX timestamp (from 00:00:00 UTC to the specified time in seconds) to the current time zone for example: hive> select from_unixtime (1323308943, 'yyyymmdd') from dual; 201112082. Obtain
I've described two ways in which hive imports analysis results into MySQL tables, respectively: Sqoop import and Using hive, MySQL JDBC driver, now I'm going to introduce a third, and use a lot more ways--using hive custom Functions ( UDF or genericudf) inserts each record into a database table.First, using the UDF methodUsing UDF is a simple implementation, as
The parameters in hive are divided into three categories, the first system environment variable information, the environment variable information, the second is ENV environment variable information, is the current user environment variable information; The third is the hive parameter variable information, is the environment variable information defined by the Hive
Business backgroundThe EXTRACT_TRFC_PAGE_KPI hive SQL is as follows: set Mapred.job.queue.name=pms; set hive. exec. reducers. Max=8; Set mapred.reduce.tasks=8; set mapred.job.name=extract_trfc_page_kpi;InsertOverwriteTablePMS.EXTRACT_TRFC_PAGE_KPI Partition (ds=' $yesterday ')Select distinctPAGE_TYPE_ID, PV, UV,' $yesterday 'Update_time from(--For PC, H5SelectPAGE_TYPE_ID,sum(PV) asPvsum(UV) asUv fromDw.rpt
, and output, and reduce is split into input, Shuffle, sort, merge, Processor, and output, etc.In this way, these decomposed meta-operations can be arbitrarily and flexibly combined, resulting in new operations that, after some control procedures are assembled, can form a large dag job.Now that Hive supports the MR and Tez computing models, Tez can perfect the binary Mr Program and improve the computational performance.Spark (Memory dag compute model)
3, hive installation configuration3.1install MySQLInstalling MySQL on the datanode5# yum-y Installmysql-server MySQL# MySQLMysql> Grant all privileges on * * [email protected] ' 10.40.214.% ' identified by ' hive ';mysql> flush Privileges;3.2Installing Hive# tar-zxf Apache-hive-0.13.1-bin.tar.gz-c/var/data/; Mv/var/dat
Hive non-interactive mode and hive Mode
Run $ HIVE_HOME/bin/hive on a linux terminal to enter the interaction mode;
$ HIVE_HOME/bin/hive-e or-f is in non-interactive mode.
1. Execute HQL statements in non-interactive mode
$HIVE_HOME/bin/hive -e 'select * from movie limit 1
In the first three sections, basic data has been maintained for hive permission control, and now the user permission configuration function has been implemented. In addition, you can perform maintenance and management through the interface. Next, the most important thing is to modify the Hive source code. Mainly for org. apache. hadoop. hive. conf. HiveConf and o
hive installation deployment, there are many tutorials on the web, I will not repeat here, this time I would like to talk about how hive submits the HQL statement to hive execution. There are several ways: first, hiveserver provide thrift interface by building Hiveserver to receive HQL statement execution from remote commit. The benefit of this is that there i
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.