First, the historical value of hive1, Big Data is known for Hadoop, and Hadoop is useful because of hive. Hive is the killer on Hadoop application,hive is the Data Warehouse on Hadoop, while Hive has both the storage and query engines in the Data warehouse. And Spark SQL is a much better and more advanced query engine
}/operation_logs Replace with native path/usr/local/hive-2.1.1/data/hive/operation_logsVI $HIVE _home/conf/hive-site.xml# ESC after input:%s#${system:java.io.tmpdir}/${system:user.name}#/usr/local/hive-2.1.1/data/hive#:%s#${system
I. Installation of Hive
The components are arranged as follows:
172.16.57.75 bd-ops-test-75 mysql-server
172.16.57.77 bd-ops-test-77 Hiveserver2
1. Install Hive
Install the Hive on 77:
# Yum Install hive Hive-metastore
Ambari Hive cannot be properly queried
1. An error occurred today. After connecting to hive, no command can be executed.
$ Beeline-u "jdbc: hive2: // hostname.domain.cn: 10000/default; principal = hive/_ HOST@domain.com ;"Connecting to jdbc: hive2: // hostname.domain.cn: 100
Hive non-interactive mode and hive Mode
Run $ HIVE_HOME/bin/hive on a linux terminal to enter the interaction mode;
$ HIVE_HOME/bin/hive-e or-f is in non-interactive mode.
1. Execute HQL statements in non-interactive mode
$HIVE_HOME/bin/hive -e 'select * from movie limit 1
("Kuxun Authorization failed:" + authExp. getMessage ()?????????????????? + "Please contact anyoneking@163.com for your information .");?????????????? Return 403 ;??????}} Note: errorMessage must be assigned a value after an exception is obtained. Otherwise, no exception prompt is displayed when an exception occurs during access through hive client, and only NUll is displayed.
After the preceding steps are completed, package the package again and pu
Hive face Test-hive Application Thinking
Question: There is a very large table: Trlog The table is about 2T.
Trlog:
CREATE TABLE trlog
(PLATFORM string,
user_id int,
click_time string,
Click_url string)
row format delimited fields terminated by ' \ t ';
Data:
PLATFORM user_id click_time click_url WEB 12332321 2013-03-21 13:48:3 1.324/home/web 12332321 2013-03-21 13:48:32.954/selectcat/er/web 1233232
jdbc:derby:;d atabasename=metastore_db;create=true Parameter javax.jdo.option.ConnectionDriverName Specifies the driver's class entry name: Org.apache.derby.jdbc.EmbeddedDriver Parameter javax.jdo.option.ConnectionUserName the user name of the specified database: APP parameter Javax.jdo.option.ConnectionPassword password for the specified database: MIME Derby database driver under directory $hive_home/lib/, Derby-10.10.2.0.jar
Start hive command lin
the hive metadata database, and it is not possible to fine-tune the permissions on the MySQL server. Hiveclient metadata can be controlled by remote, by setting the hive.metastore.uris parameter, connecting remote server The hiveclient side does not need to provide MSYQL user name and password, which greatly improves the security. At the same time the MSYQL server can be controlled by fine-grained control permissions. Deployment Mode Select a serv
Tags: hive load install step INF blog Apach info share picture RAMFirst, install the Dbvisualizerhttp://www.dbvis.com/ You can also download the cracked version of the program from the Internet, the version used here is Dbvisualizer 9.1.1 Specific installation steps can be Baidu, or modify the installation directory after the default installation can beConfigure hive JD
2.3 Hive Internal Introduction: P44The jar file under the $HIVE _home/lib is a specific functional part; (CLI module) Other components, Thrift services, remote access to other process features, and the ability to access hive using JDBC and ODBC; all hive clients need a Metas
installation and the embedded is that the embedded derby is no longer used as a storage medium for metadata, but instead uses other databases such as MySQL to store the metadata.This approach is a multi-user mode that runs multiple user client connections to a database. This approach typically uses hive internally as a company.There is a premise that every user must have access rights to MySQL, that is, every client user needs to know the MySQL usern
-0.13.1-bin/log4jCopy the Oracle JDBC Jar packageCopy the appropriate Oracle JDBC package to $hive_home/libStart Hive [emailprotected]:~/hive/apache-hive-0.13.1-bin$ Hive 14/08/20 17:14:05 INFO configuration.deprecation: Mapred.re
1. Hive architecture and basic composition the following is the schema diagram for hive. Figure 1.1 Hive Architecture
The architecture of hive can be divided into the following parts: (1) There are three main user interfaces: Cli,client and WUI. One of the most common is when CLI,CLI starts, it initiates a
reason, I think the first Mondrian generated SQL is more, I recorded MySQL query records found an MDX query will generate about 18 SQL queries, including group by and join and other queries, Because Mondrian does not optimize the underlying data source (I think), it is theoretically the same for MySQL and hive-generated SQL (no comparison), so these lengthy SQL slows down the entire query, and hive is not
First, the Hive function1. Hive Built-in function(1) More content, see "Hive Official Documents"Https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF(2) Detailed explanation:Http://blog.sina.com.cn/s/blog_83bb57b70101lhmk.html(3) test the shortcut to the built-in function:1. Creating a dual Table CREATE t
ServiceSecondarynamenode-a redundant service that can be viewed as NamenodeJobtracker-Job Management services for parallel computingNode Services for Datanode-hdfsTasktracker-Job execution services for parallel computingManagement Services for Hbase-master-hbaseHbase-regionserver-Provide services for client-side inserts, deletes, query data, etc.Zookeeper-server-zookeeper collaboration and Configuration Management ServicesManagement Services for Hive
database as the metadata storage tier by default.In Hive, Derby is started by default in "single user" mode, which means that only one user can use hive at a time, which is suitable for local testing when developing a program.The Hive configuration file is located under the $hive_home/conf directory, Named Hive-site.x
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.