Sqoop synchronizing MySQL data into hive

Source: Internet
Author: User
Tags sqoop

One, sqoop in synchronizing MySQL table structure to hive

Sqoop create-hive-table--connect jdbc:mysql://ip:3306/sampledata--table t1--username Dev--password 1234--hive-table T1;

Execution to this step exits, but in Hadoop's HDFs/hive/warehouse/directory is not found T1 table directory,

But the normal execution is done as follows:



The error is that Hive's jar package is missing.

All of the jar packages should be like this:







This is all the hadoop-2.2.0 and hbase-0.96.2 and hive-0.13.1 integrated jar packages

There is also Sqoop-1.4.4.jar and MySQL driver pack also to put in, these two bags best also put in hadoop/etc/share/common/



Hive Boot Log Check
Hive-hiveconf Hive.root.logger=debug,console

Console view

or tune the boot log priority of hive and Hadoop to DEBUG,

Output to a file to view

If there is no exception information, it means that sqoop execution is not a problem, to solve the problem!


Sqoop synchronizing MySQL data into hive

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.