Sqoop Installation Deployment

1. Environment Preparation 1.1 software version

sqoop-1.4.5

2. Configuration

The configuration of the Sqoop is relatively simple, and the files that need to be configured are given below

2.1 Environment variables

sudo VI /etc/profile

sqoop_home=/home/hadoop/source/sqoop-1.4. 5 PATH= $SQOOP _home/binexport sqoop_home

2.2sqoop-env.sh

#Set Path towhereBin/hadoop isAvailableexport hadoop_common_home=/home/hadoop/source/hadoop-2.5.1#Set Path towhereHadoop-*-core.jar isAvailableexport hadoop_mapred_home=/home/hadoop/source/hadoop-2.5.1#SetThe path towhereBin/hbase isAvailable#export hbase_home=#Set the path towhereBin/hive isAvailableexport hive_home=/home/hadoop/source/hive-0.14.0#Set the path for whereZookeper Config dir is#export Zoocfgdir=

Note: At present I am the wood has the configuration hbase and zookeeper, if need person can assign the path directly to HBase and zookeeper installation path.

2.3 Exceptions

Streaming result set [email protected] is still active

When executing the Sqoop script, this exception occurs because of the reason for the MySQL driver, using the latest MySQL driver package.

Solution:

wget http://dev.mysql.com/get/downloads/connector-j/mysql-connector-java-5.1.32.tar.gz 

Then extract to the Sqoop directory in the Lib directory, re-execute the script is normal.

This completes the installation configuration and use of Sqoop.

Contact information:

QQ Group (Dong's blog): 306184597

E-mail: 81037121[email protected]

Sqoop Installation Deployment