sqoop split by

Sqoop import-d oraoop.disabled=true --connect"jdbc:oracle:thin:@ (description= (address= (protocol=tcp) (Host=hostname) (Port=port) (connect_data=) (Service_ Name=service_name )))" --USERNAME username--table table_name--NULL-string '\\n'--NULL-non-string '\\n' --hive-import--hive-table Hivedb. Hivetalbename--num-mappers1--verbose--password PWD--hive-drop-import-delims--hive-Overwrite--fetch-size --D is not the parameter for

Tags: des style blog http ar os using SP onThe installation configuration of Hadoop is not spoken here. The installation of Sqoop is also very simple. After you complete the installation of SQOOP, you can test if you can connect to MySQL (note: The MySQL Jar pack is to be placed under Sqoop_home/lib):Sqoop list-databases--connect jdbc:mysql://192.168.1.109:3306/-

Because of the needs of the work, need to transfer the data in HDFs to the relational database to become the corresponding table, on the Internet to find the relevant data for a long, found that different statements, the following is my own test process: To use Sqoop to achieve this need, first understand what Sqoop is. Sqoop is a tool used to transfer data from

Label:The first is to install the MySQL database. Installation is complete using the sudo apt-get install mysql-server command. The table is then created and the data is inserted:Then download the Sqoop and the jar package that connects to the MySQL database. The next step is to install Sqoop. The first is to configure the sqoop-env.sh file:Then comment out the C

1.sqoop importing data from hive into MySQLFor example:Sqoop export--connect jdbc:mysql://10.18.101.15:3306/wda--username restdbuser--password 123456--table adl_trend_num _android--export-dir/apps/hive/warehouse/adldb.db/adl_trend_num_android/date_stamp= $date-- Input-fields-terminated-by ' \ t '2.sqoop importing data from MySQL into hiveFor example: sqoop Import

Hive version hive-0.11.0Sqoop version sqoop-1.4.4.bin__hadoop-1.0.0From Hive to MySQLMySQL table:mysql> desc cps_activation; + ———— + ————-+--+-–+ ——— + —————-+| Field | Type | Null | Key | Default | Extra |+ ———— + ————-+--+-–+ ——— + —————-+| ID | Int (11) | NO | PRI | NULL | auto_increment || Day | Date | NO | MUL | NULL | || Pkgname | varchar (50) | YES | | NULL | || CID | varchar (50) | YES | | NULL | || PID | varchar (50) | YES | | NULL | || Act

‘ lines terminated by ‘\n‘ stored as textfile;create table dept_etl(deptno int,dname string,loc string)row format delimited fields terminated by ‘\t‘ lines terminated by ‘\n‘ stored as textfile;create table tmp_result_etl(empno int,ename string,comm double,dname string)row format delimited fields terminated by ‘\t‘ lines terminated by ‘\n‘ stored as textfile;create table result_etl(empno int,ename string,comm double,dname string)row format delimited fields terminated by ‘\t‘ lines terminated by

1. Environment tool Version Introduction Centos6.4 (final) Jdk-7u60-linux-i586.gz Hadoop-1.1.2.tar.gz Sqoop-1.4.3.bin__hadoop-1.0.0.tar.gz Mysql-5.6.11.tar.gz 2. Install centos Refer to the use of online Ultra to create a USB flash drive to start and directly format the installation system. There are a lot of information on the Internet, but it is best not to change the host name during installation, also, it is best not to use the graphical interface

1. Install sqoop Download sqoop-1.2.0.tar.gz (version 1.20 is compatible with Hadoop0.20) Put the hadoop-core-0.20.2-cdh3u3.jar, hadoop-tools-0.20.2-cdh3u3.jar into the sqoop/lib directory, the two jar packages are out of cloudera company, you can go to its official website to download. 2. import data from mysql Go to the sqo