ETL Automation Complete Installation Method _ (metadata stored in MySQL database)

Pre-installation media preparation:

Dbi-1.636.tar.gz

Dbd-mysql-4.037.tar.gz

Etl.tar

Perl:

First part MySQL database installation

Links such as: http://jingyan.baidu.com/article/a378c9609eb652b3282830fd.html

Part II PERL module installation

1) Check the current Perl version of the command:perl-v

View installed perl module commands: Perldoc perllocal

2) DBI Module for dbi-1.636.tar.gz

Method is the same as the DBD module

3) DBD module is dbd-mysql-4.037.tar.gz

Tar xvzf dbd-mysql-4.037.tar.gz

CD dbd-mysql-4.037

Perl makefile.pl

Make

Make Test

Make install

5) Other modules ...

6) Add the following variable to the/etc/profile

Export Path=/usr/local/mysql/bin: $PATH

Export Ld_library_path=/usr/local/lib/mysql

7) Test Test.perl script to connect MySQL successfully

Part III Automation installation

1) under Linux system, create ETL User

Groupadd ETL

Useradd-g etl-m-d/home/etl-s/bin/bash ETL

2) switch to ETL user, add environment variable VI BASHRC in/home/etl, and then make it take effect source. BASHRC

Auto_home=/opt/etl; Export auto_home;

AUTO_DSN=TDVM; Export AUTO_DSN;

Auto_db=etlauto; Export auto_db;

AUTO_SERVER=ETL1; Export Auto_server;

auto_server_ip=192.168.152.100; Export auto_server_ip;

auto_agent_port=6346; Export Auto_agent_port;

auto_wdog_port=6346; Export Auto_wdog_port;

auto_primary_server=0; Export Auto_primary_server;

odbcini= $HOME/.odbc.ini;export Odbcini

Ld_library_path= $LD _library_path:/opt/teradata/client/14.00/odbc_64/lib:/usr/local/lib; Export Ld_library_path

3) Upload Etl.tar to/opt/directory and unzip

Tar xvf Etl.tar

5) Modify database connection information for etl_unix.pm and tools.pm two files

My $dbh = Dbi->connect ("dbi:mysql:database=etlauto;host=10.161.166.51", "root", "123456",

6) switch to root user, Grant ETL user/opt/etl permission

Chown-r Etl:etl/opt/etl

7) Upload yhddw.pm to this directory/usr/lib64/perl5/vendor_perl/

8) switch to ETL user, empty the file under/opt/etl/lock rm–rf etl*

Then execute SH start.sh under the/opt/etl/bin directory

9) See if the Automation 5 processes are started:

Method One: Ps–ef | grep PL

Method Two:/opt/etl/log

Main View Etlmaster.out

Part Fourth configuration Etladmin

4.1, Import the project

1) Copy the ETLAdmin261 to the workspace file

2) Open Eclipse and select

File-import

General--existing Projects into Workspace

Select Root directory–browse-then choose the file location of the first step "ETLAdmin261"

Select Copy projects into workspace Finish

4.2, Import jar Package

1) First delete the Jia package under Lib

2) Build Path-configure build Path

3) Java Buidl path-libraries-add JARs

4.3. Modify database configuration information

ETL Automation Complete Installation Method _ (metadata stored in MySQL database)