Kettle's resource pool

In kettle, the repository of the storage of resources such as transformations or jobs is called a resource library: it is divided into a file resource library and a database repository.

A transformation or job can belong to a repository or a separate file form exists.

I. Database Resource Library

1.1 Creating a database as a database repository in MySQL

1.2 Create DATABASE Repository Tool--"Resource Library--" Connect Resource Library--"Click the Plus--" Select Create Database Repository

Because we want to use MySQL as the repository, so kettle need to connect to MySQL, that is, we need a MySQL driver package, we have to copy the driver package into the Kettle Lib directory.

Create a database connection and pass the test

Select Create or update

1.3 After creation, verify that a large number of tables are created in the database

Seeing these tables means that a database repository has been created.

1.4 Create a transform and create a DB connection to verify that the unshared DB connection can not be shared in the repository

It is possible to pass the test.

Second, the Document Resource library

Tool--"Resource Library"

Use the steps above to exit the database repository

2.1 Creating a File resource library

The same way you created the database repository above, but you chose to create a file repository.

2.2 Under the file repository, create a DB connection to verify that it can be shared within the file repository

The answer is yes.

Iii. Requirements: Exporting tables from MySQL to txt files

In the Ldp_huyu database, there is a person table as follows

3.1 Creating conversions like

The configuration in which the table is entered:

Where the text file output is configured:

3.2 Run this conversion

Final Build File

Iv. Comparison of database resource library and file resource library

Use a database to manage, easier to cross-platform and share, but not as good at versioning as the file repository, and the database needs to go to the network, network connectivity anomalies can also lead to job failure

The trouble with using a file repository is the use of cross-platform, generic, and SVN-controlled tools.

Kettle's resource pool