pentaho kettle

Before the tutorial starts, do some preparation work, look at the picture should know how to do it. This is the preparation for the kettle. 1: New file, size for 1000*1100. With a resolution of 300 pixels, pull the ellipse with the Ellipse tool and add two strokes below the ellipse. Only adjusts the three dots in the red circle, moving a few pixels each. 2: Enter the channel, perform the selected modifications-shrink. The shrinkage is 25. Reverse-S

Installation complete kettle, start spoon.sh times wrong as follows: [Root@kettle data-integration]#./spoon.sh org.eclipse.swt.SWTError:No More handles [Gtk_init_check () FAI LED] at Org.eclipse.swt.SWT.error (Unknown Source) at Org.eclipse.swt.widgets.Display.createDisplay (Unknown SOURCE) at Org.eclipse.swt.widgets.Display.create (Unknown source) at org.eclipse.swt.graphics.device.This is because the gr

Tags: oracle error message generation SQL statement blog Data Conversion 9.png1. System Version Information System:windows flagship Service Pack1 Kettle version:6.1.0.1-196 JDK version:1.8.0_72 2. Connect to the database This instance uses global variables when connecting to the database. 2.1 Create a new transformation: After spoon startup, click CTRL + N to create a new transformation 　　 2.2 In the new conversion interface, right click on the DB con

Tags: ETL KettleUse kettle to call the stored procedure, passing in parameter outgoing parameters.The contents of the stored procedure are as follows, mainly the return value of passing in a table name and a numeric type.You can then get the number of rows in the table.Createor Replace Procedure p_emp_cnt (t in Varchar2, Num out number) is v_sql Varchar2 (+); LV_CNT number; Begin Select Count (*) into lv_cnt from user_tables Where Upper (table_name) =

Use javascript steps and FIRETODB functions in kettle to define your own database queriesIf you need to implement non-traditional database query operations. To discuss this scenario, if you need to read the regular table in the database, then check the number of field match expressions for each row entered.Run a database query in a JavaScript stepWhen the JavaScript step is initialized, query the database. Gets the regular table-set of records. The in

In the daily development, in order to ensure the security of the account and password, passwords are often encrypted and decrypted. But how does the kettle encrypt and decrypt the password?The following code needs to be re -translated in JavaScript to run.var encrypted_password = ' not encrypted '; Encryption (called in JS):= "Encrypted" + Packages.org.pentaho.di.core.encryption.Encr.encryptPassword (clear_ password); command line generate password:

Demand:1. Do you encounter the need to migrate all the tables and data in the MySQL database to Oracle.2. Are you still using kettle to repeat the painting: Table input-table output, create TABLE, and worry.Here's a general set of database migration processes for you.Technical guidance:At the beginning of the implementation, a similar (samples\jobs\process all tables) was found in the example provided by kettle.Through the related transformation, fina

Tags: nbsp virtual machine selected will IMG Blog Font war TTLFirst, unpack the kettle package 1. Copy the package to the Linux system And the MySQL driver pack. 2, unpack the zip suffix package Input command:unzip/software/pdi-ce-7.0.0.0-25.zip You can delete the original package. Input command:rm-f pdi-ce-7.0.0.0-25.zip Ii. Creating databases and tables Inserting data from a text file into a database table 1, write good text file 2. Drag

Tags: TP server jump parsing BSP Bubuko ZIP compression TPS ODI infFirst, data integration business Scenario1.1 BackgroundBecause of a system of GA to adjust, resulting in the original from the system backup database obtained from the corresponding data resources can not be properly obtained, the subsequent data unified by the GA a system daily ztry photo data from the previous day is compressed and uploaded to the designated FTP server, need to download from the FTP, After decompression, the JP

This article describes one of the simplest examples of using kettle to get a preliminary look at the next conversion.The requirement is this:There is a local CSV file with the contents of the file as followsNow you need to save the data in the CSV to a local text file1. Create a transform and rename it2. Add an input component to read the CSV file3. Rename the component and make the component read the Student.csv file on the local file system, and fin

Kettle has a row-and-column conversion function in the control, but the row and column conversions seem to be reversed.I. Row to Column1. Database ScriptsCreate TABLEStudentinfo (Studentnoint, Subjectvarchar(Ten), Gradeint );Insert intoStudentinfoValues(201105545,'language', the);Insert intoStudentinfoValues(201105545,'Mathematics', the);Insert intoStudentinfoValues(201105545,'English', -);Insert intoStudentinfoValues(201105543,'language', -);Inse

Reprint: http://blog.itpub.net/post/37422/464323This step is used to merge data from two different sources, both old data and new data, which match, compare, and merge the old and new data according to the specified keywords.Parameters that need to be set:Old data source: Steps for old data sourcesNew data sources. Steps for new data sourcesFlag field: Sets the name of the Flag field, which is used to save the results of the comparison, with the following several results.1. "Identical" – Same ol

Kettle is an open-source ETL tool designed to transform data through a graphical interface. Well-designed files are divided into two categories, one is trans, and the other is job, which can be stored in the file system. can also be stored in a database. If you are storing to a database, you can create a configuration repository. Configuration steps Open the design tool Spoon.bat Click the plus sign Click Create or update Here we need t

In the process of creating the data Warehouse, you often encounter such problems, for example: the source table because of business reasons for the new field, and ETL program is extracted according to the previous source table structure, if you do not rebuild the ETL program, the new indicator will not flow into the DW, the problem is as shown inCreate a simple input and outputAs shown, there is a column3 field in the source table that is not matched to theHere we can open the SQL editor, look a

Here are 3 tables only the time dimension of different days-week, now need to add yesterday data daily into these 3 tablesBecause there will be returns in the business, and so on, it is necessary to first remove the original part of the data and then from that point in time to update.Days need to delete the first 7 days of data, weeks need to delete the first 2 weeks of data, the month need to delete data before 2 months to ensure accurate dataThe Execute SQL Script control is provided in

Kettle's idea is to write a text file with a specific format into an Oracle database table, For details, see the following operations: First, let's take a look at the content of the text file: 1 | test1 2 | Test2 3 | test3 Split by |. Procedure: Open kettle, create a new conversion, and drag out the following controls: Next we will look at the specific configuration of each space: 1. text file input Here we need to configure the following: Se

The configuration file Spoon.bat file needs to be modified. (1) Set PENTAHO_JAVA=JAVAW, change JAVAW to JAVA (2) @echo on Start "Spoon" "%_pentaho_java%"%opt%-jar launcher\launcher.jar-lib. \%libspath%%_cmdline% Delete Start "Spoon", The modified effect is @echo on "%_pentaho_java%"%opt%-jar launcher\launcher.jar-lib. \%libspath%%_cmdline% (3) If the Java.lang.OutOfMemoryError:Java heap space error is reported, it is still not possible to modify the Java virtual machine parameters. Delete the.

Tags: des blog http io ar strong for file dataDemand:1. A new record is added to the source database, and a new record is added to the target repository;2. The source database modifies a record, and the target library modifies the record at the same time;Example uses three kettle componentsThe following details the configuration of each componentSource:This example connects to a MongoDB database, four fields, the ID defaults to the primary key, and th

Type definitions between databases There's still a difference. It's a very wonderful question I met at work.tinyint types in MySQL are inserted into the tinyint type of SQL ServerThe specified type field (tinyint) value that is inserted into SQL Server is all 1Steps to resolve:1, in the DB connection there configuration database connection advanced-Support Boolean data type check to remove2, in the SQL to convert the corresponding field type, such as: Cast (seller_rate as Char) seller_rateThe ti

Label:Kettle Open Source ETL tool has its own metadata storage method, can be divided into two kinds of 1:file 2:db File storage I'm not going to say much here, let's talk about the problem of using SQLserver2008 R2 as a repository in the process of creation Kettle version:6.0.1 SQL Server Version:2008r2 Here's the point: 1: The data type error is reported when creating the repository, and some of the information created will appear to be unsuccessful