On the usage and function realization of Transformer Stage in DataStage operation

Introduction of product background

IBM Infosphere DataStage is the industry's leading ETL (Extract, Transform, Load) tool that uses the Client-server architecture to store all of the project and metadata on the server side, It also supports the collection, integration, and conversion of large amounts of data in a multiple structure. The client DataStage Designer provides a graphical development environment for the entire ETL process, and the user designs and develops the DataStage Job in Designer. DataStage provides a number of process processing Stage to meet the needs of ETL, however, Transformer Stage in these Stage use and use of the most extensive, this article will Transformer Stage in the process of ETL usage and implementation of Features are described in detail. In this article, IBM Infosphere DataStage is involved in the IBM Information Server 8.0.1 version.

Introduction to Transformer Stage components

Transformer Stage is an important, powerful component in DataStage, and it assumes responsibility for "T" (i.e., data transformation) in the ETL process. In Transformer Stage, you can specify the source and destination of the data, match the corresponding input and output fields, and specify the conversion rules and constraints.

Figure 1. Application of Transformer Stage in DataStage job

Figure 2. Transformer Stage column mappings and field expressions

The function and case analysis of Transformer Stage in DataStage job

1. Field Conversion

Field conversion is one of the most common features of Transformer Stage, which transforms the source data into target data according to certain specifications. The following is an example of how the transformation of a field is implemented by using Date and Timestamp that are more common in the ETL process.

1.1 Source data type is Timestamp, target type is Date

Listing 1. Time conversion function

Timestamptodate (in. Add_date)

Figure 3. Field Transformation expression

Figure 4. Contrast before and after field conversions

See more highlights of this column: http://www.bianceng.cnhttp://www.bianceng.cn/Programming/extra/