ODI Incremental update policy

Source: Internet
Author: User

Incremental update policy: Data consolidation with a "update key" comparison of flow data records compared to records in the target table. Records with the same "update key" will be updated when the associated columns are not, and records that do not exist in the target table will be inserted. This method is used to manipulate the recorded changes when no recording is required.

IKM compares records differently by using a method that is oriented to SQL programming instead of comparing rows by row-by-record comparisons. The most common approach to this strategy is to integrate the converted data into the i$ table, in the following steps:
① Create the i$ table and add a column called Ind_update to identify the record asis insertedStill isbe updated;
② inserts the stream data into the i$ table, all the source data is converted and inserted into the i$ table, and the ind_update is set to "I";
③ if "Recycle errors" is selected in the interface, the rejected record is added;
④ call CKM for data quality check;
⑤ Update the Ind_update column of the i$ table if the record with the same update key as the target table is marked as "U";
⑥ updates the record in table i$ ind_update to "U" again, if the column values of these records are the same as the target table, Ind_update is set to "N", then the following records are included in the i$ table:
·“ I "These records will be inserted
·“ U "These are updated
·“ N "These records are ignored
⑦ Update the target table with the records "U" in the i$ table;
⑧ uses the record of "I" in the i$ table to insert the target table.

Note:The update key must be unique, and in most cases the primary key can be used as the update key. If the primary key is a surrogate key (automatically updated), in this case the source-based column is used as the update key.
Steps to IKM Incremental update:
①create The flow table in the staging area
②determine to update (using the update key)
③determine what shouldn ' t is updated by comparing the data
④update the target with the existing records
⑤insert new records

ODI Incremental update policy

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.