A preliminary understanding of Oracle Goldengate and Oracle Data Integrator

Disclaimer:
Some of the images used in this article come from the Internet. If there is any infringement, contact the blogger to delete them.


1. What is Oracle Glodengate?

GoldenGate is an oracle data synchronization software based on database logs. It parses online logs of the source database or archive logs to obtain the addition, deletion, and modification of data, then, all or part of these changes are applied to the target database to achieve real-time synchronization between the source database and the target database.

GoldenGate can implement Sub-second-level real-time replication of large amounts of data between heterogeneous IT infrastructure (including almost all common operating system platforms and database platforms.

GoldenGate works as follows:

GlodenGateThe main advantages include:

1.High performance:Non-Intrusive design and underlying data transmission enable sub-second-level data latency

2.Flexible Scalability:Open and modular structure, supporting heterogeneous source and target terminals.

3.Reliability:Resumable data transfer is supported through transaction sequence commit, reasonable checkpoint mechanism, and reliable data transmission mechanism, ensuring data integrity and reliability.

GlodenGateThe main concerns are:

1. To achieve data synchronization, you must install GoldenGate media on the source and target databases respectively. In some data integration environments, the source database may be restricted.

2. To support GoldenGate, you need to set parameters for the source database (for example, to enable archiving logs and to enable the minimum append log mode, these settings are basically configured in the database of the production database by default ).

GlodenGateMain application scenarios include:

1. Real-time disaster recovery for databases.

2. Data extraction during data integration (depending on its reliability ).

2. What is Oracle Data Integrator?

Oracle ODI is a data extraction/Data Conversion Tool designed with the concept of E-LT (Extract, Load & Transform, that is, extraction, loading, and conversion. It is mainly used for data cleansing and processing, especially for data integration projects and BI project source data extraction.

Main advantages:

1. Support for Heterogeneous Data: when the data source or target is not an Oracle database, ODI can generate native SQL statements for that data source.

2. Real-time Data Integration Environment: ODI supports CDC (Change Data Capture) to complete near-real-time Data integration.

3. the data extraction and integration process can be integrated with SOA. ODI itself provides the call web service mechanism, and the ODI interface can also be exposed as webService to interact with the SOA environment.

Main problems:

1. data resumable data transfer is not supported. Therefore, other methods (such as OGG) are used for large-scale data integration, especially for long-distance data integration) to ensure data integrity and reliability.

3. What are the roles of OGG and ODI in large-scale data integration projects? Available Modes

1. Simple mode, using ODI directly for Data Extraction

Advantages:

1. Simple deployment, suitable for small-range data integration.

2. Use OGG and ODI for data extraction.

Advantages:

1. Use the OGG module to import data from various business systems

4. References:

1. zhoujiongfield's summary document on using GlodenGate a while ago

 

 

Author: sdjnzqr
Source: http://www.cnblogs.com/sdjnzqr/
Copyright: The copyright of this article is shared by the author and the blog
Reprinted: you are welcome to repost the statement, but this statement must be retained without the consent of the author; the original article must be connected; otherwise, the legal liability must be investigated.