Oracle Golden Gate-Concepts and mechanisms

Oracle Golden Gate-Concepts and mechanisms (OGG)
Golden Gate (OGG) provides real-time capture, transformation, and delivery of transaction data in heterogeneous environments.

The heterogeneous environments supported by OGG are:

Features of Ogg:
Small impact on the production system: real-time read transaction log, with low resource consumption to achieve large transaction volume data real-time replication, the transaction as a unit copy.

Guaranteed Transaction Consistency:
Synchronize only committed data

Performance:
Intelligent transaction reorganization and operation merging
Accessing using the Database local interface
Parallel processing System

Flexible topologies:
Support for a pair of one or one-to-many, many-to-one, many-to-many and bidirectional replication
Supports data filtering and conversion
You can customize filter rules based on tables and rows.
You can perform flexible innuendo and transformations on real-time data.

Provides data compression and encryption:
Reduce the bandwidth required for transmission and improve transport security.

How OGG works:

The process of Ogg:

The manager process is a goldengate control process that runs on both the source and target sides. It mainly functions in the following aspects: Start, monitor, restart other processes of goldengate, report errors and events, allocate data storage space, publish threshold report, etc. There is only one manager process on the target side and the source side

Extract runs on the source side of the database and is responsible for capturing data from the source-side data tables or logs.
The role of the extract can be divided into stages as follows:
One initial time load stage: During the initial data loading phase, the extract process extracts data directly from the source-side data table
Two-sync change capture phase: After initial data synchronization is complete, the extract process is responsible for capturing the source-side data changes (DML and DDL)

The data pump process runs on the source side of the database, which is often recommended as a local trail file generated by the source, sending the trail as a block of data through the TCP/IP protocol to the target. Pump process essence is a special form of the extract process, if the trail file is not used, then the extract process is delivered directly to the target side after extracting the data, and a remote trail file is generated.

The collector process is called the server collector process that corresponds to the data pump process, and this process does not need to cause my attention because it is transparent to us because it does not require us to configure it in the actual operation. It runs on the target side, and the task is to reassemble the data sent by Extract/pump into a remote trail file.

Replicat process, we also call it the application process. Running on the target side is the last station of data delivery, which reads the contents of the target Trail file and resolves it to a DML or DDL statement and then applies to the target database.

Trail file on Ogg:
For more efficient and more secure delivery of database transaction information from the source side to the target. Goldengate introduced the concept of trail file. As mentioned earlier, when extract extracts the data, Goldengate will convert the extracted transaction information into a goldengate proprietary format file. Then the pump is responsible for delivering the trail file from the source to the target, so the source and target will have this file at either end.

The purpose of the trail file is to prevent a single point of failure, persist transactional information, and use the checkpoint mechanism to record its read-write location, and if a failure occurs, the data can be re-transmitted according to the location of the checkpoint record.

Oracle Golden Gate Software is a log-based structured data replication backup software that enables the source database to synchronize with the target database by parsing the source database online logs or archive logs for incremental changes to the data, and then applying those changes to the target database. Oracle Golden Gate enables a large number of data sub-second real-time replication between heterogeneous IT infrastructures, including almost all common operating system platforms and database platforms, in order to be available in emergency systems, online reporting, real-time Data Warehouse provisioning, transaction tracking, data synchronization, centralized/distributed, Disaster recovery, database upgrades and porting, dual-service centers, and more. At the same time, Oracle Golden Gate can be a one-to-one, broadcast (a-to-many), aggregation (many-to-two), bidirectional, point-to-point, Cascade, and many other flexible topologies.

Oracle Golden Gate-Concepts and mechanisms