OGG_Oracle GoldenGate three-step Extract/Dump/Relicat (case study), goldengaterelicat
Create By Bao
I. Summary
1. OGG is a data synchronization software, or logic replication software. Its competitors include ibm cdc, DELL shareplex, DSG, and DDS.
2. OGG software must be installed on the operating system. Oracle DB software does not have its own OGG software (at least currently)
3. The OGG software has three major processes (the four major processes can also be said ):
Three processes: Source extraction process, source transmission process, and target application process (namely, replication process)
Four processes: the source extraction process, the source transmission process, the target server process (responsible for writing the trail file to the target), and the target application process (namely, the replication process)
4. OGG software has two types of trail file
Source trail file: written by the source extraction process.
Destination trail file: the source transmission process is transmitted to the destination, and the destination server process is written to the specified path of the destination operating system.
5. All three processes in OGG software have their own checkpoints (I .e., checkpoints are used to record the locations where each process reads and writes)
Source extraction process: there are read and write checkpoints
Source transmission process: there are read and write checkpoints
Target application process: there is a read checkpoint
6. Three major OGG software processes the trail file:
Source extraction process: Read the oracle redo log (assuming that the source database is oracle), and convert the content in the redo log into a file in OGG's own format (that is, a trail file) in combination with the parameter file of the extraction process ), and write it to the specified path of the source operating system.
Source transmission process: read "The trail file written by the source extraction process", send the data to be synchronized to the target end in combination with the parameter file of the transmission process, the server process is responsible for writing data to the target end.
Target application process: Read the trail file in the specified path of the target operating system, combine the parameter files of the application process to form SQL statements, and execute these SQL statements on the target database.
Ii. Extract Process
Create Extract Process
Step 1. Add the extract Program
GGSCI (gavinprod.com) 51> add extract ext2, tranlog, begin nowEXTRACT added.
Step2. define the extract directory
GGSCI (gavinprod.com) 52> add exttrail /opt/oracle/ggate/dirdat/ld, extract ext2EXTTRAIL added.
Step3. define the extract Parameter
Edit params ext1
GGSCI (gavinprod.com) 19> edit params EXT2extract ext2userid ggate@gavinprod, password oracleexttrail /opt/oracle/ggate/dirdat/ldddl include mapped objname source_prod.*;table source_prod.*;
Iii. Dump Process
Create Dump Process
Step 1. Add the dump Program
GGSCI (gavinprod.com) 60> add extract dmp2,exttrailsource /opt/oracle/ggate/dirdat/ldEXTRACT added.
Step2. define the dump directory
GGSCI (gavinprod.com) 62> add rmttrail /opt/oracle/ggate/dirdat/ld, extract dmp2RMTTRAIL added.
Step3. define dump Parameters
GGSCI (gavinprod.com) 71> view params DMP2extract dmp2userid ggate@gavinprod, password oraclermthost odellprod.com, mgrport 7809rmttrail /opt/oracle/ggate/dirdat/ltpassthrutable source_prod.*;
Iv. Replicat Process
Create Replicat Process
Step 1. Add the replicat Program
GGSCI (odellprod.com) 8> add replicat rep2, exttrail /opt/oracle/ggate/dirdat/ld, checkpointtable ggate.checkpointREPLICAT added.
Step2. define the replicat Parameter
GGSCI (odellprod.com) 11> view params REP2replicat rep2ASSUMETARGETDEFSuserid ggate@odellprod,password oraclediscardfile /opt/oracle/ggate/dirdat/rep2_discard.txt, append, megabytes 10map source_prod.*, target target_prod.*;
V. Test
1. Create test data on the source data end
CREATE TABLE source_prod.bxj_test_ogg_dump( test_date DATE, test_description VARCHAR2 (100));INSERT INTO source_prod.bxj_test_ogg_dump VALUES (sysdate,'test goldendate data transfer by extract/dump/replicat');
2. Source Database, process and file
GGSCI (gavinprod.com) 17> info allProgram Status Group Lag at Chkpt Time Since ChkptMANAGER RUNNING EXTRACT RUNNING DMP2 00:00:00 00:00:07 EXTRACT RUNNING EXT1 00:00:00 00:00:08 EXTRACT RUNNING EXT2 00:00:00 00:00:06
2. Target Database, processes and files
GGSCI (odellprod.com) 6> info allProgram Status Group Lag at Chkpt Time Since ChkptMANAGER RUNNING REPLICAT RUNNING REP1 00:00:00 00:00:03 REPLICAT RUNNING REP2 00:00:00 00:00:03
3. Checkpoint table
Reference: shined-http://www.cnblogs.com/shined/archive/2012/07/12/2587648.html
Reference: msdnchina-http://blog.csdn.net/msdnchina/article/details/38347285