OGG components:
- Manager: Start Other processes
- Collector
- Extract
- Data Pump: Optional process, recommended use
- Replicat
- Trails: can be compressed, encrypted
- Checkpoint
Ogg Process Group
- Process Group:
- Process
- Parameter FILE:DIRPRM
- Checkpoint File:dirchk
- Additional Files: dirrpt (report file:. Rpt and Discard file:. DSC ogg12c Auto-created), Dirdef,dirpcs (Process run Status: Pcm-manager, Pcr-replicate,pce-extract )
- Each process group is named unique: case blending is not recommended, Linux may be abend, and group is not recommended to end with a number.
Ogg Common directives:
- Ggsci:
- Obey
- Help <command> <object>
- !: repeatedly executes the previous command
- Shell <os command>
- View ggsevt (for Ggserr.log file content, remember to clean up regularly, do not delete files directly. )
- History
- Stats
- Send
- Kill
Common Goldengate directives:
- Add Trandata vs Add schematrandata
- Add Trandata: Trandata information is not automatically updated (Create table,update additional log column information, etc.)
- Add schematrandata:
command format: add schematrandata <, schemaname> (do not use Schemaname.* exec Dbms_goldengate_auth.grant_admin_privilege (' goldengate '); check if enable: Query select * from table (Logmnr$always_suplog_columns (' Schemaname ' ); Info Trandata cannot be queried. Dba_log_groups and Dba_log_group_columns have no information
- CONVCHK: Convert checkpoint files to a new version
- Defgen: When the source and target libraries are different types of databases, the definition of heterogeneous data is generated
- Keygen: Generate an encrypted key
- Extract:extract parameterfile <path> reportfile <path>
- Replicat:replicat parameterfile <path> reportfile <path>
- Oggerr: Query ogg error number, such as: Oggerr 1738
Goldengate directory structure:
| Directory |
Description |
| Br |
Bounded recover needed checkpoint files |
| Cfg |
Configure the property and XML files required for OGG monitoring |
| Dirchk |
The checkpoint file created by the Extract or replicat process. CPE and CPR Suffixes |
| Dirdat |
Default storage location for trial files, 2 user-defined characters + 6 digits |
| Dirdef |
Heterogeneous data definition file, generated by Defgen |
| Dirjar |
OGG Monitor-related jar packages |
| Dirpcs |
Process Status File |
| Dirprm |
Parameter file |
| Dirrpt |
Storage directory for process reports |
| Dirsql |
SQL script |
| Dirtmp |
Temporary storage directory for transactions exceeding allocated memory |
Golden Gate parameter file:
- Global (Globals file)
- Check Point table information: Checkpointtable goldengate.checkpoint
- DDL: File information: Ggschema goldengate
- Windows environment Registration MGR Services: Mgrservname ggmgr
- ggsci> Install AddService addevents
- Process parameter: DIRPRM/*.PRM
- Mgr Parameters:
- Port:mgr Listening Port
- Dynamicportlist: The port range of the actual worker process used to receive data sent by the extract process.
- Autostart:mgr which processes start automatically at startup
- AutoRestart: In the case of a process failure, MGR can attempt to restart those processes, specifying the number of retries and the time interval
- Lagcritical: Delay More than this time is a serious error, write an error message inside the Ggserr.log
- Laginfo: If the delay reaches this time value will write an info message in Ggserr.log
- Lagreporthours: Check the frequency of lag (here is the hour, also can lagreportminutes)
- Purgeoldextracts: The policy for automatically deleting obsolete queues. It is recommended that you use relative or absolute paths uniformly.
- Extract parameters:
- Extract Group Name
- Trial file information (Rmthost, Rmttrail, Exttrail)
- Tables that need to be copied or excluded (tables, tableexclude)
- Whether to specify column information
- Which operations to extract (Getupdates)
- What to capture (Getupdatebefores | Ignoreupdateafters)
- You can specify filtering, mapping, converting
- General Default Minimalist parameters:
- All DML operations are captured:
- Capture only commit operations
- Insert operation: Full post mirror
- Update operation: Append log columns and modify columns, do not capture pre-update mirror values
- Delete action: Additional log columns
- Do not convert
- Cachemgr parameter control: 64bit default maximum can be used to 64g, so to control, otherwise memory consumption is too large: cachemgr cachesize 2048M, cachedirectory./dirtmp 4GB, Cachedirectory ./DIRTMP2 4GB
- BR: Default 4 hours. BR Brinterval 20M, brdir br (20M means check interval is 20 minutes): Scene: Long transaction is not finished, log file is deleted, no need to restore log file, after receiving commit, write to trial file directly from file in BR directory.
- Two extraction modes:
- Classic: Extract based on an online log or archive log. No special requirements for database version
- Consolidation: (11.2.1 or more)logmining Server is responsible for capturing data changes from the database log in the LCR format, and the extract process then stores the data in the trail file. Logical Change Records
- Benefits of the integration model:
- More data types are supported on compatibility (IOT, compression, XML, LOB)
- No additional configuration required for RAC, ASM, TDE, Rman
- Multi-threaded extraction (producer Thread:capture Redo;consumer thread:process Redo), the performance of the concurrent processing process improves.
- OGG12C capture of Oracle 12c Multi-tenancy (must be integrated with extraction mode to support)
- DDL without Trigger (OGG12C, DB11204)
- It's closer to the database engine!
- Integration Mode Deployment Method:
- Local deployment: Source and log Mining server databases are the same database (source and integration extraction processes on the same host)
- Downstream deployment: Source and log mining server databases are different databases (source libraries deliver archived logs to downstream databases) (source and integration extraction processes are not on the same host)
Golden Gate Related Components Description: