Vous êtes sur la page 1sur 5

3/24/2014 GoldenGate Tutorial 1 Concepts and Architecture Oracle DBA Tips and Techniques

http://gavinsoorma.com/2010/02/goldengate-concepts-and-architecture/ 1/5
GoldenGate Tutorial 2 Installation (Oracle 11g on
Linux)
Home Oracle GoldenGate an introduction
GoldenGate Tutorial 1 Concepts and Architecture
GoldenGate enables us to extract and replicate data across a variety of topologies as shown the diagram below as well
as the exchange and manipulation of data at the transactional level between a variety of database platforms like Oracle,
DB2, SQL Server, Ingres, MySQL etc.
It can support a number of different business requirements like:
Business Continuity and High Availablity
Data migrations and upgrades
Decision Support Systems and Data Warehousing
Data integration and consolidation
Let us know look at the differents components and processes that make up a typical GoldenGate configuration on
Oracle.
3/24/2014 GoldenGate Tutorial 1 Concepts and Architecture Oracle DBA Tips and Techniques
http://gavinsoorma.com/2010/02/goldengate-concepts-and-architecture/ 2/5
(source: Oracle GoldenGate Administration Guide)
Manager
The Manager process must be running on both the source as well as target systems before the Extract or Replicat
process can be started and performs a number of functions including monitoring and starting other GoldenGate
processes, managing the trail files and also reporting.
Extract
The Extract process runs on the source system and is the data caoture mechanism of GoldenGate. It can be configured
both for initial loading of the source data as well as to synchronize the changed data on the source with the target. This
can be configued to also propagate any DDL changes on those databases where DDL change support is available.
Replicat
The Replicat process runs on the target system and reads transactional data changes as well as DDL changes and
replicates then to the target database. Like the Extract process, the Replicat process can also be configured for Initial
Load as well as Change Synchronization.
Collector
The Collector is a background process which runs on the target system and is started automatically by the Manager
(Dynamic Collector) or it can be configured to stsrt manually (Static Collector). It receives extracted data changes that
are sent via TCP/IP and writes then to the trail files from where they are processed by the Replicat process.
Trails
Trails are series of files that GoldenGate temporarily stores on disks and these files are written to and read from by the
Extract and Replicat processes as the case may be. Depending on the configuration chosen, these trail files can exist on
the source as well as on the target systems. If it exists on the local system, it will be known an Extract Trail or as an
Remote Trail if it exists on the target system.
Data Pumps
Data Pumps are secondary extract mechanisms which exist in the source configuration. This is optional component and
if Data Pump is not used then Extract sends data via TCP/IP to the remote trail on the target. When Data Pump is
configured, the the Primary Extract process will write to the Local Trail and then this trail is read by the Data Pump and
data is sent over the network to Remote Trails on the target system.
In the absence of Data Pump, the data that the Extract process extracts resides in memory alone and there is no storage
of this data anywhere on the source system. In case of network of target failures, there could be cases where the primary
extract process can abort or abend. Data Pump can also be useful in those cases where we are doing complex filtering
and transformation of data as well as when we are consolidating data from many sources to a central target.
Data source
When processing transactional data changes, the Extract process can obtain data directly from the database transaction
logs (Oracle, DB2, SQL Server, MySQL etc) or from a GoldenGate Vendor Access Module (VAM) where the database
3/24/2014 GoldenGate Tutorial 1 Concepts and Architecture Oracle DBA Tips and Techniques
http://gavinsoorma.com/2010/02/goldengate-concepts-and-architecture/ 3/5
logs (Oracle, DB2, SQL Server, MySQL etc) or from a GoldenGate Vendor Access Module (VAM) where the database
vendor (for example Teradata) will provide the required components that will be used by Extract to extract the data
changes.
Groups
To differentiate between the number of different Extract and Replicat groups which can potentially co-exist on a system,
we can define processing groups. For instance, if we want to replicate different sets of data in parallel, we can create two
Replicat groups.
A processing group consisits of a process which could be either a Extract or Replicat process, a corresponding
parameter file, checkpoint file or checkpoint table (for Replicat) and other files which could be associated with the
process.
Coming Next! Oracle GoldenGate Installation demo ..
Ask me now!
I'm a database wizpert
February 8th, 2010 | Category: GoldenGate
16 comments to GoldenGate Tutorial 1 Concepts and Architecture
jason
April 22, 2010 at 6:41 pm
Thank you f or your Tutorial about goldengate
Walter
July 30, 2010 at 1:25 am
Thanks. This inf o is well written.
Joshua
August 25, 2010 at 4:24 am
Good Job.
Well done. many Thanks
ATP
September 15, 2010 at 2:16 pm
Hi ,
can you please explain the trail f ile storage mechanism, suppose im going to create a trail f ile with size of 500Mb , i would like
to know
1. how much rows GG can store in the 500Mb of trail f ile.?
Gavin Soorma
September 22, 2010 at 11:01 pm
Not sure if I can understand what your question is why would you worry how many rows f its in one trail f ile when the
trail f ile f ills up it will create another one and so on
Gavin Soorma
October 19, 2010 at 1:39 pm
Hi which tutorial do you need?
3/24/2014 GoldenGate Tutorial 1 Concepts and Architecture Oracle DBA Tips and Techniques
http://gavinsoorma.com/2010/02/goldengate-concepts-and-architecture/ 4/5
Abood
October 19, 2010 at 2:49 pm
Many thanks f or such great job keep it up.
Pralay
October 22, 2010 at 8:44 am
Great inf ormation on GoldenGate
Highly appreciate you sharing your experience and various scenarios
Thank You.
Suman Das
January 27, 2011 at 5:33 am
Gavin Sir, Thank you f or providing such interesting topics on ORACLE. Enjoyed lot reading these. Can you please provide
ORACLE RAC concept, architecture and all of its services in very simplif ied version.
Thank you.
Jagan
January 31, 2011 at 10:22 pm
Hi Gavin
Is it possible to join two source tables and the result set will be insterd in the target table as part of data extraction and
delivery?
pankaj
March 9, 2011 at 12:19 am
Hi Gavin,
1st of all thanks a lot f or sharing such valuable docs. I want some clarif ication regarding the replicate process which i
conf igured in my target server. Whenever I am trying to start the process its giving replicate is starting however when i check the status its
showing replicate is stopped.I am not getting the updated data in the scott.emp table of my source database.
I f ollowed all your installation and manager conf iguration steps. Its conf igured properly but f ailing at the end.
Please suggest.
Thanks,
Pankaj
Elven
March 15, 2011 at 5:27 pm
Golden Gate can replicate MySQL ? how GG to do it ? as I know MySql doesnt have LOG f ile like a database such as Oracle,
DB2 etcPlease let me know how GG works, thanks
Gavin Soorma
March 16, 2011 at 11:26 am
Hi have a read of the Goldengate f or MySQL Installation guide ..
http://download.oracle.com/docs/cd/E18101_01/index.htm
girish
May 25, 2011 at 1:16 pm
Hi Gavin,
Nice explanation f or the beginners who wants to know the concept of the Golden Gate.
3/24/2014 GoldenGate Tutorial 1 Concepts and Architecture Oracle DBA Tips and Techniques
http://gavinsoorma.com/2010/02/goldengate-concepts-and-architecture/ 5/5
Thanks,
Girish
pabitra
May 25, 2011 at 2:54 pm
Thanks..very helpf ul
Arindam
June 11, 2011 at 4:21 am
Just exactly what I was looking f or Thanks Gavin.

Vous aimerez peut-être aussi