Zero Downtime

with Oracle GoldenGate

Paul Steffensen
1
 Wide Awake and Zero Downtime!

Meet
Swaroup Anand
who lives in
Bangalore

http://www.dailymail.co.uk/health/article-1250507/Eyes-Wide-Open-Patient-open-heart-surgery-awake.html 2
 CX and the Disappearing Batch window

The Customer Experience Revolution

Source: Dr. Elizabeth B. N. Sanders 1992 Masters Paper

3
 The Disappearing Batch Window

Increasing
expectation of
application
availability
Ever increasing
data volumes

So much data, so little time

4
Paul Steffensen

Problem solver and pragmatic

DBA
25+ years as an Oracle DBA
NZs only certified GoldenGate
Implementation Specialist
Director and Senior
Consultant, Enterprise IT Ltd
Linkedin:
nz.linkedin.com/in/uptimedba

5
Enterprise IT

100% Kiwi owned Est. 2005

Strong Oracle background
Services
Cloud Services
Database
Facilities Management
Linux and Solaris

6
How does Enterprise IT do IT?
I.T. right first time
Culture
Are we adding value? drives our culture
Consistency in communications and way we operate
Service Focus
Build Trusted Advisor Partnerships with Clients
Developing a Thought Leadership Position in our
Sector
High Professional Standards
Best Practice standards and procedures, ITIL

7
What else do I do?

8
What is Oracle GoldenGate?

Oracles strategic solution for real

time data integration.

What does that mean?

9
 Where did GoldenGate come from?

GoldenGate Software Inc. founded in 1995

The need to improve operating performance

in a global 24x7 environment has led to the
need for data integration to support real-
time and high availability capabilities..

Hasan Rizvi, senior vice president Oracle Fusion

Middleware Product Development in 2009.

10
 What makes GoldenGate so good?
Whats all the fuss about.
Performance
Low Latency
Low Impact

Flexibility
Open, Modular Architecture
Heterogeneous

Reliability
Transactional Integrity
Resilient

11
 What can GoldenGate do?
Unidirectional Bi-Directional Peer-to-Peer
Query Offloading or Live Standby or Load Balancing,
Upgrades/Migrations Active-Active Multi-Master

Broadcast Integration/Consolidation Cascading

Data Distribution Data Warehouse Data Marts

12
 What can GoldenGate be used for?
Disaster Recovery, Data
Protection
Standby (Open & Active)

Zero Downtime Migration

New Database
and Upgrades

Operational Reporting &

Log Based, Real-
Time Change Data Query Offloading
Capture
GoldenG
Reporting Database
ate
ETL

ODS EDW
Real-time BI
ETL

Heterogeneous Data Warehouse

Source Systems Event Driven
Legacy Systems JMS Queue Architecture, SOA
Java Message Bus
Enterprise Data
Synchronization Distribution

13
Where can I run GoldenGate?
Databases Operating Systems
Oracle (from 8i) Linux
DB2 Solaris v11
Microsoft SQL Server Windows 2000, 2003, XP
Sybase ASE HP-NonStop
Teradata HP-UX
MySQL v 5.5 IBM z Series
JMS message queues IBM AIX v7.1
Enscribe IBM i Series
Postgres (delivery)
SQL/MX

14
 How
How does
does GoldenGate
GoldenGate work?
work?
Capture: Committed changes are captured (and can be filtered) as they occur by reading the transaction
logs.
Trail files: Stages and queues data for routing and can be encrypted.

Pump: Distribute data for routing to one or multiple targets.

Route: Data can be compressed and encrypted for routing to

targets.
Delivery: Applies data with transaction integrity,
transforming the data as required.
Source Target
Databas Database
Source TCP
TCP /IP
/IP
e Trail Files
LAN
DB Log LAN // WAN
WAN // Target
Trail Files
Pump Internet DB
Capture Internet Delivery
Client
Library

DB Client
Delivery Bi-directional Pump DB Log
Library
Capture

Diagram courtesy Oracle Corporation

15
How Do I Manage it?

Management Pack for GoldenGate

Oracle GoldenGate Monitor for monitoring

GoldenGate implementations. Includes a plugin
for Enterprise Manager 12c

Oracle GoldenGate Director for managing

GoldenGate components.

16
How Do I Know Its Working?

Oracle Veridata
High speed, low impact comparison solution

17
New Features in the latest Version

11gR2 (11.2.1.0.5)
Integrated Capture
Improved Conflict Detection and
Resolution
Globalization
Security and Performance
Manageability and Monitoring
Additional platforms/databases
Support for new Oracle applications

18
Conflict Detection and Resolution

What happens if a row that was inserted in the

Customers table already exists in the target
database?

In the event of a new Customer record already existing in the target

database, overwrite that record with the data from the source table.

MAP source.customers, target.customers,

RESOLVECONFLICT(INSERTROWEXISTS, DEFAULT, OVERWRITE);

19
Migration Case Study
GoldenGate in Action!

20
Our Clients Problem
Providing a robust and reliable service to its customers

Major player in NZ but small player in the

World
Forrester Research has identified that
Commoditisation has stripped away most
sources of differentiation and Customer
Experience is what is left
Brand value a priority and client constantly
measuring Cx for eg with Net Promoter Score
(NPS)

BUT...... 21
Our Clients Problem

Hardware lacked HA ability and limited DR

capability
Older software versions lacked functionality
Ability to provide a robust and reliable service
to its customers was at risk
Priority 1 and 2 applications demanded little or
no downtime

22
Enterprise ITs Problem
We had to do 4 days of work in 30 minutes!

To perform a cross platform migration

and upgrade
Very limited downtime allowed
350+ Gb of data to move in less than
half an hour

23
Our Professions Challenge

There is now a real business

requirement to maintain
application service levels
during operations on
applications and their
supporting infrastructure that
would in the past have meant
a system outage.

24
Why we used Oracle GoldenGate?

Heterogeneous, cross-platform, cross-version

Performance: Real time, Sub second latency
Efficient: Non-intrusive, Low impact
Flexible
Robust
Reliable

At the time, no other viable alternative

25
Our problem solving strategy

Needed a solution for more than this application

Documented generic procedure that could be handed
over to implementation teams for other applications
K.I.S.S.

26
Migration Implications
Everything Changes yet Nothing Changes

Source Platform Target Platform

Solaris8 (Sparc) Linux 2.6 (Intel)

Single Instance Oracle RDBMS Oracle 4 node RAC Cluster

Oracle 9i (9.2.0.7) Oracle 10gR2 (10.2.0.5)

7 bit character set (US7ASCII) Multi-byte Unicode character set

Standalone database Consolidated database

27
The Solution Design

Implement GoldenGate to capture changes made in

the source database
Use Export / Import to perform the initial load of the
new database
Use GoldenGate to update the new database and
keep it synced
Perform switchover at a chosen time in a controlled
fashion

28
The Solution Implementation
Time in the Operating Theatre

Sunday 6th November 2011 10:00pm to 11:00pm

10:00 Shut down application

10:05 GoldenGate switchover to the new database
10:10 Perform audit counts between old and new
10:20 Start up application for testing
11:00 Make application available to the public

29
A Great Result

Clients challenge was to increase the robustness of

their service to its customers
Enterprise ITs challenge was to make this happen
with little or no impact to the service it was improving
Oracle GoldenGate provided the solution

30
Return on Investment
Getting bang for your buck

Increased service availability during the operation

Increased HA and DR position
Absolutely no issues post-migration
Performance and reliability improvements

31
GoldenGate Alternatives?
Is there anything else that will do the job?

DIY scripts
Active Data Guard
Oracle Streams
Dbvisit Replicate

32
 GoldenGate Resources
Lots of information out there
Oracles GoldenGate Home Page
http://www.oracle.com/us/products/middleware/data-integration/goldengate/overview/index.htm
GoldenGate Forum
https://forums.oracle.com/forums/forum.jspa?forumID=860
Oracles My Support Community Page
https://communities.oracle.com/portal/server.pt/community/goldengate%2C_streams_and_distributed_database/410

Oracle Documentation and Books

http://www.oracle.com/technetwork/middleware/goldengate/documentation/index.html
Linkedin
http://www.linkedin.com/groups?gid=1784310
Many Blogs

33
A solution to other problems?

34
Questions?

35
paul.steffensen@enterpriseit.co.nz
nz.linkedin.com/in/uptimedba

36