Enterprise Manager Snap Clone

Snapshot your data without snapping your storage

Subhadeep Sengupta
Principal Product Manager
Bala Kuchibhotla
Senior Director of Development
September 2014
Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and timing of any features or
functionality described for Oracles products remains at the sole discretion of Oracle.

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Session Abstract
CON8122
Are database refresh challenges causing you to miss projects deadlines? Is your storage
cost for dev/test environments spiraling out of control? In this session, you will learn
how the Snap Clone feature of Oracle Cloud Management Pack for Oracle Database

Can refresh production databases after masking and subsetting

Can enable instant cloning of large databases (TBs) while saving more than 90 percent
on storage costs
Fits perfectly with your existing investments in storage, servers, and engineered systems
Is being used by other customers for large-scale environments

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Program Agenda
1

Current Challenges

EM 12c Solution

Summary

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

A Large Financial Institution Storage Challenges

SPARC

Oracle DB
Size

Very Small (less < 1 TB)

Small (1TB to 5TB)
Medium (5TB to 10TB)
Large (10TB to 15TB)
Very Large (>15TB)

Total:

Number
x86
of
Applications
1,400
500
75
25
20

Average
DB Size
(GB)

Average
Number of
Non-prod
Environments

300
3,000
7,500
12,500
20,000

5
5
7
7
7

2,020

5 to 7 non-prod clones per production database

18 of 30 PB for non-prod Oracle environments
$122M of $198M for non-prod clones

Storage Team: We haveEstimated

50 PB SAN. Annual OP
Ave
Annual growth has ranged from
Estimated
1 - 20-35%
3 Years

Storage (GB) Non Production

Applications Team: 1300 Apps
Environments
Requirements
are utilizing private Cloud

Per En
Per A

2,100,000
$13,860,000
7,500,000
$49,500,000
Database
Team:
delivering
3,937,500
3 5$25,987,500
Years
test
data for UAT is a focus
for private Cloud
2,187,500
$14,437,500
this
year
2,800,000
$18,480,000

$
$
$
$

18,525,000

$122,265,000

Storage Cost / GB = $6.6/year

Estimated Annual Storage OPX
Cost $198M/year for Oracle
Environments

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Process Challenges
60000

RMAN

refresh/year

full clones

2000+

10 - 20

Dev/Test DB

3 5 TB
Typical DB size

Database Refresh
is a
necessary evil!

issues/day

EMC & NetApp

storage

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

- Christian Bilien,
Global Head of
Database Team

Evolution of Solutions

Point Features
Storage level:
snapshot,
volumn/lun thin
clone, dedupe,
compression, etc
Lacked DB or
application context
Does not solve
process problem

Point Tools
VM cloning
DB cloning using
smart file systems
Limited focus on
just cloning

Lacked lifecycle
management of
clones

EM Solution
Technology
agnostic
End-to-End
automation from
prod to test/dev

Designed for DBAs

Complete mgmt of
clones - masking,
performance,
patch/upgrade, etc

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

EM Solution Data Lifecycle Management (DLM)

Supports full and thin database clones
Technology Agnostic
End-to-End Automation Prod to Test/Dev
Designed for DBAs
Integrated Masking, Subsetting, Patch, etc
Available via Admin Flows and Self Service portal

EMCLI and REST API for integrations

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Strong Investment in EMs Data Cloning Solution

EM 12c R2

Snap Clone for

NAS storage
NetApp & Sun
ZFSSA
RMAN backup
based clones
Snap Clone
Analyzer to show
storage savings

EM 12c R3

Snap Clone using

Solaris File System
(ZFS)
Snap Clone for PDBs
(Admin Flows)

EM 12c R4

Snap Clone using

CloneDB
Data Guard Standby
as a Test Master
NetApp Ontap 8.x
cluster mode
Certification for Engg
systems, I/O over IB
Support for NFSv4

EM 12c R4+

Data Lifecycle Management

Snap Clone using EMC SAN
and ASM
Admin flows for test master
creation
Integration with masking,
patching, upgrades, etc

Copyright 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential Internal

Technology Agnostic
Data Lifecycle Management

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Supported Cloning Options

Full Clones

Snap (Thin) Clones

Software Solution [Vendor Agnostic]

Database Native [Storage Agnostic]

RMAN
Restore

RMAN
Duplicate

Data Pump

Hardware Solution [Vendor Specific]

Leverage your existing investments

Cater to both functional and stress testing needs
Maximize for best performance

NAS

Use Snap Clone whenever you need >1 clones!

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

SAN

Snap Clone using Solaris File System (ZFS)

Uses a single stock Solaris 11.1+ image physical or virtual [and NOT the
Sun ZS3 Appliance ]
Supports any storage type NAS or SAN
For SAN, mount LUNs as raw disk and format with ZFS filesystem
Does NOT require the snapshot/clone licenses from the storage vendor,
these features are available for free
Additional features include compression, de-duplication, IO caching, etc
HA has to be handled externally either via Solaris Clusters, or by using HA
features of the underlying hypervisor

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Solaris File System with SAN Storage Network Diagram

Copyright 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential Internal/Restricted/Highly Restricted

13

CloneDB using DNFS

Ability to create thin databases from Advantages
RMAN image copies
Easy to setup
Uses NFS v3 client embedded in
database
Supported configurations
Single instance databases
Note: Only file system support for this
setup (No ASM)

Supported Versions: 11.2.0.3+, 12.1

No special storage software needed

Works on all platforms
Time efficient: Instantaneous cloning
Space efficient: Create multiple clones
based on one backup
Uses dNFS to improve performance,
high availability, and scalability of NFS
storage

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Snap Clone on ASM + EMC Storage

Ability to create live thin clones of
databases on ASM
Live Clone: NOT snapshot based, but
a live clone of DB
Clone can be within the same or on
a different cluster
EMC VMAX (with Time Finder
VPSnap) and VNX storage appliances
Supported configurations: SI and
RAC
Supported Versions: DB = 10.2.0.5 or
higher; GI = 11.2 and higher

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

End to End Automation

Data Lifecycle Management

Copyright 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential Internal/Restricted/Highly Restricted

16

Data Movement
Production
Database
NAME

SSN

Test Master
Database

Masking &
Sub setting

SALARY

NAME

AGUILAR 203-33-3234 40,000

BENSON 323-22-2943 60,000

SSN

SALARY

MILLER 112-23-4567

40,000

SMITH

60,000

111-22-3333

010110011
101001010
000111010

Data Guard Standby

Prod DB

Backups

Mask / Subset

Test Master

Refresh

Clones
Refresh

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Data Movement
Activity Breakdown
Prod DB Identify production database for cloning
Backups Take regular backups [RMAN, datapump exports, etc]

Mask / Subset Mask sensitive data. Optionally, subset to reduce storage footprint
Test Master Sanitized copy of production data for use in dev / test environments OR

a Data Guard Standby database

Clones Full clones for performance / stress testing; snap clones for functional testing
Refresh - Keep in sync with data changes in production

Copyright 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential Internal/Restricted/Highly Restricted

18

Deployment Scenarios
Snap Clones using Standby

Production
Database

Continuous or Discrete Replication

Private backups
(snapshots) for SSA
user

Standby / Test
Master Database

Replication Types:
Continuous

Discrete

Technology

Data Guard, Golden Gate

RMAN, Snap Mirror, import/export

Data Refresh

Automatic and instantaneous

Manual and at scheduled intervals

Masking and
Subsetting

Not possible

At source (in production), or in place at test master

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

DB Clone and Refresh Admin Flow

Production
Database
NAME

SSN

Test Master
Database

Masking &
Sub setting

SALARY

NAME

AGUILAR 203-33-3234 40,000

BENSON 323-22-2943 60,000

SSN

SALARY

MILLER 112-23-4567

40,000

SMITH

60,000

111-22-3333

Enable direct clones from production databases

Works with patched or upgraded binary

Provide automation to refresh the clone with data

changes in production

If using clone as test master, allow self service users to

refresh existing clones with new data

Works for storage snapshots, RMAN backups, data

pump exports, etc

Reduce administrative overhead

Include masking & subsetting

Copyright 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential Internal/Restricted/Highly Restricted

20

DB Clone and Refresh Admin Flow

Mask
Subset

Production Database

Clone / Test Master

Update [Patch or Upgrade]

Change Configuration [SI / RAC]
Snap Clone
Use as Test Master
Version: 11.2.0.3

Version: 11.2.0.4

Config: 3 Node RAC

Config: Single Instance

Data: RMAN Backup1

Data: RMAN Backup1

t0

t1

t2

tN

RMAN Backup / Data Pump / Storage Snapshot

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Confidential

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Confidential

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Oracle Confidential

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Full or Snap Clone: How it Works?

Scheduled or Manual Storage Snapshots or RMAN Backups of the test master database, called Profiles

Standby /
Test Master

Test master is
regularly
refreshed with
current data
from production

t1

t0

t2

Clones
Private backups

tN

Clones can be created from any

profile
Each user gets a personal readwrite database clone

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Self Service Provisioning and Service Catalog

Out-of-box self service portal

Catalog of different database configuration with
varied datasets
Resource quota based on role
Integrated monitoring, snapshot/rollback, etc

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Complete APIs for Automation or Integration

Request DBs

List Zones
List Service Templates

Deploy

List

Request Schemas

List Service Instances

Track request progress

DBaaS
Portal & API

Service Control (start/stop)

Backup

Delete Service
Extend reservation

Request PDBs

Delete

Manage

Restore
Snapshot
Get Chargeback info

DBaaS Providers:
CRUD on Zones / Pools / Service templates / Profiles / Quota / etc

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Complete REST API for Automation or Custom Portals

OR
Out of box Self Service Portal

POST :
https://example.oracle.com/em/cloud/dbaas/zone/82CF1C28FA20A18
3C99D138FF8065F19
Authorization: basic ZGVtb3VzZXI6ZGVtb3VzZXI=
Content-Type:
application/oracle.com.cloud.common.DbPlatformInstance+json
Accept:
application/oracle.com.cloud.common.DbPlatformInstance+json
Body:
{
"based_on":
"/em/cloud/dbaas/dbplatformtemplate/CC3BBB665A6BC6FFE040F00AEF
252456",
"name": "<Request name>",
"description": "<Request Description>",
"params":
{ "username": "Master Account username for the DB",
"password": "Password for the Master Account on the DB"
}
}

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Snap Clone Vs Competition

Scale, Scale, Scale
Supports 1 to 1000s of clones
Protects your existing investments
Choice between hardware and software solution
Use of trusted technologies like data guard for test master refresh
Part of Enterprise Manager 12c
Oracles flagship management product for all your database needs
In sync with DB releases (support for PDBs on day 1)
Secure and role based access control; used by Fortune 1000 customers

Protection from unnecessary point tools; reduce TCO

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Snap Clone with Oracle Engineered Systems

External Storage

Exadata
Compute nodes are used to run snap
clone databases
The storage is external to Exadata
and served over NFS
In case of ZS3 storage, all traffic over
infiniband
SuperCluster
Solaris Zones or LDOMS used to run
snap clone databases
Embedded ZS3-ES storage served
over infiniband

Test Master
Database

/source [nfs]
010110011
101001010
000111010

/clone1 [nfs]

/clone2 [nfs]

Oracle Virtual Compute Appliance

Oracle VMs used to run snap clone
databases
Embedded ZS3-ES storage served
over infiniband

.. more
Enterprise Manager
12c
Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

Cloud Management Pack for Oracle Database Summary

Self-Service Provisioning

Supports Databases, Schema, and PDBs

Database Cloning

Full clones and Snap Clones (thin clones)

Enterprise-wide Service Catalog

Role based, Single catalog, to enforce

standardization across the DB estate

Quota and Policy based Management

Enforces governance and control

Metering, Chargeback

Supports Database, Schema, and PDBs

Comprehensive REST and EMCLI APIs

For all self service and admin functions

Copyright 2014 Oracle and/or its affiliates. All rights reserved. |

References
Enterprise Manager Page on O.com
Cloud Management Page on OTN
Cloud Administration Guide (Documentation)
MOS Note: EM12c Recommended Plug-Ins and Patches for DBaaS
(1549855.1)
Copyright 2014 Oracle and/or its affiliates. All rights reserved. |