using snap clone with enterprise manager 12c

Copyright © 2015 Oracle and/or its affiliates. All rights reserved.

Enterprise Manager Snap Clone

Pete SharmanDatabase Architect, DBaaS EM [email protected]

February 2015

Snapshot your data without snapping your storage


Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.


Session Abstract

Are database refresh challenges causing you to miss projects deadlines? Is your storage cost for dev/test environments spiraling out of control? In this session, you will learn how the Snap Clone feature of Oracle Cloud Management Pack for Oracle Database

• Can refresh production databases after masking and subsetting

• Can enable instant cloning of large databases (TBs) while saving more than 90 percent on storage costs

• Fits perfectly with your existing investments in storage, servers, and engineered systems

• Is being used by other customers for large-scale environments


Program Agenda

1

2

3

4

Current Challenges

EM 12c Solution

Demo

Summary


The Obligatory Slide About Me

• 20 years with Oracle

– DBA instructor / Education Centre Manager

– HA Consultant

– Internal services curriculum developer

– North America Sales and Consulting database lead

– RAC Development

– ST Curriculum DBA / EM team

– Product Manager, EM Product Suite

– Database Architect, DBaaS, EM Product Suite

• OakTable member

• Presented at conferences all over the place

• Owner, petewhodidnottweet.com ☺


A Large Financial Institution – Storage Challenges

1 - 3 YearsSPARC x86

3 – 5 Years

Storage Cost / GB = $6.6/year

Estimated Annual Storage OPX Cost “$198M/year” for Oracle Environments

Applications Team: “1300 Apps

are utilizing private Cloud”

Storage Team: “We have 50 PB SAN.

Annual growth has ranged from 20-35%”

Database Team: “delivering

test data for UAT is a focus for private Cloud

this year ”

Very Small (less < 1 TB) 1,400 300 5

Small (1TB to 5TB) 500 3,000 5

Medium (5TB to 10TB) 75 7,500 7

Large (10TB to 15TB) 25 12,500 7

Very Large (>15TB) 20 20,000 7

Total: 2,020

Oracle DB

Size

Average

Number of

Non-prod

Environments

Average

DB Size

(GB)

Number

of

Applications

5 to 7 non-prod clones per production database

18 of 30 PB for non-prod Oracle environments

$122M of $198M for non-prod clones


Process Challenges

“Database Refresh is a

necessary evil!”

60000 refresh/year

2000+

Dev/Test DB

3 – 5 TB

Typical DB size

RMAN full clones

10 - 20 issues/day

EMC & NetApp storage

- Christian Bilien, Global Head ofDatabase Team


Evolution of Solutions

Point Features Point Tools EM Solution

� Storage level: snapshot, volume/lun thin clone, dedupe, compression, etc

× Lacked DB or application context

× Does not solve process problem

� VM cloning

� DB cloning using smart file systems

× Limited focus on just cloning

× Lacked lifecycle management of clones

� Technology agnostic

� End-to-End automation from prod to test/dev

� Designed for DBAs

� Complete mgmt of clones - masking, performance, patch/upgrade, etc


EM Solution – Data Lifecycle Management (DLM)

�Supports full and thin database clones

�Technology Agnostic

�End-to-End Automation – Prod to Test/Dev

�Designed for DBAs

�Integrated Masking, Subsetting, Patch, etc

�Available via Admin Flows and Self Service portal

�EMCLI and REST API for integrations


Strong Investment in EM’s Data Cloning Solution

EM 12c R2 EM 12c R3 EM 12c R4 EM 12c R4+

• Snap Clone for NAS storage –NetApp & Sun ZFSSA

• RMAN backup based clones

• Snap Clone Analyzer to show storage savings

• Snap Clone using CloneDB

• Data Guard Standby as a Test Master

• NetApp Ontap 8.x cluster mode

• Certification for Eng. systems, I/O over IB

• Support for NFSv4

• Snap Clone using Solaris File System (ZFS)

• Snap Clone for PDBs (Admin Flows)

• Data Lifecycle Management

• Snap Clone using EMC SAN and ASM

• Admin flows for test master creation

• Integration with masking, patching, upgrades, etc


Technology AgnosticData Lifecycle Management


Supported Cloning Options

Software Solution [Vendor Agnostic]

Hardware Solution [Vendor Specific]

Full Clones Snap (Thin) Clones

NAS SAN

Database Native [Storage Agnostic]

RMAN RestoreRMAN

RestoreRMAN

DuplicateRMAN

DuplicateData PumpData Pump

• Leverage your existing investments• Cater to both functional and stress testing needs• Maximize for best performance

Use Snap Clone whenever you need >1 clones!


Snap Clone using Solaris File System (ZFS)

• Uses a single stock Solaris 11.1+ image – physical or virtual [and NOT the Sun ZS3 Appliance ]

• Supports any kind of storage – NAS or SAN

• For SAN, mount luns as raw disk and format with ZFS filesystem

• Does NOT require the snapshot/clone licenses from the storage vendor, these features are available for free

• Additional features include compression, deduplication, IO caching, etc

• HA has to be handled externally either via Solaris Clusters, or by using HA features of the underlying hypervisor


Solaris File System with SAN Storage Network Diagram


• Ability to create thin databases from RMAN image copies

• Uses NFS v3 client embedded in database

• Supported configurations

– Single instance databases

– Note: Only file system support for this setup (No ASM)

• Supported Versions: 11.2.0.3+, 12.1

• Advantages

– Easy to setup

– No special storage software needed

– Works on all platforms

– Time efficient: Instantaneous cloning

– Space efficient: Create multiple clones based on one backup

– Uses dNFS to improve performance, high availability, and scalability of NFS storage

CloneDB using DNFS


NAS Network Diagram

• Components:

• NAS storage

• Ethernet switch

• DB servers

• EM 12c

• Storage proxy host (Agent managed host)


Snap Clone on ASM + EMC Storage

• Ability to create ‘live’ thin clones of databases on ASM

• Live Clone: NOT snapshot based, but a live clone of DB

• Clone can be within the same or on a different cluster

• EMC VMAX (with Time Finder VPSnap) and VNX storage appliances

• Supported configurations: SI and RAC

• Supported Versions: DB = 10.2.0.5 or higher; GI = 11.2 and higher


End to End AutomationData Lifecycle Management


Data Movement

Test MasterDatabase

NAME SSN SALARY

MILLER 112-23-4567 40,000

SMITH 111-22-3333 60,000

Masking &Sub setting

ProductionDatabase

010110011

101001010

000111010

NAME SSN SALARY

AGUILAR 203-33-3234 40,000

BENSON 323-22-2943 60,000

Prod DB Backups Mask / Subset Test Master Clones

Refresh

Data Guard Standby

Refresh


Deployment Scenarios

Continuous or Discrete Replication Standby / Test Master Database

Production Database

Snap Clones using Standby

Private backups

(snapshots) for SSA

user

Continuous Discrete

Technology Data Guard, Golden Gate RMAN, Snap Mirror, import/export …

Data Refresh Automatic and instantaneous Manual and at scheduled intervals

Masking and

Subsetting

Not possible At source (in production), or in place at test master

Replication Types:


DB Clone and Refresh – Admin Flow

Enable direct clones from production databases Works with patched or upgraded binary• Enable direct clones from production databases

• Provide automation to refresh the clone with data

changes in production

• Works for storage snapshots, RMAN backups, data

pump exports, etc

• Includes masking & subsetting

• Works with patched or upgraded binary

• If using clone as test master, allows self service users to

refresh existing clones with new data

• Reduces administrative overhead

Test MasterDatabase

NAME SSN SALARY

MILLER 112-23-4567 40,000

SMITH 111-22-3333 60,000

Masking &Sub setting

ProductionDatabase

NAME SSN SALARY

AGUILAR 203-33-3234 40,000

BENSON 323-22-2943 60,000


DB Clone and Refresh – Admin Flow

Mask

Subset

Update [Patch or Upgrade]

Change Configuration [SI / RAC]

Snap Clone

Use as Test Master

Version: 11.2.0.4

Config: 3 Node RAC

Data: RMAN Backup1

Version: 11.2.0.4.2

Config: Single Instance

Data: RMAN Backup1

t0 t1 t2 …. tN

Production Database Clone / Test Master

RMAN Backup / Data Pump / Storage Snapshot


Full or Snap Clone: How it Works?

Standby / Test Master

t0 t1 t2 …. tN

Scheduled or Manual Storage Snapshots or RMAN Backups of the test master database, called Profiles

Private backups

Clones • Clones can be created from any

profile

• Each user gets a personal read-

write database clone

Test master is

regularly

refreshed with

current data

from production


Self Service Provisioning and Service Catalog

• Out-of-box self service portal

• Catalog of different database configuration with

varied datasets

• Resource quota based on role

• Integrated monitoring, snapshot/rollback, etc


Complete APIs for Automation or Integration

DBaaS Providers:

• CRUD on Zones / Pools / Service templates / Profiles / Quota / etc

List

DBaaS Portal & API

Deploy

Delete Manage

� List Zones

� List Service Templates

� List Service Instances

� Request DBs

� Request PDBs

� Request Schemas

� Track request progress

� Service Control (start/stop)

� Backup

� Restore

� Snapshot

� Get Chargeback info

� Delete Service

� Extend reservation


Complete REST API for Automation or Custom Portals

OR

Out of box Self Service Portal

POST :

https://example.oracle.com/em/cloud/dbaas/zone/82CF1C28FA20A18

3C99D138FF8065F19

Authorization: basic ZGVtb3VzZXI6ZGVtb3VzZXI=

Content-Type:

application/oracle.com.cloud.common.DbPlatformInstance+json

Accept:

application/oracle.com.cloud.common.DbPlatformInstance+json

Body:

{

"based_on":

"/em/cloud/dbaas/dbplatformtemplate/CC3BBB665A6BC6FFE040F00AEF

252456",

"name": "<Request name>",

"description": "<Request Description>",

"params":

{ "username": "Master Account username for the DB",

"password": "Password for the Master Account on the DB"

}

}


DemoSelf Service Data Cloning

(9:17)


Snap Clone Vs Competition

� Scale, Scale, Scale

� Supports 1 to 1000s of clones

� Protects your existing investments

� Choice between hardware and software solution

� Use of trusted technologies like data guard for test master refresh

� Part of Enterprise Manager 12c

� Oracle’s flagship management product for all your database needs

� In sync with DB releases (support for PDBs on day 1)

� Secure and role based access control; used by Fortune 1000 customers

� Protection from unnecessary point tools; reduce TCO


Test MasterDatabase

010110011

101001010

000111010

Snap Clone with Oracle Engineered Systems

Enterprise Manager12c

Exadata • Compute nodes are used to run snap

clone databases

• The storage is external to Exadata

and served over NFS

• In case of ZS3 storage, all traffic over

infiniband

SuperCluster• Solaris Zones or LDOMS used to run

snap clone databases

• Embedded ZS3-ES storage served

over infiniband

Oracle Virtual Compute Appliance• Oracle VMs used to run snap clone

databases

• Embedded ZS3-ES storage served

over infiniband

/source [nfs]

.. more

/clone1 [nfs]

External Storage

/clone2 [nfs]


Cloud Management Pack for Oracle Database Summary

Metering, ChargebackMetering, Chargeback

Supports Databases, Schema, and PDBsSupports Databases, Schema, and PDBs

Database CloningDatabase Cloning Full clones and Snap Clones (thin clones)Full clones and Snap Clones (thin clones)

Quota and Policy based ManagementQuota and Policy based Management

Self-Service ProvisioningSelf-Service Provisioning

Enforces governance and controlEnforces governance and control

Supports Database, Schema, and PDBsSupports Database, Schema, and PDBs

Comprehensive REST and EMCLI APIsComprehensive REST and EMCLI APIs For all self service and admin functionsFor all self service and admin functions

Enterprise-wide Service CatalogEnterprise-wide Service CatalogRole based, Single catalog, to enforce

standardization across the DB estate

Role based, Single catalog, to enforce

standardization across the DB estate


References

• Enterprise Manager Page on O.com

• Cloud Management Page on OTN

• Cloud Administration Guide (Documentation)

• MOS Note: EM12c Recommended Plug-Ins and Patches for DBaaS (1549855.1)

using snap clone with enterprise manager 12c

Software

oracle andor

oracle database

nonprod oracle environments

sole discretion of oracle

dbaas em

storage costs

tools em solution

private cloudstorage