sto1167bu oracle on hci steroids: a complete end-to-end or ...vmware vsphere® vmotion®, vmware...

68
Palanivenkatesan Murugan Sudhir Balasubramanian STO1167BU #VMworld #STO1167BU Oracle on HCI Steroids: A Complete End-to-End Solution for Business- Critical Oracle Workloads on VMware vSAN VMworld 2017 Content: Not for publication or distribution

Upload: others

Post on 31-Mar-2020

22 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Palanivenkatesan MuruganSudhir Balasubramanian

STO1167BU

#VMworld #STO1167BU

Oracle on HCI Steroids: A Complete End-to-End Solution for Business-Critical Oracle Workloads on VMware vSAN

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 2: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

• This presentation may contain product features that are currently under development.

• This overview of new technology represents no commitment from VMware to deliver these features in any generally available product.

• Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind.

• Technical feasibility and market demand will affect final delivery.

• Pricing and packaging for any new technologies or features discussed or presented have not been determined.

Disclaimer

2

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 3: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Disclaimer

This session does not address Oracle Licensing on VMware SDDC

• We Suggest:• VIRT1817BU• VIRT1867GU

3

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 4: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Agenda

4

Key Takeaways

Requirements of BCA Workloads

Overcoming Challenges with Hyper Converged Infrastructure (HCI)

Oracle on vSAN - Solution history

Traditional and Extended Oracle RAC on vSAN

Oracle 12c Workload on vSAN All Flash

Oracle Day 2 Operations on vSAN

Bringing it together – Database as a Service (DBaaS)

Customer Case Studies

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 5: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Key Takeaways

Stringent requirements of BCA workloads

Challenges associated with meeting the requirements

How VMware HCI helps BCA workloads

• High performance

• Scalability, Resiliency and High Availability

• Security , Performance and Capacity Management

• Ease of deployment with cost effective hardware

• Oracle Day 2 operations (Backup ,Cloning, Data Refresh) made easy

• Database as a Service

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 6: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Characteristics of Business Critical Application (BCA) workloads

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 7: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

• Must be highly available

• Must be resilient and redundant

• MTBF must be very high

BCA Requirements

7

Availability

Performance

Recoverability

Scalability

Security

• Timely process completion is critical

• Must avoid bottleneck

• RPO, RTO, MTD, WRT must all be very low

• Recovery plans must be verifiable and repeatable

• Should be adaptive and grow with littlereconfiguration effort

• Security from Internal & External attacks and be complaint with industry standard security practices

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 8: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Design Methodology - OverviewRequirements Gathering

Selling the Project to Stakeholders

DB Workload Measurement

Understanding Current Environment

Constraints

Database Migration Strategies

Support & Licensing

Design Considerations for Sizing

Backup and Recovery

High Availability / Disaster Recovery

Monitoring & Tuning

Design Methodology SAME as Oracle on Bare Metal ☺

8

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 9: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Performance

Rapid Provisioning

▪ I/O is not an issue

▪ Scale up and out

▪ Newer hardware can increase performance

▪ Streamline activation, deployment, and validation of servers

▪ Avoid manual configuration errors

Server Consolidation

▪ Fully utilize hardware

▪ Maintain application isolation

▪ Scale dynamically and right-size infrastructure

Workload Management

Business Continuity

High Availability

▪ VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere®

Fault Tolerance (FT), VMware vSphere Distributed Resource Scheduler (DRS)

▪ Without clustering or RAC

▪ VMware vCenter Site Recovery Manager™

▪ Hardware reduction at failover site

▪ Comprehensive testing of DR solution

Benefits of Oracle Databases on VMware

▪ Zero downtime maintenance

▪ Migrate live databases

9

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 10: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Storage Concerns of Business Critical Applications (BCA)

• Common objections to using traditional storage solutions for BCA are

– Scale-up / Scale-out issues

– Storage inefficiency

• Complex storage management

• Capability of non disruptive operations

– High Deployment cost (CapEX)

– High Operating costs (OpEX)

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 11: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

BCA requirements - Meet VMware Hyper Converged Infrastructure (HCI)

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 12: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Technical & Strategic Reasons for Deploying vSAN

Lower TCO

Efficiency at scale

Pro-active cloud analytics

Intelligent operations

Native HCI security

Evolve Without Risk

Resilient management

Intelligent rebuilds

Scale to Tomorrow

Optimized performance

Next-gen apps

Latest hardware support

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 13: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

vSAN – Enabling the Modern Data Center

All-flash6.2

Hybrid5.5

Cross-cloud6.5

H1 2017

Native security

Enhanced stretched clusters

Higher performance

Moderninfrastructure

6.6

H1 2016

Compression

Deduplication

Erasure coding

Quality of service

H2 2016

AWS announcement

Container support

Cloud Native apps

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 14: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Supporting a Broad Variety of Use Cases

Business Critical Apps Virtual Desktops (VDI)

DR / DA

Cloud Native AppsDatabases

(SQL/Oracle)

ROBOManagement

Clusters

ContainersvSAN

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 15: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Secure Data with vSAN Data-at-Rest Encryption

• Datastore level, data-at-rest encryption for all objects on vSAN Datastore

• Enabled at cluster level, supporting hybrid, all-flash, and stretched clusters

• No need for self encrypting drives (SEDs), reducing cost and complexity

• Works with all vSAN features, including deduplication and compression

• Integrates with all KMIP compliant key management technologies, including SafeNet, Hytrust, Thales, Vormetric, etc.

vSphere vSAN

vSAN Datastore

Other options include Oracle Encryption (Application Level) or VMcrypt (VM Level Encryption)

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 16: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Optimize Performance with Cloud-based Performance Analytics

Specify one of three predefined areas

of focus for benchmarks:

– Max IOPS

– Max Throughput

– Min Latency

Integration into HCIBench

Sends test output automatically to VMware

cloud for analysis

Provides results of analysis in UI

Detects issues and suggests remediation

steps by tying to specific KB articles

NEvSAN 6.6.1

vSphere vSAN

HCIBench

Analysis

Detect issues

Visible to GSS

Feedback

Site results

Links to KBs

vSAN Cloud Analytics

VMware Customer Experience Improvement Program

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 17: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Integration with vR Ops - Manage HCI at Scale with vRealize Operations 6.6

Aggregate cluster statistics

Cluster specific statistics

Prebuilt vSAN dashboards with multi-

site visibility and analytics

Fully integrated natively into vRealize Operations 6.6

Easily customize to expose data you

want to see

Display vSAN and non-vSAN

metrics together

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 18: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

VMware vSAN Delivers a Native vSphere Architecture

Runs on any standard x86 server

Pools HDD/SSD into a shared datastore

Delivers enterprise-grade scale and performance

Managed through per-VM storage policies

Deeply integrated with the VMware stack

vSphere vSAN

vSAN DatastoreVMworld 2017 Content: N

ot for publicatio

n or distribution

Page 19: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

vSAN Hybrid and All Flash

Hybrid All-flash

Cache

Persistent

Item Hybrid All Flash

Cache Tier Flash Based Flash Based

Capacity Tier Magnetic Disks Flash Based

Cache Tier Acts as Read Cache

(70%) and Write-Back

Buffer (30%)

Acts as Read Cache

(0%) and Write-Back

Buffer (100%)

Working Set Active working set

resides in flash based

Cache Tier

Not applicable as both

Tier are Flash Based

Write

Acknowledgement

Write acknowledged to

VM once written to

buffer (on all replicas)

Same as HybridVMworld 2017 Content: N

ot for publicatio

n or distribution

Page 20: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Oracle on VMware HCI - Solution History

2015

2016

2017

Traditional and Extended Oracle Real Application Clusters on VMware vSAN

VMware KB 2121181 to support Oracle RAC on vSphere 6.x with vSAN Datastore

Oracle Database 12c on VMware vSAN 6.2 All-Flash

Oracle Database 12c on VMware vSAN – Day 2 Operations and Management

1

2

3

4 VMworld 2017 Content: Not fo

r publication or distri

bution

Page 21: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

An Application Perspective into VMware vSAN Hybrid & All Flash

• vSAN All flash & Hybrid

• Oracle Real Application Cluster (RAC) for High Availability

• Traditional & Stretched

• Oracle Data Guard for Disaster Recovery

• Oracle RMAN for Backup and recovery

• Other database operations

• Backup & Restore / Cloning / Data refresh

• Monitoring and Troubleshooting using Oracle tools

Deployment does not change across

vSAN flavors

• Performance

• Continuous innovation in vSAN Software and x86 Server Hardware

• Features availability and TCO

• Space Efficiency features Deduplication, Compression, Erasure coding (RAID 5,6)

• vSAN Native encryption

• vSAN Management improvements

• Optimize Performance with Cloud-based Performance Analytics

What really changes across different

vSAN versions and hardware

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 22: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Oracle RAC 11.2.0.4 on vSAN 6.1 Hybrid – Configuration Overview

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 23: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

vSAN Cluster (Hybrid)

VM1

RAC Node 1

Linux

VM2

RAC Node 2

Linux

ESXi 1

Disk Group Disk Group

ESXi 2

Disk Group Disk Group

ESXi 3

Disk Group Disk Group

ESXi 4

Disk Group Disk Group

VM3

RAC Node 3

Linux

VM4

RAC Node 3

Linux

Oracle RAC 11gR2 on vSAN 6.1 Hybrid - Configuration

ESXi4 Servers

2 Sockets ,20 Cores with 512GB RAM

Oracle

RAC

4 Node RAC 11.2.0.4

8 vCPU, 64GB Memory

DB size 350GB

SGA 28GB, PGA 10GB

vSAN

Each ESXi has 2 Disk groups

Each disk group has

• 1 x 800 GB SSD

• 5 x 1.2TB HDDs

vSAN Policy

• FTT = 1

• Number of Disks Stripes = 2

• OSR = 100

• Rest default

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 24: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Oracle RAC Disk Layout - KB 2121181

vSAN Datastore

VMDK 1

1 x 100 GB

VMDK 2 to VMDK 11

10 x 60 GB

VMDK 12 to VMDK 15

4 x 40 GB

VMDK 16 to VMDK 18

3 x 20GB

VMDK 18 to VMDK 20

3 x 20GB

Virtual Machine

LSI1 PVSCSI1Virtual

SCSI

driver

PVSCSI2 PVSCSI3

OS DATA 1 to DATA 10 FRA 1 to FRA 4 REDO 1 to REDO 3 CRS 1 to CRS 3

OS ,ORACLE DATA DG FRA DG REDO DG

ASMLinux

ext4ASM

CRS VOTE DG

ASM ASM

OS & Oracle Oracle RAC Shared Disks

Multi-

writer

support

enabled

for shared

VMDKs

(KB

2121181)

for Oracle

RAC

Steps for setting Multi-Writer Flag same as Traditional vSphere Cluster

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 25: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Oracle RAC on vSAN Hybrid - Test Scenarios

• vMotion to

migrate a RAC

node from one

ESXi host to

other

• Single disk failure (

HDD Hot unplug )

• Disk group failure (

SSD hot unplug )

• Host failure ( Host

shutdown)

Performance & Scalability

Resiliency vMotion

• Swingbench TPC-

C to generate

OLTP workload

using 100 user

sessions on a 4-

node Oracle RAC

• SCAN provides

load balancing and

failover for client

connections to the

database

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 26: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

vSphere vMotion Test

Migration Initiated -300,000 TPMs

Migration Completion time - 182 seconds

TPM reduced for 10 seconds during the last phase of the migration

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 27: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Oracle Extended RAC on vSAN Stretched Cluster - Overview

NEWvSAN 6.6

• Redundancy locally

and across sites

• With site failure,

vSAN maintains

availability with

local redundancy in

surviving site

• Optimized site

locality logic to

minimize I/O traffic

across sites

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 28: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Metro & Global DR with vSAN Stretched Cluster & Oracle Data Guard

Near Zero data loss DR solution using the combination:

vSAN Stretched

Cluster

Oracle Data Guard Physical standby in Max Performance

Oracle Extended RAC Cluster across site A, B & C

DR Standby RAC on vSAN

Cluster

Oracle RMAN deployed to backup RAC database

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 29: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Extended Oracle RAC on vSAN Stretched – Performance Test Scenario

• 2-node Extended Oracle RAC on vSAN Stretched ClusterConfiguration

• Swingbench to generate OLTP like workload using 100 user sessions

Workload

• Increasing distance between the sites increases the latency

• Round trip latency between data sites was changed

• 1ms

• 2.2ms

• 4.2ms

• Latency between Data site’s (A & B) to Witness site was constant RTT latency @ 200ms

Distance (Latency) between Sites

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 30: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

vSAN Stretched Cluster with OLTP like Workload on Oracle RAC - Test ResultsTPS Comparison IOPS Comparison

• As inter-site latency increased, IO and Oracle cache-fusion message latency increased

• For 1ms, 2.2ms, and 4.2ms round trip latency, the TPS reduced by 12% , 27% & 47% respectively

• 1ms inter-site round trip latency (typically 100km distance) is capable of delivering 88 percent of the transaction rate when compared to no latency

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 31: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Oracle RAC on vSAN – Reference architecture

https://storagehub.vmware.com/#!/vmware-vsan/oracle-real-application-clusters-on-vmware-virtual-san

Released December 2015

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 32: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Oracle 12c workload on vSAN 6.2 All Flash

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 33: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Oracle 12c on vSAN 6.2 All-Flash - Configuration

ESXi• 4 Servers

• 2 Sockets ,16 Cores with 384GB RAM

Oracle

RAC

• Oracle 12c 12.1.0.2.0

• 2 VM size deployed

- Medium VM : 4 vCPU and 64GB memory

- Large VM : 8 vCPU and 96GB memory

• Oracle ASM disk groups on separate

PVSCSI controllers

• External redundancy with AU size of 1M

• No shared disks as Single instance

database

vSAN

• Each ESXi has 2 Disk groups & each

disk group has

- 1 x 800 GB SSD (Cache)

- 3 x 800 GB SDD (Capacity)

Erasure Coding (Raid 5)

Deduplication & Compression

Software Checksum

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 34: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Oracle 12c on vSAN All Flash 6.2 - Test Scenarios

• SLOB & Swingbench

Sales History (SH)

• 6.2 features

• Erasure Coding

• Deduplication &

Compression

• Checksum

• Swingbench Sales

History (SH)

• 100% read & IO

throughput intensive

• 6.2 features

• Erasure Coding

• Deduplication &

Compression

• Checksum

OLTP Workload DSS Workload Mixed Workload

• SLOB OLTP like

workload

• Workload mix of

75% reads , 25 %

writes

• Baseline with NO

new 6.2

• Raid 1

Performance Data is a result of the combination of hardware configuration, software configuration, test methodology, test tool, and workload profile used in the testing

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 35: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Test Methodology – DSS Workload using Swingbench

• 4-node ESXi cluster

• 2 Oracle Single Instance VMs (1 Large & 1 Medium) on separate ESXi

• 350GB database schema loaded on each database

Configuration

• Decision Support System (DSS) like workload using Swingbench Sales History (SH)

• SH workload is 100% read & IO throughput intensive

• SH workload executed on both db for 60 minutes (default 24 users)

Workload

• For performance and storage efficiency , below combination was chosen

• Mixed Protection

• Data disk with Erasure Coding (RAID 5)

• Redo Disks with Mirror (RAID 1)

• Deduplication & Compression

• Checksum enabled

vSAN Policy

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 36: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

DSS Workload using Swingbench - Test result Read IO Throughput

0

100

200

300

400

500

600

700

800

900

1,000

00:00 05:00 10:00 15:00 20:00 25:00 30:00 35:00 40:00 45:00 50:00 55:00 1:00:00

IO T

hro

ug

hp

ut ( M

Bp

s )

Minutes

Read IO Throughput

• Peak IO throughput –935MB/s

• Average IO throughput 636 MB/s

vSAN

• Aggregate total “physical read total bytes” of combined database from AWR is 644MB/s

Oracle AWR

vSAN viable for IO throughput intensive DSS

workload as well

Peak

935MB/s

vSAN Observer Metrics

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 37: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Oracle 12c on vSAN All Flash – Reference architecture

https://storagehub.vmware.com/#!/vmware-vsan/oracle-database-12c-on-vmware-virtual-san-6-2-all-flash

Released September 2016VMworld 2017 Content: Not fo

r publication or distri

bution

Page 38: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Database Day 2 operations - Oracle on vSAN 6.6

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 39: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Confidential

Oracle on VMware vSAN Day 2 Operations

Solution provided for Oracle Single instance and Oracle RAC

Leverage vSAN Snapshots & Clones

• Backup, Recovery & Cloning

• Database refresh for dev & test from production

• Database Patching (Stand alone and RAC)

Feature and Tools used

• vSAN snapshot and clone

• Oracle Backup and recovery

• Oracle Archive log backup

VM - 24 vCPU , 256GB memory

Oracle SGA 192GB , PGA 16GB

OEL 7.3 O/S

Oracle 12.1.0.2 GI and RDBMS

Oracle ASM

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 40: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Oracle Backup and Recovery on vSAN - Procedure

• Database Backup using one of the two methods

– Using Oracle Hot Backup mechanism

– Using Oracle crash consistent backup

• VM cloning process

– VM-level snapshots and clone

– VMDK-level backup

40

VM Level

Snapshots & clone using

Oracle hot backup

Snapshots & clone using

Oracle crash consistent backup

VMDK level

Backup using Oracle hot backup

Backup using Oracle crash

consistent backup

2 2 4 Scenarios

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 41: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Restore Oracle Database using vSAN Snapshots, Clone with Oracle hot backup – VM level

41

VirtualMachine

DB

VirtualMachine

DBProduction VM

‘ORA12C-OL73

Cloned VM from

vSAN SnapshotRecovery VM

‘ORA12C-OL73-Clone’

vSphere + All-Flash vSAN Cluster

• Database in Hot back up mode

• VM-level Snapshot using VMware snapshot

• End Hot backup mode

• Clone new VM using VMware Cloning using Snapshot (PIT)

• Delete Snapshot after Cloning completes

Backup Operations

• Power on new Cloned VM

• Database on cloned VM started & recovered using the Oracle media recovery mechanism

• A PIT copy of production database is available for data recovery

Recovery Operations

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 42: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Restore Oracle Database using vSAN Snapshots, Clone with Oracle hot backup – vmdk level

42

Virtual Machine

PROD1

Virtual Machine

PROD1Production VM

‘ORA12C-OL73’

Clone relevant

vmdk from vSAN

Snapshot

Recovery VM for “PROD1“

‘ORA12C-OL73-Clone’

PROD 3

PROD 2

vSphere + All-Flash vSAN Cluster

• Assumption DB’s on dedicated vmdk’s

• Place database in Hot back up mode

• Take VM-level Snapshot using VMware snapshot

• End Hot backup mode

• Clone database disks using “vmkfstools” command

• Delete Snapshot after cloning completes

Backup Operations

• A Recovery VM pre-exists with Grid and RDBMS binaries

• Attach cloned database VMDK to the recovery VM

• Scan the OS for new Oracle ASM disks

• Mount new ASM disk groups

• Create the database initialization parameter file

• Start Oracle DB and perform recovery

• A PIT copy of production database is available for data recovery

Recovery Operations

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 43: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Refresh Dev/Test Databases from Production

43

• Database in Hot back up mode

• VM-level Snapshot using VMware snapshot

• End Hot backup mode

• Clone VM database vmdk’s using VMware vmkfstools

• Delete Snapshot after Cloning completes

Backup Operations

• Drop QA1 database

• Attach cloned VMDK’s to target VM

• Scan O/S to see new Oracle ASM disksCleanup

• Mount ASM Disks groups for QA1

• Start QA1 Database to perform Oracle media recovery

• Additional archive logs can be applied for PIT data recovery

Recovery Operations

• 3 test DB’s : QA1, QA2, and QA3

• • Requirement to refresh QA1 DB

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 44: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Oracle on vSAN – Day 2 Operations and Management

https://storagehub.vmware.com/#!/vmware-vsan/oracle-database-12c-on-vmware-vsan-day-2-operations-and-management-1

Released April 2017VMworld 2017 Content: N

ot for publicatio

n or distribution

Page 45: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Partner Certified Data Protection Solutions for Day 2 Operations

Flexibility to extend HCI

environment with additional

software services

Simplified experience with

vSAN documentation, best

practices, and support

Greater confidence when

deploying 3rd party

solutions of choice

Data Protection

45

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 46: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Bringing it together

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 47: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

From Day 0 till Day 2 - Bringing it together

• Backup and recovery• Cloning• Database Refresh• Patching

• Gather Requirements

• Design Architecture With Best Practices

• Installation

• Setup

• ConfigurationDAY 0 DAY 1 DAY 2

Database as a Service (DBaaS)

Can we automate this ?

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 48: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Technical Reasons for Oracle DBaaS – Why Automate ?

▪Regardless of the platform (vSAN , vSphere or any Bare metal architecture)

• Deployment of Oracle RAC is not easy !!!!!

•Too complicated – lots of moving parts

•Co-ordination between DBA and Infrastructure teams

•Requires intimate RAC knowledge

•Requires DBA involvement for every RAC deployment

•Easier automating Oracle Stand Alone databases

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 49: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Automating Day1 and Day 2 operations – Database As a Service

• List of use cases defined

• Defining templates of Oracle DB VMs to be available in self-service catalog

• Provisioning Single Instance / RAC VMs (no user data) from self-service catalog

• Decommissioning a RAC

• Provisioning clones of Single Instance database

• with data masking for Test / Dev / QA

• Metering / Reporting

• Decommissioning a DB VM

• Migrating traditional DB to DBaaS

• Provisioning clones of RAC

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 50: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Customer Case Study

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 51: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Public References - Customers running Oracle on vSAN

• Telefonica

• Large digital Telco , > 300 million users across 21 countries

• Oracle Workload

• Wachter

• Leading Nationwide designer, integrator & service provider (Power & Technology)

• VMware Site Recovery Manager

• CRM Applications with Oracle databases

• Union Hospital

• Healthcare

• Oracle Workloadhttps://www.vmware.com/products/vsan/customers.html

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 52: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

A Customer Case Study

▪ One of the largest independent software corporations in the world

• creates systems software that runs in mainframe, distributed computing, virtual machine and cloud computing environments

▪ Deployed Oracle RAC on vSAN & followed all best practices

▪ Had performance issues

• “Log file sync” event wait time was 13.28ms – VERY HIGH !!!

• Oracle tuning exercise conducted

• “Log file sync” event wait time reduced to 2.66ms

▪ Conclusion

• Oracle tuning is no different - same for vSAN , vSphere or any other Physical environment

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 53: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Best Practices for running Oracle on vSAN

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 54: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Confidential

Best Practices for Oracle on vSAN

• Separate Oracle ASM disk groups for Data, Redo and Archive

• Recommend multiple vmdk’s for in each Oracle ASM disk group

• ASM disks in an ASM disk group same capacity to maintain balance

• Use Paravirtualized SCSI (PVSCSI) controllers for Oracle vmdk’s

• Separate PVSCSI controllers for Data, Redo and FRA vmdk’s

• Increase default PVSCSI adapter and vmdk queue depths [KB 2053145]

• Check Server Disk Controller / HBA queue depth for IO throughput / IOPS

• Use the NOOP value as the I/O scheduler for Linux kernel [KB 2011861]

Database Disk & PVSCSI

Configuration

Oracle Databases on VMware – Best Practices Guidehttps://www.vmware.com/content/dam/digitalmarketing/vmware/en/pdf/solutions/vmware-oracle-databases-on-vmware-best-practices-guide.pdf

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 55: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Confidential

Best Practices for Oracle on vSAN

• Similarly sized ESXi hosts to avoid imbalance

• Scale-up, consider initial deployment with enough cache to accommodate future requirements

• Future capacity addition, create disk groups with similar configuration and sizing

Design for growth

• Depending on FTT, consider design with additional host and capacitywhich

• enables the cluster to be automatically recovered in the event of a failure

• enables to maintain desired level of performance

Design for availability VMworld 2017 Content: N

ot for publicatio

n or distribution

Page 56: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Confidential

Best Practices for Oracle on vSAN

• Policy Management at VM object level

• Granular leverage for features Checksum, Erasure Coding & QoS SPBM

• Use RAID 1 (Mirror) for Data and Redo disks

• For others, use RAID 5 (Erasure Coding) for Data disk and RAID 1 for Redo to provide balance between space efficiency and performance

For Latency-sensitive

application

• Provide space efficiency

• Space saving specific to the Application Workload

• Domain for deduplication at disk group level

• Larger disk groups typically yield higher overall deduplication ratios than smaller disk groups

Deduplication and

compression

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 57: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Conclusion

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 58: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

HCI – Powered by vSAN - Conclusion

• Cost-effective & High-performance HCI platform

• Space Efficiency & Data Integrity features

– minor resource overhead

– significantly lowering TCO

• vSAN Stretched Cluster

– excellent storage platform for Extended Oracle RAC (zero RPO and RTO at the metro distance)

– Disaster Recovery & Business Continuity for BCA

• Ease of deployment & Management

• Provides enterprise-class snapshots and clones for Day 2 operations and management

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 59: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Useful Collateral

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 60: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Oracle on VMware Collateral – One Stop Shop

https://blogs.vmware.com/apps/2017/01/oracle-vmware-collateral-one-stop-shop.html

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 61: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

References• Oracle RAC on vSAN – Reference Architecture

– https://storagehub.vmware.com/#!/vmware-vsan/oracle-real-application-clusters-on-vmware-virtual-san

• Oracle Database 12c on VMware vSAN 6.2 – Reference Architecture

– https://storagehub.vmware.com/#!/vmware-vsan/oracle-database-12c-on-vmware-virtual-san-6-2-all-flash

• Oracle Database 12c on VMware vSAN – Day 2 Operations and Management Guide

– https://storagehub.vmware.com/#!/vmware-vsan/oracle-database-12c-on-vmware-vsan-day-2-operations-and-management-1

• Oracle Databases on VMware – Best Practices Guide

– https://www.vmware.com/content/dam/digitalmarketing/vmware/en/pdf/solutions/vmware-oracle-databases-on-vmware-best-practices-guide.pdf

• For all other technical resources related to

• VMware vSAN - https://storagehub.vmware.com/#!/vmware-vsan

• Virtualizing Oracle on VMware - http://www.vmware.com/solutions/business-critical-apps/oracle-virtualization/oracle-database.html

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 62: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Nerd Out With These Key vSAN Activities at VMworld

#HitRefresh on your current data center and discover the possibilities!

Earn VMware digital badges to

showcase your skills

• New 2017 vSAN Specialist

Badge

• Education & Certification Lounge:

VM Village

• Certification Exam Center:

Jasmine EFG, Level 3

Become a

vSAN Specialist

Learn from self-paced and expert

led hands on labs

• vSAN Getting Started Workshop (Expert led)

• VxRail Getting Started (Self paced)

• Self-Paced lab available online 24x7

Practice with

Hands-on-Labs

Discover how to assess if your IT

is a good fit for HCI

• Four Seasons Willow Room/2nd floor

• Open from 11am – 5pm Sun, Mon, and Tue

• Learn more at Assessing & Sizing in STO1500BU

Visit SDDC

Assessment Lounge

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 63: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

3 Easy Ways to Learn More about vSAN

63

• Live at VMworld

• Practical learning of vSAN, VxRail and more

• 24x7 availability online– for free!

vSAN Sizer

vSAN Assessment

New vSAN Tools

• StorageHub.vmware.com

• Reference architectures, off-line demos and more

• Easy search function

• And More!

Storage Hub Technical Library Hands-On Lab

Test drive vSAN

for free today!

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 64: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Let Us Know Your Experiences!

Sudhir @vracdbaPalani @palani_vm

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 65: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

▪ 20+ years Oracle hands on experience as an Oracle DBA / Architect,

Oracle RAC/Data Guard Expert, Experienced in EMC SAN Technologies

▪ VMware [2012-] Staff Solution Architect – Oracle

▪ Principal Oracle DBA/Oracle Architect (1995 – 2011)

▪ VMware VCA – Cloud ,VMware vBCA Specialist

▪ VMware vExpert

▪ Member of the CTO Ambassador Program

▪ Co-Author of “Virtualize Oracle Business Critical Databases”

▪ Recognized Speaker@ Oracle Open World, IOUG, VMworld, VMware

Partner Exchange, EMC World, EMC Oracle Summit and Webinars

▪ Industry recognized expert in Oracle Virtualization technologies

▪ Blog :

▪ https://blogs.vmware.com/apps , http://vracdba.com

▪ Twitter : @vracdba

Sudhir Balasubramanian

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 66: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

• Sr Solution Engineer - Product Enablement of SABU VMware

• 11+ years of experience in Enterprise Storage Solution design and Implementation for Business Critical applications

• Prior roles

– Storage Solution architect in IBM Systems and Technology Lab Services

– Implementation delivery specialists in EMC Professional services division

• Experience demonstrating POC using latest Storage technologies

• Storage Performance Benchmarking, Delivering Technical Workshop for Customers and Partners

• Other expertise includes Storage Availability and Performance Assessments , Complex Data Migrations across Storage platforms

• Blog - https://blogs.vmware.com/virtualblocks

• Twitter : @palani_vm

Palanivenkatesan Murugan

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 67: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

Questions

VMworld 2017 Content: Not fo

r publication or distri

bution

Page 68: STO1167BU Oracle on HCI Steroids: A Complete End-to-End or ...VMware vSphere® vMotion®, VMware vSphere High Availability (HA), VMware vSphere® Fault Tolerance (FT), VMware vSphere

VMworld 2017 Content: Not fo

r publication or distri

bution