role of dbas in cloud era - aioug hyd chapter - oracle cloud day

©Copyright2017.AppsAssociatesLLC. 1

RoleofDBAsintheCloudERA

SatyendraPasalapudiDirector–CloudServicesAppsAssociates

Feb11th2017


AboutMe

SatyendraKumarPasalapudiDirector–CloudServiceatAppsAssociates

Co-Founder&PresidentofAIOUG

@pasalapudi


Performance.Growth.Excellence.

Global Reach – US, Europe, India •  Founded in 2002 with HQ in Boston,

MA •  $65M+ Annual Revenue •  850+ Associates •  150+ Active Customers

Mature Delivery Model

•  GoTo Partner for Oracle Cloud ERP •  CMMI Level 3 & SOC 1 Appraised •  Premier AWS Partner for Oracle and

Migration Competencies

Long Term Focus on Customers and Associates

•  30 customers with 5 & 10 year relationships •  40 associates with 5 & 10 year

anniversaries •  Learning & Development and Mentor

programs •  5% of Revenue Invested in L&D •  10+ years of Average Oracle experience •  15+ years of Average Business experience

Integrated Delivery Processes

•  Projects & Managed Services •  Flexible Global Delivery Model Our Strategic Partners


GeneraTonalChangeforEnterprise(IT)Ÿ  Cloudsupportsmissioncri/calworkloads

─  87%ofEnterprisesuseCloudforMissionCriTcalApplicaTons

Ÿ  Clouduseintheenterprisecon/nuesto

grow─  HalfoftheEnterprisessaytheywilluse

cloudforatleast75%oftheirworkloadsby2018

Ÿ  Noonecloudfitsall

─  Morethanhalf(53%)ofenterprisesusetwo(2)tofour(4)cloudproviders

Source:Verizon2016StateoftheMarket:EnterpriseCloudreport


Cloud–ProbabletoInevitableŸ  GEundergoingmostimportant

transformaTonin140yearhistory─  9000ApplicaTonstoAWS&to4000ApplicaTons─  300ERPs(twoyearsback)tomoremanageable─  34DataCentersto4DataCenters

Ÿ  By2020-US$15bofSoewareRevenueŸ  Changes

─  People-ReduceOutsourcing─  Technology-BuildApproachforthingsthatmafer─  20%ofApplicaTonsinCloudasoftoday─  70%ofApplicaTonsby2020inCloud

Source: AWS2015Keynote–Oct62015

OOWKeynotewithMarkHurdOct262015

─  ServiceManagement─  NetworkPerimeter─  RiskBasedSecurityControls─  SelfServiceandAutomaTon─  FinancialTransparency


HybridCloudFramework

HR FIN

SCOM SALES

PROCUREMENT

PLANNING

DW/BI

HistoryofDataManagementSystems

Magne/ctape

“flat”(sequen/al)files

Pre-computertechnologies:

PrinTngpressDeweydecimalsystemPunchedcards

MagneTcDisk

IMS

RelaTonalModeldefined

Indexed-SequenTalAccessMechanism(ISAM)

NetworkModel

IDMS

ADABAS

SystemR

OracleV2

Ingres

dBase

DB2

Informix

Sybase

SQLServer

Access

Postgres

MySQL

Cassandra

Hadoop

VerTca

Riak

HBase

Dynamo

MongoDB

Redis

VoltDB

Hana

Neo4J

Aerospike

Hierarchicalmodel

1960-701940-50 1950-60 1970-80 1980-90 1990-2000

2000-2010

3rdPlamormdrivesnewdemandsonthedatabase:

•  Globalhighavailability

•  Datavolumes•  Unstructureddata•  TransacTonrates•  Latency

Asinglearchitecturecannotmeetallthosedemands.

Why?

9

2005

10

2009

The Role of Data

is Changing


UnTlnow,QuesTonsyouaskdroveDatamodel

Newmodeliscollectasmuchdataaspossible–“Data-FirstPhilosophy”


Data is the new raw material for

any business on par with capital, people, labor

Data is the new raw material for any business on par

with capital, people, labor

We Need Tools Built Specifically for Big Data


Hadoopandit’sEcoSystem

•  Scale out Easily •  Parallel Computing •  Commodity Hardware

•  Solves some Problems •  Complex to Run •  Special Skills to Maintain

Cassandra


We know we want collect, store, organize,

analyze and share it.

But we have limited resources


The Cloud Optimizes

Precious IT Resources i.e. Skilled People with

automation(DevOps/SysOps)


Operational RDBMS

(Oracle, SQL Server, …)

In-memory Analytics (HANA,

Exalytics …)

In-memory processing

(Spark)

Hadoop Web DBMS

(MySQL, Mongo,

Cassandra)

ERP & in-house CRM

Analytic/BI software

(SAS, Tableau

Web Server

Data Warehouse

RDBMS (Oracle,

Terradata …)

ChangingArchitectures


WhatisVirtualizaTon?•  ItisaabstracTonofcomputerhardwareresources

Virtualization technology emulates real — or physical — computing resources, such as

desktop computers and servers, processors and memory, storage

systems, networking, and individual applications.

A hypervisor — also known as a virtual machine manager

(VMM) — allows multiple “guest” operating systems

to run concurrently on a single physical host

computer.

Types Ø  Hardware Virtualization Ø  Full Software

Virtualization Ø  Para virtualization Ø  Hardware-assisted

software virtualization Ø  Component or resource

virtualization

Virtualization players in market

©Copyright2017.AppsAssociatesLLC.

EvoluTonofVirtualizaTonTypes•  1st Generation: Full

virtualization (Binary rewriting)

–  Software Based –  VMware and Microsoft

Time

•  3rd Generation: Silicon-based (Hardware-assisted) virtualization

–  Unmodified guest –  VMware and Xen on

virtualization-aware hardware platforms

•  2nd Generation: Para virtualization

–  Cooperative virtualization

–  Modified guest –  VMware, Xen

Dynamic Translation

Virtual Machine

Hardware

Operating System

Virtual Machine …

Hypervisor

Hardware

VM VM

Hardware

Virtual Machine

Virtual Machine …

Virtualization Logic

Hypervisor

…


ReasonsforVirtualizaTon?

Server Consolidation Server Provisioning

Backup/Restore

Hosting/ Cloud Computing


TypesofHypervisors

Oracle VM VMware vSphere KVM Xen Hyper-V

VirtualBox VMware Fusion VMware Player VMware Workstation

Guest OS

Guest OS

Guest OS

Server Hypervisor

Type 1 – Native (Bare metal)

Guest OS

Guest OS

Guest OS

Operating System Hypervisor

Server

Type 2 – Hosted


VirtualizaToninanutshell Virtualization : Running multiple machines on a single hardware “Real” hardware invisible to OS OS only sees an abstracted out picture Only Virtual Machine Monitor (VMM) / Hypervisor talks to hardware

Traditional Environment

Virtualized Environment


ProsandCons–FullVirtualizaTon•  Pros

–  Disasterrecovery,failover–  Virtualappliancedeployment–  Legacycodeonnon-legacyhardware

•  Cons

–LATENCYofcorefourresources–  RAMperformancereduced25%to75%–  DiskI/Odegradedfrom5%to20%–  Networkperformancedecreasedupto10%–  CPUprivilegedinstrucTondingsnearing1%to7%


CloudEvaluaTonConsideraTons

RunningOracleOnCloud


KeyConsideraTonsforrunningOracleonCloud

OracleDatabase

Compute

Storage/SharedFS

LoadBalancing&Network

Backup/Cloning

Security

Performance


AWSvsOracleIaaS-TerminologyAWS ORACLEIaaS

Compute InstanceType(EC2) Shape

CPU VCPU OCPU

BlockStorage ElasTcBlockStorage StorageVolume

ObjectStorage AWSS3 ObjectStorage

ArchivalStorage AWSGlacier ArchiveStorage

Snapshots EBSsnapshot StorageVolumeSnapshot

Network VirtualPrivateCloud(VPC) VirtualCloudNetwork

LoadBalancer ElasTcLoadBalancer OracleTrafficDirector

Images AmazonMachineImages(AMI) MachineImages

DataCentersinaRegion

AvailabilityZones(AZ’s)

AvailabilityDomains(AD’s)


RelaTonbetweenOraclecomputecloudobjects

instance

Imagelist PublicIP(IPreservaTon)

SSHPublicKeyStorage

volume

Shape

Used to create Used to create

attached to

attached to associates with

Protocol(secapplicaTon)

Networkgroup(seclist)IPlist

(seclist)

Accessrule(secrule)

associated with

source in used in

Source/destination in

10 1

Name Site CounterDick Ebay 507,018

Dick Google 690,414

Jane Google 716,426

Dick Facebook 723,649

Jane Facebook 643,261

Jane ILoveLarry.com 856,767

Dick MadBillFans.com 675,230

NameId Name

1 Dick

2 Jane

SiteId SiteName

1 Ebay

2 Google

3 Facebook

4 ILoveLarry.com

5 MadBillFans.com

NameId SiteId Counter

1 1 507,018

1 3 690,414

2 3 716,426

1 3 723,649

2 3 643,261

2 4 856,767

1 5 675,230

Id Name Ebay Google Facebook (othercolumns) MadBillFans.com

1 Dick 507,018 690,414 723,649 .............. 675,230

Id Name Google Facebook (othercolumns) ILoveLarry.com

2 Jane 716,426 643,261 .............. 856,767

BigTable(WideColumn)datamodel


ScalabilityRequirement


IsRDBMSScalable?


ScalingOutRDBMS

Webservers

DatabaseServers

MemcachedsServers

Shard (G-O) Shard (P-Z) Shard (A-F)

Read Only Slaves

CAPTheoremsayssomethinghastogive.

•  CAP(Brewer’s)Theoremsaysyoucanonlyhavetwooutof

threeofConsistency,ParTTonTolerance,

Availability

ConsistencyEveryonealwaysseesthe

samedata

AvailabilitySystemstaysupwhen

nodesfail

Par//ontolerance

Systemstaysupwhennetworkbetween

nodesfail

RDBMS lives here

Eventual consistency

No go zone

Majorinfluencesonnon-relaTonal

•  EventuallyconsistenttransacTonmodel• Consistenthashing

AmazonDynamo

• ColumnFamilymodelforsparsedistributedcolumnardata

GoogleBigTable

•  Pavedthewayforthedocumentdatabase

OODBMSandXMLDBs

DynamoConsistentHashing

A

C

B

F D

H

E

G

Rowkey=”johnny”Hash=-6.7e10Node=H

Hashvalues-4e10To-8e10

Dynamo Consistent Hashing

A

C

B

F D

H

E

G

Rowkey=”johnny”Hash=-6.7e10Node=H Firstwrite

2ndWrite

3rdWrite

2ndWrite

3rdWrite

Nodeonadifferentrack

Nodeinadifferentdata

center

Documentdatabases

•  Structureddocuments–XMLandJSON(JavaScriptObjectNotaTon)becomemoreprevalentwithinapplicaTons

•  WebprogrammersstartstoringtheseinBLOBSinMySQL

•  EmergenceofXMLandJSONdatabases

MongoDB

ShardingArchitecture

Linearscalingandreplica/on

•  Elastic Auto Sharding (split, add, contract)

Store

•  Writes to elected node with flexible durability

•  Reads from any node in shard

Shard

M

R

R

Shard

M

Shard

R

R

R R

Application NoSQL Driver

M

Shard

R

R

M•  Auto re-balance of data on expansion

Expand

OracleSharding(beta)

ShardDirectory

Coordinator

AndCatalogDB

Replica1

Shard1

Replica2

Shard2

Replican

Shardn

ShardChunks

Shard1

ShardChunks

Shard2

ShardChunks

Shardn

ShardDirectory

Coordinator

AndCatalogDB

ShardDirector

ShardDirector

ShardDirectors

Application

SQLincludingshardkeySQLwithoutshardkey

1

4

2

3

5

6

DatabaseClient

Router(Mongos)

ConfigserverConfigserverShard2(mongod)

ConfigserverConfigserver

ConfigServer(mongod)



1 1 1

23

On Premises Oracle Cloud Same Architecture Same Software

Same Skills

Hybrid Cloud

IntegratedandHybridClouddatabasesoluTon

DatabaseCloudService

Database

Ready for Use

Allocate Compute

Allocate Storage

Set Keys & Privileges

Request for

Service Provision OS

Install & Configure Database

Configure Tools

Configure Access

Configure Backups

Reduced time and complexity to provision database services

Increased standardization of the “fleet”

Also use to deploy Maximum Availability Architectures

Benefits

AutomateddatabaseandinfrastructureprovisioningandadministraTon

DatabaseCloudService

AutomatedDBAandPatching

Backup/RecoveryplusHA&DR

SimpleProvisioning

AnyLanguage MaximumSecurityLocalandRemoteManagement

OracleCloud–SecurityByDefault

DatabaseCloudService-AutomaTon


Cap

ture

Trai

l

Rou

te

Del

iver

Pum

p

GoldenGateCloudService

GoldenGate

DatabaseasaService

HadoopasaService*

Database Cloud Service

Exadata Cloud Service

Big Data Cloud Service

GGCS

GGCS

GoldenGate Cloud Service ü  Real-time Data Replication

Service in Oracle Cloud via Subscription or Hourly basis

Key Benefits ü  Changed Data delivery is

more effective than batch processes

ü  No Data Loss reliable and proven core GG technology

ü  Realtime Data always up to the moment replication & visibility

3rd Party Cloud ü  Migrate from Amazon any

database from AWS RDS ü  Deliver to 3rd Party Clouds

from on-premise databases

3rdPartyCloud

GoldenGate


OracleDatabaseCloud–SummaryofServices


CloudDBADBA/

NoSQL60%Network

Admin10%Storage

Admin10%Automa/on

20%= + + +

Prepare yourself for * as a service

ThankYou!