e2evc 2014 building clouds with microsoft cloud os and system center

Building Clouds with Windows Azure Pack and System Center Michael Rüefli– Cloud Architectwww.miru.chThomas Maurer – Cloud Architect & Microsoft MVPwww.thomasmaurer.ch

Session Objectives

o Get overview of Microsoft Cloud OS stack

o Understand the different components involved and see them in action

o Hear deployment experiences from the Field

o Have a lot of fun ….and get questions answered

The Cloud OSModern platform for the world’s apps

DEVELOPMENT MANAGEMENT IDENTITY VIRTUALIZATIONDATA

CUSTOMER

SERVICE PROVIDER

WINDOWS AZURE

Transforms the datacenter

Unlocks insightson any data

Empowers people-centric IT

Enables modern apps

1CONSISTENTPLATFORM

Cloud – Demystified

• Pool of compute, storage and networking

• Allocable on demand to your customers • Automate everything• Metered• Self-service

Architecture

Cloud OS Experience (Microsoft Cloud v2)

R2 w/ Service Provider Foundation

Future Services

Service Bus

SQLVMsWebSites

Service Management API

ServicePlansUsers Provider

PortalConsumer

Self-ServicePortal

Web SitesAppsDatabaseVMs

Service ProviderCustomer

Self Service Portal Moves On-

Premises

Common Mgt. Experience

Workloads

Cloud-Enabled Services Move On-

Premises

Consistent Dev.

Experience

Other Service

sCDN.

Media,, etc.

Caching

Service Bus

SQLVMsWebSites

WorkerRole

Service Management API

Web SitesAppsDatabaseVMs

Subscriber Self-

ServicePortal

Windows Azure

R2

VM Cloud Architecture

Virtual Machine Manager

NetworkStorageComputeServices

VMs Apps

Service Provider Foundation

Windows Azure Pack

RD GWWSUSWDSSQLAD

IPAM

Service Management Automation

Virtual Machine Manager

Storage

iSCSI, Fiber Channel, SMB, Storage Spaces

Network

Logical Networks, VLAN based, NVGRE

Compute

Hyper-V(ESX, XenServer)

Clouds (Resources Pools)

Tenants (Service Customers)

VMs and Services

System Center Virtual Machine

Manager

DeploymentManagementAutomationMonitoring

Storage

The Performance vs. Cost Dilemma 80% of costs for 20% of I/O critical workloads

(peaks)

Microsoft Software defined StorageStorage Spaces / Scale out File Server

• Cost effective and performant• Ease of Management• Scalable• Auto Tiering (SSD / HDD)• Write Back Cache

Scale the Storage Stack

Clustered Storage Spaces (CSV)

Hyper-V Compute Cluster

High Speed Storage Network10-40 GbE / 56 Gb Infiniband

SMB Namespace

60-bay Shared SAS JBOD Arrays

400 TB / Mirrored(2.2 TB SSD Tier)

Scale Out File Server with RDMA (40GbE/RoCe)

64 x 6 Gbps Shared SAS

\\SOFS1\VMShare1

\\SOFS1\VMshare2

SMBDirect

Mirror

Mirror

…

SMBDirect

64 x 6 Gbps Shared SAS

\\SOFS1\VMShare1

\\SOFS1\VMshare2

SMBDirect

Mirror

Mirror

…

SMBDirect

64 x 6 Gbps Shared SAS

\\SOFS1\VMShare1

\\SOFS1\VMshare2

SMBDirect

Mirror

Mirror

…

SMBDirect

File Client

SMB ClientSMBBuffer

File Server

Application

NIC Driver

Transport Protocol Driver

With RDMA

Improved network performance through SMB Direct (RDMA*)

Without RDMA

Application

NIC Driver

SMB ServerSMB Client

Transport Protocol Driver

NIC Driver

TransportProtocol Driver

AppBuffer

SMBBuffer

OSBuffer

Driver

Buffer

SMBBuffer

OSBuffer

Driver

Buffer

SMB Server

NIC Driver

TransportProtocol Driver

AppBuffer

SMBBuffer

rNIC* rNIC* NIC AdapterBuffer NICAdapter

BufferAdapterBuffer

AdapterBuffer

RoCe

InfiniBand

• Higher performance through offloading of network I/O processing onto network adapter

• High throughput with low latency and ability to take advantage of high-speed networks (such as InfiniBand and iWARP)

• Remote storage at the speed of direct storage

• Transfer rate of around 40 Gbps on a single NIC port

• Compatible with SMB Multichannel for load balancing and failover *Remote Direct Memory Access *e.g. Mellanox Connect X3®™ Adapter Family

Manage the Storage Stack

SAN3rd Party

NAS Devices

Scaleout Fileserver (SOFS)

Node Node

JBOD

SAS SAS

FC/iSCSI

SMB3 SMB3

SCVMM Storage Management

3rd party storage management

DEMOStorage Management

Network

Microsoft Networking

Cloud Providers are required to…

… isolate Tenants from each other… isolate Tenants from Provider Infrastructure… be flexible for changes on physical

Infrastructure… offer Self Service Capabilities to tenants

Why Network Management is Important

SCVMM 2012 Networking

Logical NetworksPhysical Network Infrastructure

Network SitesNetwork Sites / VLANs

IP PoolsIP Address Pools for deployment

SCVMM 2012 R2 Networking

Logical NetworksPhysical Network Infrastructure / Sites / IP Pools

VM NetworksVirtual Networks for VMs

Port ProfilesNew Features from Windows Server 2012 Hyper-V

Logical SwitchLogical Network Switch which combines all features

How network virtualization works• Overlays multiple virtual networks

on shared physical network

• Uses industry standard General Routing Encapsulation (NVGRE) protocol

Problems solved• Creates VM mobility across

datacenter, hoster cloud or Azure without network constraints

• Provides ability to import customer IP addresses and network topology

• Helps remove VLAN constraints

• Helps eliminate hierarchical IP address assignment for virtual machines

Hyper-V Network Virtualization

Physical server Physical network

VIRTUALIZATION

Blue virtual machine

Yellow virtual machine Blue network Yellow network

SCVMM 2012 Networking

Logical NW

Virtual Machine

Physical Network

Fabri

cV

irtu

al

SCVMM 2012 R2 Networking

VM Network

Logical NW

Virtual Machine

Physical Network

Fabri

cV

irtu

al

SCVMM 2012 R2 Networking

VM Network

Logical NW

Virtual Machine

Physical Network

Fabri

cV

irtu

al

VM Network

Logical NW

Virtual Machine

VM Network

Virtual Machine

SCVMM 2012 R2 Networking

VM Network

Logical NW

Virtual Machine

Physical Network

Fabri

cV

irtu

al

VM Network

Logical NW

Virtual Machine

Logical Switch

Software Defined Networking

Hyper-V Network VirtualizationExtensible Virtual Switch

Network Policy/Offloads

SR-IOVDHCP GuardIPSec Task OffloadBandwidth ControlTrunk Mode

Multi-Tenant HNV Gateway

• Virtual Machine running Server 2012 R2 with RRAS Role

• On "dedicated" Hyper-V Host• 50 S2S VPNs / 200 virtual Subnets per single

GW • Service Template for Scale Out / Redundancy• Support for Site-to-Site VPN with 3rd Party

Products from Cisco, Juniper, Citrix

IPAM – VMM Integration

AD DC / NPS / DNS

DNS

DHCP

IPAM Management

Server

SCVMM

Manage virtual IP spaces like a Boss !

DEMOSoftware defined Networking

Hypervisor

Microsoft Hyper-V 2012 R2

• Gen2 VMs• Enhanced Session Mode• vRSS / dVMQ• Online VHDX resizing• Hyper-V Replica Cycles• …etc

Hypervisor Management

DEMOHypervisor

Coffee BreakWe'll be back….in 10 minutes….sharp!

Admin Portal

Tenant Portal

Automation

Automation….

… is a key component in every cloud… must leverage standard APIs and

interfaces… must support multiple tenants… must support linear scaling

Architecture• REST oData API / Web Service• Portal integrated with Azure Pack• SQL Database• Runbook Workers

Windows Azure Pack Admin Portal

DEMOService Management Automation

So which one to go for?SC Orchestrator

SMA

Better together

Thomas MaurerCloud Architect / MVPwww.thomasmaurer.ch@ThomasMaurer

Michael RueefliCloud Architectwww.miru.ch@drmiru

In case of any questions…

THANKS!