cloudcamp chicago jan 2015 - the guts of the cloud (full slides)

CloudCamp Chicago

“Guts of the Cloud”

#cloudcamp@CloudCamp_CHI

Sponsored by

Hosted by

Emcee

Margaret WalkerCohesiveFT

Tweet: @MargieWalker #cloudcamp


Sponsored by

Hosted by

… sponsored by you!

Pete Kippes - Hegemony Consulting GroupMatt Chiera - Ice Nine OnlineMichael Madeja - Scientific GamesSusan Emery - Viewpointe LLCMichael Cartina - Orasi SoftwareJim Hamilton - SkytapMark Calaguas - McDermott Will & Emery LLPJeff Stricker - BroadCloudAdam Kallish - IBMAndre Stubberfield - Equinix Ralph Capasso - SkytapBrian Lickenbrock - EY

Mark your calendars - CloudCamp Chicago on March 18

6:00 pm Introductions6:05 pm: Lightning Talks

"Cloud Computing: A look under the hood of the next-gen cloud" - Bill Kleyman "Cloudy with a 100% chance of GigaWatts" - Russell Pease "The Red Hat OS1 Cloud: You want guts?" - Dan Yocum "The Importance of the Network Enabled Cloud" - Ron Zirkin

7:00 pm: Unpanel 7:45 pm: Unconference / Networking, drinks and pizza

Agenda


Sponsored by

Hosted by

"Cloud Computing: A look under the hood of the next-gen cloud"

Bill KleymanDirector of Strategy and Innovation, MTM Technologies

Tweet: @QuadStack #cloudcamp


Sponsored by

Hosted by

Cloud Computing: A look under the hood of

the next-gen cloud

Bill KleymanDirector of Strategy and Innovation | MTM

[Writer, Author, Blogger, IT Veteran]

01/07/2015

The “Defining” Trends

� Annual global data center IP traffic will reach 8.6 zettabytes

(715 exabytes [EB] per month) by the end of 2018, up from 3.1

zettabytes (ZB) per year (255 EB per month) in 2013.

� Global data center IP traffic will nearly triple (2.8-fold) over

the next 5 years. Overall, data center IP traffic will grow at a

compound annual growth rate (CAGR) of 23 percent from 2013

to 2018.

� By 2018, more than three quarters (78 percent) of workloads

will be processed by cloud data centers; 22 percent will be

processed by traditional data centers.

� [2015 Cisco Cloud Index Report]

What’s under the hood for Cloud in 2015?

1. APIs and cloud connectivity

2. Software-defined everything (SDx)

3. Hybrid technologies and extensions

4. Mobility – as defined by the user, data, and device

5. Security, Compliance, Regulations, and more…

APIs and Cloud Connectivity

� Platforms from VMware, OpenStack, CloudStack, Eucalyptus, and Amazon are

all creating easier ways to connect via the cloud.

� APIs are creating intelligent infrastructure cross-connects to reduce the

amount of resources required.

� APIs at the software and hardware layer will continue to make cloud

communication easier on an application and infrastructure level.

Automation

Self-Healing Event-based Management

Quality of Service

Autonomics

REST API

vCenter vCAC vVol CloudStackOpenStack IBM SmartCloud Policy-Based ControlCapacity

Performance

Availability

Performance Isolation

Cloud ServicesHigh Availability

Auto Provisioning

Fast Cloning

Orchestration:

vCenter, vCOPS,

vCAC, OpenStack

Software-Defined Everything (SDx)� Network

� SDN

� Powerful logical network architectures

� Compute

� “Follow the sun data center”

� Abstracting compute resources

� Data Center

� Putting it all together.

� Creating a new control layer

� #SDDC

� Storage

� Creating powerful pools at the logical layer

� Optimizing data control

Virtual

Controllers

Performance

Hybrid Cloud and Beyond

� There is going to be a lot of blurring when it comes to

cloud model definitions.

� The future of the cloud will pretty much see everyone

adopt some type of hybrid cloud platform. Why?

1. Firstly, most organizations are already in the cloud.

2. Secondly, there are a lot of new options in terms of

connecting a private cloud with some cloud resources.

� New cloud management solutions aim to control your

cloud regardless of the platform.

� Hybrid, public, private and even community clouds can

all be controlled from a single console.

LinuxVDI

Pri

vate

Clo

ud

Pu

bli

c C

lou

dH

yb

rid

Clo

ud

Mobility –As Defined by the User, Apps and Devices� Forget about devices. The fad around mobility being defined around the

device is over.

� “BYOD” is only the tip of the iceberg and a very tactical conversation. Time to

switch to strategy when it comes to mobility.

� Mobility revolves around the delivery of applications, workloads and data to an

ever-mobile user. This can be to any device.

� In the future, the goal will be to deliver the best possible user experience

regardless of the device.

� Here’s something we all need to come to terms with:

� The age of the PC, as we know, is coming to a close.

� Look for a much more mobile user, and a much more mobile data layer.

… of CIOs believe that mobility will have as much impact or greater impact than the web. (Accenture, 2014)

73%

Security, Compliance, Regulations… Oh my.

• Big regulations like SOX, PCI/DSS and HIPAA are making technology

adjustments.

• The recent Omnibus Rule as a modification to HIPAA can actually allow

you to store data for collaboration in the cloud.

• Solutions like Citrix Sharefile Cloud for Healthcare and even Rackspace

jumped all over this, signed a business associate agreement (BAA), and can

now process protected healthcare information (PHI) directly from the cloud.

• Microsoft announced in December that its Azure Cloud for Government

supports such standards as FedRAMP, FISMA, DOD Enterprise Cloud

Service Broker, HIPAA, IRS 1075 and CJIS.

• Microsoft and Amazon Web Services (AWS) offer tools that make it easier

for agencies to create hybrid systems

• Some applications reside in government-run clouds while others are in public

clouds.

• As for security – it’ll always be an ongoing battle.

• Look for more virtual services, more data center and network integration,

and more protections around mobile data.

10

10

SS

L1

01

01

01

01

01

10

SS

L1

01

0

Thank You! Any questions?

�Network: Linkedin.com/in/BillKleyman

�Follow: @QuadStack | @MTM_INC

�Social: Facebook.com/mtmtechnologies

"Cloudy with a 100% chance of GigaWatts"

Russell PeaseBusiness Development Manager, CyrusOne Data Centers

Tweet: #cloudcamp


Sponsored by

Hosted by

Cloudy with a 100% chance of Gigawatts

Russell Pease Featuring: 7 Billion People , millions of servers

Cloudy with a 100% chance of Gigawatts

• The Cloud –what it means to me (and me! and me!)

• Where exactly are the Clouds? (Public ) • What drives Cloud Location (MTDC) • The guts- basics –physical aspect

The Cloud- then and now or where's my stuff?

• Mature /Silents - Huh? • Baby Boomers - “It’s like an AS400 IBM Mainframe”

• Gen X‘ers - Place to store some “stuff”-”not on my PC”

• Gen Y / Millennials – Duh -“the link to the world”

Where are the Clouds? Let’s focus on the Big 4 Public platforms–AWS, Apple, MSFT, IBM AWS -11 geographical "regions": • US East , NoVa - majority of AWS servers are based here

• US West (NorCal, Oregon ) • Brazil (Sao Paolo) • Europe (Ireland and Germany) • Southeast Asia (Singapore) • East Asia (Tokyo, Beijing) • Australia (Sydney)

Where are the Clouds? Apple - “Maiden” built in 2010 500K sft. (North Carolina)

- Reno, NV 2,200 acres!

MSFT - Americas- SC, Iowa, Georgia, OK, NC, Oregon, Chile

- Asia- Taiwan, Singapore - Europe- Finland, Belgium, Ireland IBM -Investing 1.2B to build out local cloud Hubs -40 data centers in 5 continents

What drives Location? Right Brained Rules! It’s about Efficiency

• Lots of POWER- low rates! (In 2013, U.S. data centers consumed an estimated 91 billion kilowatt-hours of electricity)

• Cooling-including climate driven efficiencies

• Interconnection(Content accessibility)

• State sponsored tax incentives- TX, AZ, NoVA, etc.

US Players in MTDC There are over 510,000 Data Centers in the World- Newmark Grubb GCS

The global data center colocation market is expected to grow from $16.65 B in 2014 to $49.57 B by

2019. (CAGR of 17.6)

Skies for the Cloud CyrusOne PHX 1M sft Phase 1 DFT NoVa ACC7 450K sft

Green field builds yield efficiency and speed to market!

Demand Capture A Modular approach is common to mitigate ”THE RISK”

Time/effort/money is spent up front on common platforms - land, building shell, network, fire protection, security

Electrical and mechanical subsystems are remanufactured offsite as needed

Supply chain engineering to deliver electrical and mechanical subsystems onsite just-in-time

Delivery of data centers in as little as 16 weeks

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&uact=8&ved=0CAcQjRw&url=http://www.datacenterknowledge.com/archives/2013/04/30/cyrusone-big-in-texas/&ei=tFitVLCRFIGyyASW1IKACg&bvm=bv.83134100,d.aWw&psig=AFQjCNGzqzhVng46JUmTlvgGUFrYBycdkw&ust=1420732971945814

Efficiencies continue to improve –water in the data center?

The Guts (Basics) Power • Generators (supports facility from utility failure) • Battery back up • UPS (Uninterruptible Power Supply /Source) • PDU (Power Distribution Unit) • Power WHIPS

Mechanical • Chillers ( disperses heat from facility) • CRAC- (Computer Room Air Conditioners- so servers are

cozy)

NORMAL UTILITY GENERATOR UPS PDU POWER POD

"The Red Hat OS1 Cloud: You want guts?"

Dan Yocum Principal Systems Engineer, Red Hat

Tweet: @yocum137 #cloudcamp


Sponsored by

Hosted by

01/05/15 Red Hat, Inc. 1

OPENSH

IFT

TECHO

PS

The Red Hat OS1 Cloud

●You want guts?

DanYocum

01/05/15 Red Hat, Inc. 2

The Data Center

● Wholesale or Retail– Digital Realty– Internap– Savvis– Et al.

● Cage● Rack(s)● Electrical – 240V● Cooling – enough tonnage● Network – Internal and Edge

● SLAs– Power– Cooling– Network– Environmental monitoring

● Temperature● Humidity● Fire supression● Access

01/05/15 Red Hat, Inc. 3

Design Considerations

● High CPU usage?● High Memory usage?● High IO usage?● High Availability?● Monolithic Storage with a Clustered Filesystem?● Fragmented Storage for HDFS? PVFS? NoSQL? Lustre?● General Purpose?

01/05/15 Red Hat, Inc. 4

Hardware Infrastructure

● Basic Specs– Dual redundant rack PDUs, separate building circuits– Dual redundant network switches (hire a network

admin!)– Dual redundant power supplies for systems– RAID system disks– >=2 10GbT bonded NICs

01/05/15 Red Hat, Inc. 5


● Specs for a small OpenStack Cell – 64 compute nodes:

– Juniper EX4550 32port 10GbT TOR switch– NetApp FAS2240-2 (maxes out at 60 clients &

~1500 active processes)● Hitting Consistency Points● Would buy larger model with ability to expand.

01/05/15 Red Hat, Inc. 6


– 2 MySQL database nodes● 2 RAID1 SSDs, 16GB RAM, 4-core● Multi-master Replication or galera

– 2 Operations nodes● 4 RAID10 SATA, 128GB RAM, 8-core● Libvirt for VMs

01/05/15 Red Hat, Inc. 7


AMD SeaMicro SM15000 Fabric Compute Chassis

64 compute nodes- 64GB RAM- 8-core Opteron- 8-1Gbps NICSVirtual L2 switch4-10Gbps uplinks

01/05/15 Red Hat, Inc. 8

Software Infrastructure

● On each Operations node duplicates of these:– 1 VM – provisioning (foreman) and configuration management

(puppet) – rsync for replication– 1 VM – bind DNS – Designate– 1 VM – software Load Balancer - LVS or haproxy– 1 VM – messaging service – rabbitmq– 1 VM – OpenStack control node – nova, glance, cinder, heat, etc.– 1 VM – performance (ganglia) and availability (zabbix) monitoring

01/05/15 Red Hat, Inc. 9

Conclusion

● Software Engineers over-abstract systems away.● System Engineers can't abstract systems away.● Hardware is hard (the hood is welded shut).● Configuration management is hard.● Performance monitoring is easy.● Availability monitoring is less easy.

"The Importance of the Network Enabled Cloud"

Ron Zirkin Enterprise Account Manager, XO Communications

Tweet: @ronzirkin #cloudcamp


Sponsored by

Hosted by

Ron Zirkin

Enterprise Account Manager


The Importance of the

Network Enabled Cloud


Essential Characteristics

of The Cloud


On-demand self-service

Ubiquitous Broad network access

Resource pooling

Rapid elasticity

Measured service

5 Characteristics of the Cloud


Multi- Cloud Environment & Network

1

2

The Emergence of the Multi-Cloud Ecosystem and Hybrid IT.

Network Enabled Cloud Story and Why it Matters

to You.


Cloud Adoption Issues for Businesses Exist

Source: CDW, 2013 State of the Cloud Report, May 2013

Security once dominated, but cloud service performance and other issues are

emerging as concerns that slow adoption

46%say yes

…concerns with security of

proprietary data or applications?

32%say yes

…concerns with performance

of cloud services?

Biggest Barriers:*

25%say yes

…concerns with technical aspects of

integrating cloud applications or

infrastructure with legacy systems?

Other Impeding Factors

22% report ambiguous

agreements with

vendors about who’s

responsible for what

20% report senior-level

non-IT management is

holding them back

21% report concerns

with locating services

in multi-tenant

environments

20% report software

licensing policy issues


Yet Enterprises are Moving to the Cloud –

Comptia Survey Shows:

“More than 50% of IT decision-makers indicated they will be using four or more cloud

platforms.”

6 in 10 Installing other platforms beyond

initial projects.

90 % responded have moved some

processes to the cloud and expect

to expand to multi-cloud

60% use cloud for data storage,

48% to improve business

continuity and 44% say it has

increased data security


So What is the Multi-Cloud Ecosystem?

• Three or more interconnected

cloud-based platforms, such as

IaaS, PaaS, or SaaS, private or

public.

• A massive collection of network

accessible services/APIs.

• Managed through a single point

of abstraction, such as a cloud

management platform.

• Becomes a catalyst for the

development of Hybrid IT as well

as Hybrid Cloud architectures

According to Gartner the evolution of Hybrid IT will lead towards the IT organization emerging as a

trusted cloud broker in the Multi-cloud environment


How Does Multi-Cloud Impact the WAN?

• Growth in complex cloud

implementations has increased the

intra- and inter-company networking

requirements.

– Network performance is a key issue

when implementing multi-cloud

solutions.

– Network governance and management

a core concern, as is integrated

security and application performance.

A recent survey of 154 IT decision-makers from enterprises in the United States found that the

majority of organizations have embraced cloud services, but that their networks have kept them from

realizing the full potential of their cloud investments.


Define your network strategy in tandem with

your cloud strategy

Move your network

investment to the forefront of

your IT initiatives

Recognize that everything you do will affect the network

Work with a strategic

partner. Network engineering is

not a core competency of

most companies.

Lessons Learned from Forrester Study regarding Cloud Adoption and the network


Enterprise Cloud Computing


Less Bottlenecks seen in typical expansion

Expansion and contraction on demand through Virtualization

Power issues Mitigated

Physical data loss due to malicious attack reduced

Faster, Cheaper, And Safer

Enterprise Objectives by adopting Cloud Strategy


• Readily Accessible

• Concerns for Dependability and Performance

• Best Efforts (No SLA)

• Need additional engineering for security

Internet

• Scalable

• Secure

• Provides only site to site connectivity

Private Line

• Scalable

• Secure

• Any to Any Site connectivity

• Quality of Service (QOS)

• Service Level Agreements (SLAs)

MPLS (Layer 3 IP-VPNs)

Network Connectivity Options


Nemertes refers to the strategy as the three-tiered WAN architecture.

(The notion behind the three-tiered WAN is that there's no one-size-fits-

all WAN technology. Instead, some technologies and services work

better in certain network tiers than others -- and most organizations

deploy a mix of two or more technologies to cover all three tiers.

http://searchenterprisewan.techtarget.com/news/2240150369/Should-you-redesign-WAN-architecture-for-cloud-and-UC


The Network Enabled Cloud Vision

MPLS IP-VPN

(“IT Manages the WAN &

the Relationships with

the Cloud providers”)

Enterprise

Branch Site

Customer

Data

Center

Enterprise

HQ SiteAWS

Direct Connect

Equinix

Cloud

Exchange

Open Cloud

Exchange

Additional

Clouds

Customer

Data

Center

Enterprise

Branch Site

Additional

Clouds

:


Amazon Web Services Direct Connect

AWS Connection Options:

• 1 Gbps or 10 Gbps Private Line or MPLS (w/cross-connect)

• Can also leverage Bandwidth on Demand (BoD) option

• 50, 100, 200, 300, 400 & 500 Mbps via NNI connection (no cross-connect required)


Amazon Web Services Direct Connect

Summary

• MPLS and Private Line options give customers dedicated, secure, consistent, and reliable access to AWS Cloud services

• Minimizes security concerns when compared to accessing AWS via the public Internet

• Connection speeds from 50 Mbps to 10 Gbps

• Ability to overlay additional services, including:

• Bandwidth on Demand (BoD)

• Premium Class of Service (CoS)

• Hosted Security

• Applications Performance Management (APM)

• Managed Services


[email protected]

@ronzirkin

mailto:[email protected]

Un-panel Discussion

volunteer to join the panel & ask questions from the floor!


Sponsored by

Hosted by

Unconference

Small groups & discussions, network

Pizza’s almost here!


Sponsored by

Hosted by

cloudcamp chicago jan 2015 - the guts of the cloud (full slides)

Technology

cloud data centers

cloud connectivity2

cloudcamp chicago guts

cloud communication

calendars cloudcamp

cloud connectivity platforms

red hat os1 cloud

cisco cloud index reportwhats