nca gtug 2012 - cloud is such stuff as dreams are made on

Patrick ChanezonSenior DirectorDeveloper Relationschanezonp@vmware.comhttp://twitter.com/chanezon NCA GTUG, January 2012

Cloud is such stuff as dreams are made on

Wednesday, February 1, 12

P@ in a nutshell

• French, based in San Francisco

• Senior Director, Developer Relations, VMware

• Software Plumber, API guy, mix of Enterprise and Consumer

• 18 years writing software, backend guy with a taste for javascript

• 2 y Accenture (Notes guru), 3 y Netscape/AOL (Servers, Portals), 5 y Sun (ecommerce, blogs, Portals, feeds, open source)

• 6 years at Google, API guy (first hired, helped start the team)

• Adwords, Checkout, Social, HTML5, Cloud

P@ & Military Software

Dreams Of my childhood

Accelerando / Singularity, in a Galaxy far far away

§ Even if we automate ourselves out of a job every 10 years

§ ...I don’t think the singularity is near!

Moore's Law is for Hardware Only

§ Does not apply to software

§ Productivity gains not keeping up with hardware and bandwidth

§ Writing software is hard, painful, and still very much a craft

Moore's Law’s free lunch is over

§ Herb Sutter, Welcome to the Junglehttp://herbsutter.com/welcome-to-the-jungle/

Predictions

“The future is already here — it's just not very evenly distributed” William Gibson

Architecture Changes: 60’s Mainframe

Architecture Changes: 80’s Client-Server

Architecture Changes: 90’s Web

Architecture Changes: 2010’s Cloud, HTML5, Mobile

Back to Client Server: Groovy Baby!

What is Cloud Computing?

Cloud According to my daughter Eliette

Cloud Stack - Classic Pyramid

Platform As A Service

Infrastructure As A Service

SoftwareAs A Service

Cloud Stack - By Number

InfrastructureAs A Service

Cloud Stack - By Value

InfrastructureAs A Service

Cloud Stack - Neutral

Infrastructure As A Service

Crossing the Chasm

§ Build the whole product

§ Cloud getting mainstream: Apple iCloud

§ Opportunities and risks

§ Ecosystems, various platforms

Picture from Wikimedia Foundation http://en.wikipedia.org/wiki/File:Technology-Adoption-Lifecycle.png

Cloud Stack - History

§ What does cloud mean, 4 main angles• Software 1994 Netscape

• Infrastructure 2002 Amazon AWS

• Platform 2008 Google

• Development now!

§ Industrialization of hardware and software infrastructure• like electricity beginning of 20th century, cf The Big Switch, Nick Carr

§ But software development itself is moving towards craftmanship

Cloud started at Consumer websites solving their needs

• Google, Amazon, Yahoo, Facebook, Twitter

• Large Data Sets

• Storage Capacity growing faster than Moore’s Law

• Fast Networks

• Horizontal -> Vertical scalability

• Open Source Software

• Virtualization

• Cloud is a productization of these infrastructures

• Public Clouds Services: Google, Amazon

• Open Source Software: Hadoop, Eucalyptus, Ubuntu, Cloud Foundry

Infrastructure

IaaS/Virtualization getting mainstream

§ AWS, Joyent, Rackspace,...

§ Open Source projects: OpenStack, DeltaCloud, Eucalyptus

§ Automation: Chef, Juju

§ Standardization? DMTF

§ Inside the Firewall, Virtualization: VMware, Microsoft, Xen, KVM

§ 50% of workloads are virtualized

§ Easy to provision, manage instance...BUT

§ Still need to manage backups, software stacks, monitor, upgrades

With Infrastructure, you still need to build your own platform

§ Need to build a distributed platform on top of you infrastructure

§ Story of the AWS meltdown from last summer• http://blog.reddit.com/2011/03/why-reddit-was-down-for-6-of-last-24.html

• http://www.readwriteweb.com/cloud/2010/12/chaos-monkey-how-netflix-uses.php

• http://news.ycombinator.com/item?id=2477296

• http://stu.mp/2011/04/the-cloud-is-not-a-silver-bullet.html

§ Twilio, Smugmug, SimpleGeo survived it because they built their own distributed platform on top of IaaS

§ Enterprise customers want to consider Infrastructure like CDNs• Multi Cloud usage

• Based on Open Source de facto standards, or full standards whenever that happens

Platforms

§ Raise the Unit of currency to be application & services instead of infrastructure

§ Google App Engine, Cloud Foundry, Joyent, Heroku, Stax (Cloudbees), Amazon elastic beanstalk, Microsoft Azure, AppFog

§ Single or a few languages, services

§ Start of Multi language Polyglot platforms

§ Enabler for Agile Developers -> Create Business value faster

§ Lack of standards: risk, vendor lock-in

§ Enterprise needs:•Control, customizability

•Private/Hybrid Cloud

•Avoid lock-in

Agile Development Processes

Agility as a survival skill

§ Consumer software is becoming like fashion•Phone apps, social apps, short lifetime, fast lifecycles

•Ab testing

§ Clay shirky situational apps

§ Kent Beck, Usenix 2011 Talk, “Software G-Forces”change in software process when frequency grows

§ Cloud Platforms enables an Agile culture, driver for innovation•Scalability is built in the platforms

•Can iterate faster

•Focus on design

§ Cloud Platforms lets developers focus on driving business value

Main Risk: Lock-In

Welcome to the hotel californiaSuch a lovely placeSuch a lovely facePlenty of room at the hotel californiaAny time of year, you can find it here

Last thing I remember, I wasRunning for the doorI had to find the passage backTo the place I was before’relax,’ said the night man,We are programmed to receive.You can checkout any time you like,But you can never leave!

Cloud Foundry: The Open PaaS

Application Service Private Clouds

PublicCloud

MicroCloud

Data Services

Other Services

Msg Services

vFabric Postgres

vFabric RabbitMQTM

• Open Source: Apache 2 Licensed

• multi language/frameworks

• multi services

• multi cloud

Open Source

Open Source Advantage

§ http://code.google.com/p/googleappengine/issues/detail?id=13

• https://github.com/cloudfoundry/vcap/pull/25

Multi Cloud

CloudFoundry.COM

Runtimes & Frameworks

Services

vCenter / vSphere

Cloud Foundry

Infrastructure

Cloud Foundry.ORG

The Source Code to Compile & Build Cloud Foundry

vCenter / vSphere

Cloud Foundry

DownloadCode

Setup Environment

Deploy Behind Firewall

Setup Scripts

Micro Cloud Foundry

What is a Micro Cloud?

Entire Cloud Running inside of a single VM

Micro Cloud Foundry… (BETA)

A pre-built Micro (Single VM) version of Cloud Foundry…

Signup @ http://cloudfoundry.com/micro

You need a Cloud Foundry.com Account to use Micro Cloud Foundry

Micro Cloud Foundry… (BETA)

A pre-built Micro (Single VM) version of Cloud Foundry…

Signup @ http://cloudfoundry.com/micro

You need a Cloud Foundry.com Account to use Micro Cloud Foundry

What is in Micro Cloud Foundry?

Open source Platform as a Service project

App Instances Services

Dynamic Updating DNS

Other Cloud Foundry powered PaaS

Private PaaS

Added Python and Perl

Public PaaS

Added PHP

Tier3 and Uhuru recently added .NET support

Development LifeCycle

Traditional App Deploy and Request/Response

Request/AllocateBuild/SetupInstall/ConfigureDeploy/Test

Scale?Upgrade?Update?

How Apps are Deployed on Cloud Foundry

“vmc push MyApp”

WebApp

“vmc instances MyApp 5”“vmc map MyApp MyApp2”“vmc update MyApp”

How Apps are Deployed on Cloud Foundry

WebApp

“vmc instances MyApp 5”“vmc map MyApp MyApp2”“vmc update MyApp”

How Apps are Accessed on Cloud Foundry

App Instance

Service

Request Web InterfaceLoad

Balancingand

Routing

Response

How Apps are Scaled on Cloud Foundry

App Instances

Service

Request

Response

Balancer(s)Load

Balancer(s)

Load Balancing

and Routing

“vmc instances MyApp 3”

How Apps are Updated on Cloud Foundry

Service

PreviousVersion

InstanceStopped

UpdatedCode

NewVersion

“vmc update MyApp”

Services

Current Services Available on Cloud Foundry

Service Creation and Binding

VCAP_SERVICES:

{"redis-2.2":[{"name":"redis_sample","label":"redis-2.2","plan":"free",

"tags":["redis","redis-2.2","key-value","nosql"],

"credentials":

{"hostname":"172.30.48.40",

"host":"172.30.48.40",

"port":5023,

"password":"8e9a901f-987d-4544-9a9e-ab0c143b5142",

"name":"de82c4bb-bd08-46c0-a850-af6534f71ca3"}

"mongodb-1.8":[{"name":"mongodb-e7d29","label":"mongodb-1.8","plan":"free","tags”:………………….

App Instance

App Instance Redis Service

MongoDB

Service

How it works

Logical View

VMC client STS plugin Browser(user app access)

Routers

CloudControllers App

Services

HealthManager

DEA Pool

Messaging

Architecture

Register today

http://cloudfoundry.com/signup

dc2012Use Promo Code

To avoid approval queue waiting time

Cloud for Developers: the true path is PaaS!

BigData Platforms: Hadoop

§ Apache Hadoop, open source version of Google MapReduce, GFS...

§ Cloudera, many others, space heating up

§ EMC, HortonWorks distros

§ Google Bigquery

§ Be your own bitch, today, Cloudera distro

Services

§ Services

§ Apis, apigee, mashery

§ Telephony, Twilio

§ Geo

§ Social

§ Visualization

Development

§ Final frontier, happening now

§ Not whole product yet

§ Source: Google code, Github

§ Dev: Cloud9, Exo, Orion

§ Higher level case tools, Wavemaker, Orangescape, Runmyprocess

§ Build: Jenkins, Cloudbees, OpenShift

§ Test: feature of cloud platforms

§ Community Stackoverflow, Github

Lessons for Developers

Predictions

§ Software is becoming like fashion, design rules

§ Welcome to Babel, use the best tool for the job, embrace multiple language & heterogeneity

§ Our jobs will change, build yourself out of your current job

§ Sysadmin jobs will disappear, except at large cloud providers

§ Many opportunities open when you embrace change

Chaos of creativity

§ Proliferation of languages and frameworks

§ Spring, Rails, Grails, Django

§ “Pythons has more web frameworks than language keywords”

§ Javascript, Python, PHP, Java, Groovy, Scala, Clojure, Go

§ Gosling, vm is important, not the language

§ Ability to create DSL important, cf Book

§ Fragmentation of communities

§ Chaotic Darwinian period, fun for the curious, deadly for the ossified

§ Online services replacing a lot of software

§ Mashups, Weaving services together

§ Pick your battles, choose what you need to build yourself to add value

Things to Forget

§ First normal form

§ Waterfall model

§ Single server deployment

§ Single language skill

Things to Learn

• Agile, API Design

• UI Design, Javacript, HTML5, CSS3

• A/B Testing

• Open Source, Open Standards

• Architecture, Distributed Computing (CAP theorem, 8 fallacies)

• Cloud Platforms and APIs

• Multiple types of

• languages (imperative, object, functional, logic)

• Learn to live in a box (embrace platform limitations) to think outside the box

What it means for you

§ Build On the shoulders of giants

§ Take risks, to innovate

§ Learn everyday, try different things

§ learn an api or framework / month

§ Learn a language / year

§ Be fast and agile

§ Make money

§ Social and app stores

Be your own bitch

“Don’t be a Google Bitch, don’t be a Facebook Bitch, and Don’t be a Twitter Bitch. Be your own Bitch.”Fred Wilson

http://techcrunch.com/2011/05/23/fred-wilson-be-your-own-bitch/

Such stuff as dreams are made on

§ Like a kid on a candy store: there's never been a better time to be a software developer!

§ Welcome to the Cloud: embrace change and reinvent yourselves

§ “The future is already there, not evenly distributed” Gibson

§ We Developers, invent the future today

Cloud Foundry Resources

Primary Site : cloudfoundry.com

Open Source Site : cloudfoundry.org

Twitter : @cloudfoundry , hash tag #cfoundry

Blog : blog.cloudfoundry.com

FB : facebook.com/cloudfoundry

Support : support.cloudfoundry.com• Documentation

• Knowledge Base

• Q & A / Forums

Questions

?Wednesday, February 1, 12

Thank You!@CloudFoundry

@chanezon

Website : www.cloudfoundry.comBlog : blog.cloudfoundry.comForum : support.cloudfoundry.com

Books / Articles

§ Nick Carr, The Big Switch

§ Eric Raymond, The Art of Unix Programming

§ Weinberg, Psychology of Computer Programming

§ Wes python book

§ Mark html5 book

§ Kent Beck XP

§ Hunt, Thomas, The Pragmatic Programmer

§ Ade Oshineye, Apprenticeship Patterns

§ Matt Cutt's Ignite Talk IO 2011, Trying different things

§ Josh Bloch talk about api design

§ Larry and Sergey, Anatomy of a Search Engine

§ Rob Pike, The Practice of Programming

Papers / Talks

§ Simon Wardley, Oscon 09 “Cloud - Why IT Matters”

§ Tim O’Reilly article on internet os

§ Peter Deutsch’s 8 Fallacies of Distributed Computing

§ Brewer’s CAP Theorem

§ Gregor Hohpe’s Starbucks Does Not Use Two-Phase Commit

§ Stuff I tag http://www.delicious.com/chanezon/

§ More specifically http://www.delicious.com/chanezon/cloudfoundry

§ My previous Talks http://www.slideshare.net/chanezon

§ My list of favorite books http://www.chanezon.com/pat/soft_books.html

Acknowledgement

§ Drawings from my daughters Eliette

§ Slides from Dave McCrory, Derek Collison, Russell Acton, Alexandre Vasseur

nca gtug 2012 - cloud is such stuff as dreams are made on

service software

software infrastructure

service infrastructure

s cloud

cloud foundry

service platform

product cloud

software development

Technology

gtug presentation · gtug presentation comforte‘s...

pt gtug 1st technical tession - android

google guava & emf @ gtug nantes

nantes gtug - restlet & appengine

hpe nonstop gtug berlin - 'yuma' workshop

beginning android flash development - gtug edition

nca ta website:...

powering the social web (at the dublin gtug)

unit testing - gtug

20110525[taipei gtug] titanium mobile簡介

hello android&&android in china(gtug)

john vlachoyiannis "appengine - fast track" 1st gtug greece...

android - pune gtug

taipei gtug opening

gtug philippines - implementing google analytics -...

gtug js will save us all

hello android - gtug kl meetup 27062009

web 2.0 technology by gtug-addis march 5,2011

gtug event 3

gtug youtube