cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/patrickde... · test...
TRANSCRIPT
![Page 1: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/1.jpg)
Cloud... so much more than a tools fest
Patrick Deboishttp://localizationlocalisation.files.wordpress.com/2010/08/rolling-out-old-tools.jpg
Qcon London 2012
![Page 3: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/3.jpg)
@patrickdebois
![Page 4: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/4.jpg)
Freelancer
![Page 5: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/5.jpg)
Context:a traditional enterprise
![Page 6: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/6.jpg)
http://1.bp.blogspot.com/-dJydLIEZCQA/TtO26OpjywI/AAAAAAAADBg/wo3Vpl-eesc/s800/Cat%2BArmy.jpg
With a developer group
on a mission
to innovate
![Page 7: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/7.jpg)
Realtime TV - Web interaction
![Page 8: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/8.jpg)
Second Screen Applications
![Page 9: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/9.jpg)
http://www.twylah.com/billycoover/topics/xamarin
![Page 10: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/10.jpg)
http://icanhascheezburger.files.wordpress.com/2011/09/2afc3f14-2ab1-49dc-819e-87490c58b16f.jpg
TV-show+/- 1 million
concurrent viewers
![Page 11: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/11.jpg)
http://www.twylah.com/billycoover/topics/xamarin
![Page 12: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/12.jpg)
![Page 13: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/13.jpg)
Google AppEngine
![Page 14: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/14.jpg)
Abstraction is AWESOME
![Page 15: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/15.jpg)
If it failshard to debug/
understand
![Page 16: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/16.jpg)
Too generic
EsperPython Nodejs
RedisMongodb
HadoopJava RailsMysql
ETL tools
![Page 17: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/17.jpg)
Need more control
![Page 18: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/18.jpg)
IAAS
http://3.bp.blogspot.com/-TgmC6DkVNiU/TzCTP_BxWqI/AAAAAAAAAb8/797iiSLQ3FY/s1600/funny-pictures-cat-fixes-your-computer.jpg
![Page 19: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/19.jpg)
http://meowcheese.com/files/lolpics/2010/05/dog-not-cat.jpg
I never did any cloud before.
Only enterprisestuff
![Page 20: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/20.jpg)
http://www.collthings.co.uk/2008/06/10-very-rare-clouds.html
What I learned from managing Production Servers
![Page 21: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/21.jpg)
WEBAPPDB
A Single Server
![Page 22: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/22.jpg)
WEBAPPDB
Starts Growing
WEBAPP
WEBAPP
![Page 23: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/23.jpg)
DB
Generic Servers become Specific Servers
WEB
APP
WEB
APP
WEB
APP
![Page 24: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/24.jpg)
DB
Physical becomes Virtual
WEB
APP
WEB
APP
WEB
APP
xen/vsphere/kvm/...
![Page 25: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/25.jpg)
DB
We learned cloning isn’t working
WEBvI
APP
WEBv2
APP
WEBv1
APP
![Page 26: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/26.jpg)
We introduce config management
APPWEB DB
= = =
WEB
JEOS
Config
APP
JEOS
Config
DB
JEOS
Config
![Page 27: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/27.jpg)
Infrastructure as code
WEB
JEOS
Config
APP
JEOS
Config
DB
JEOS
Config
Config ManagementCode Repository
Cfengine/Puppet/Chef
![Page 28: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/28.jpg)
http://www.collthings.co.uk/2008/06/10-very-rare-clouds.html
What I learned from managing Test Servers
![Page 29: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/29.jpg)
InfrastructureCode Repository
DB
WEB
APP
DB
WEB
APP
TEST PROD
Reuse Across Environments
DEV
![Page 30: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/30.jpg)
TEST PROD
Explosion of VM creation
DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
InfrastructureCode Repository
ApplicationCode Repository
DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
DEV
![Page 31: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/31.jpg)
UI Interface to Automated Provisioning of VMS
INFRA DBWEB APP
APP DBWEB APP
VM VM VM
Cobbler,Spacewalk, ...
![Page 32: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/32.jpg)
INFRA DBWEB APP
APP DBWEB APP
VM VM VM
ConfigManagement
Puppet/ChefServer
Metadata Registry for Systems
![Page 33: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/33.jpg)
![Page 34: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/34.jpg)
![Page 35: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/35.jpg)
I’VE NEVER INSTALLED A GUI FOR THAT.
![Page 36: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/36.jpg)
$ knife ec2 server create \-r 'role[webserver]' -I ami-7000f019 \-f m1.small \-A 'Your AWS Access Key ID' \-K 'Your AWS Secret Access Key'
![Page 37: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/37.jpg)
$ puppet node create -‐-‐image ami-‐XxXXxXXX \-‐-‐keypair puppetlabs.admin -‐-‐type m1.small
aka “cloudpack”
![Page 38: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/38.jpg)
http://fog.io@geemus
ServersKeys
Elastic Loadbalancers
Securitygroups
CustomScripts
S3 StorageE-Mail service
![Page 39: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/39.jpg)
AWS Network Constraints
Security Groups only on
creation
Only 1 networkinterface
ELBnot on non-
standard ports
http://iruntheinternet.com/lulzdump/images/cat-in-jar-cok-stuck-1298144751i.jpg
![Page 40: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/40.jpg)
Dynamic Monitoringnodes = search(:node, "hostname:[* TO *] AND chef_environment:#{node.chef_environment}")
![Page 41: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/41.jpg)
http://icanhascheezburger.files.wordpress.com/2009/09/funny-pictures-cat-is-squished.jpg
VM creation failure, network hickups, disk erratic behavior
![Page 42: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/42.jpg)
Embrace
![Page 43: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/43.jpg)
Re-architect
![Page 44: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/44.jpg)
“Quis custodietipsos Custodes”
who watches the watchers
![Page 45: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/45.jpg)
Noops
![Page 46: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/46.jpg)
What I learned working in the (Amazon)cloud
![Page 47: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/47.jpg)
AMIJEOS
Config Mgmt Config Mgmt
VM Xen
Web,App,DB Web,App,DB
UI Provision AWS Console
Internal Cloud
what’s the difference ?
Metadata Registry Metadata Registry
![Page 48: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/48.jpg)
AWS Console
FogJcloudsBoto
AWS API
From console to API
Web UI
“Internals” API
AbstractedAPI
![Page 49: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/49.jpg)
Beyond Servers Components
Server(s)
LoadbalancersDNS ServiceIP Address
Email ServiceEBS Volume
FirewallKeys
+
![Page 50: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/50.jpg)
Cloudformation
From server to stack
Json file specifyingorder of component creation
and dependencies
![Page 51: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/51.jpg)
http://www.collthings.co.uk/2008/06/10-very-rare-clouds.html
What I learned from managing development Servers
![Page 52: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/52.jpg)
DB
WEB
APP
Development movesfrom host into virtual machines
HOST
DB
WEB
APP
HOST
VM
![Page 53: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/53.jpg)
Developmentstarts using config mgt
DB
WEB
APP
HOST
VM
JEOS
DB
WEB
APP
HOST
VM
Config
![Page 54: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/54.jpg)
InfrastructureCode Repository
DB
WEB
APP
DB
WEB
APP
DB
WEB
APP
DEV TEST PROD
Reuse “code” across Environments
![Page 55: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/55.jpg)
DB
WEB
APP
HOST
VM
JEOS
http://vagrantup.com/
Simple CLI
UPPROVISION
HALTDESTROY
Vagrantfile
Config
Basebox
Puppet/Chef
VM Management
Vagrant
![Page 56: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/56.jpg)
INFRA DBWEB APP
DEV TEST PROD
Integrate with Continuous Integration
APP DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
InfrastructureCode Repository
ApplicationCode Repository
![Page 57: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/57.jpg)
DB
WEB
APP
VM
JEOS
Config
Development/VM workflow
UP
PROVISION
HALT DESTROY
![Page 58: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/58.jpg)
INFRA DBWEB APP
TEST
PROD
Peak Capacity needed in Prod
APP DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
CLOUD
Setup OutgrewTest Lab
Setup OutgrewVM on Laptop
DEV
![Page 59: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/59.jpg)
Mccloud (simple CLI)
AWS
Fog Library (API)
JEOS
Config Mgmt
Web,App,DB
AWS
JEOS
Config Mgmt
Web,App,DB
AWS
JEOS
Config Mgmt
Web,App,DB
DEV TEST PROD
Reuse “workflow” across Environments
“If it’s hard to it more often”
![Page 60: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/60.jpg)
+Reuse workflow across hypervisors
Virtualbox KVM AWS
Fog Library
JEOS
Config Mgmt
Web,App,DB
JEOS
Config Mgmt
Web,App,DB
JEOS
Config Mgmt
Web,App,DB
customers
![Page 61: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/61.jpg)
Cloud Libs (Jclouds/Fog/Boto)embracing old and personal
AWS
RackspaceEucalyptus
Openstack
“old” “new”
VsphereVirtualbox
KvmLibvirtVM Fusion
“personal” “hybrid”
![Page 62: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/62.jpg)
http://github.com/jedi4ever/veewee
Abstracting OS Installation
Kickstart Preseed
Unattended.xml
Debian Ubuntu Solaris Win
Archlinux Suse Centos
Redhat
Virtualbox KVM Fusion Parallels
![Page 63: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/63.jpg)
Cloud Libs (Jclouds/Fog/Boto)beyond servers
DNS Keys IPs Storage
LoadbalancerSecuritygroups
![Page 64: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/64.jpg)
Workflow beyond servers
upprovision
haltdestroy
ipbalancesorry
VM
Other
![Page 65: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/65.jpg)
Self Servicing
![Page 66: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/66.jpg)
INFRA DBWEB APP
DEV TEST PROD
Continuous Integration to Continuous Delivery
APP DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
InfrastructureCode Repository
ApplicationCode Repository
Faster/Delivery
Faster/Feedback
![Page 67: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/67.jpg)
Confidence
![Page 68: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/68.jpg)
Faster/Delivery
Faster/Feedback
DEV OPS
![Page 69: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/69.jpg)
Infrastructure ~ Code
![Page 70: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/70.jpg)
Add Test
WatchTest Fail
Run tests Write Code
Refactor
TDD Cycle
![Page 71: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/71.jpg)
Testing ~ Monitoring
Cucumber-nagios
![Page 72: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/72.jpg)
Debugging ~ Metrics
![Page 73: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/73.jpg)
TEST PROD
Metrics Reuse
DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
Collectd,Ganglia,Graphite, Opentsdb
Traditional Ops
![Page 74: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/74.jpg)
TEST PROD
Extend “metrics” to Development
DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
Collectd,Ganglia,Graphite, Opentsdb
DEV
DBWEB APP
DBWEB APP
![Page 75: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/75.jpg)
TEST PROD
Extend “logs” to Development
DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
Logstash, Graylog
DEV
DBWEB APP
DBWEB APP
![Page 76: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/76.jpg)
TEST PROD
Selfservicing “metrics injection”
DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
StatsD
DEV
DBWEB APP
DBWEB APP
![Page 77: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/77.jpg)
TEST PROD
Selfservicing “alerts”
DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
Tatle
DEV
DBWEB APP
DBWEB APP
![Page 78: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/78.jpg)
TEST PROD
Selfservicing “graphs”
DBWEB APP
DBWEB APP
DBWEB APP
DBWEB APP
Graphite
DEV
DBWEB APP
DBWEB APP
![Page 79: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/79.jpg)
Repeating Service PatternSimple API/CLI , Self-Servicing
Heroku Blitz.io New Relic
App Deployment
Load Testing
AppMetrics Logging
LogglyPager Duty
AlertingMonitoring
Pingdom
ContinuousIntegration
Cloudbees DatadogHQ
AppMetrics
![Page 80: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/80.jpg)
+Reuse workflow across monitoring tools
Nagios Zenoss Sensu
“my dream” Library
Collectd Ganglia Graphite
![Page 81: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/81.jpg)
Workflow reuse
Monitoring UP
![Page 82: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/82.jpg)
Abstracting
It’s all events
Timestamp - Key - Value
Logs Metrics Monitoring Meta Ops
![Page 83: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/83.jpg)
Social ITradiate information to where it’s needed
Business ‘Pulse’
![Page 84: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/84.jpg)
http://www.collthings.co.uk/2008/06/10-very-rare-clouds.html
So maybe you don’t have
unlimited resources
![Page 85: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/85.jpg)
But you can shape your internal IT as a cloud
![Page 86: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/86.jpg)
Questions?
![Page 87: Cloud so much more than a tools festgotocon.com/dl/qcon-london-2012/slides/PatrickDe... · TEST PROD Explosion of VM creation WEB APP DB WEB APP DB WEB APP DB WEB APP DB Infrastructure](https://reader033.vdocument.in/reader033/viewer/2022051410/6029d302e88ab50f931e5d1b/html5/thumbnails/87.jpg)
http://www.collthings.co.uk/2008/06/10-very-rare-clouds.html
Thank you!