using aws, eucalyptus and chef for the optimal hybrid cloud
DESCRIPTION
How Mosaik Solutions Delivers Mission-Critical Mobile Network IntelTRANSCRIPT
![Page 1: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/1.jpg)
![Page 2: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/2.jpg)
Using AWS, Eucalyptus
and Chef for the
Optimal Hybrid Cloud
Daniel Bozeman, Software Engineer
![Page 3: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/3.jpg)
Hello
![Page 4: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/4.jpg)
My Background
• Software Development
• Traditional Systems Administration and datacenter design
• AWS
• DevOps / Infrastructure Engineering
• My opinions are my own and do not necessarily represent
those of my employer, Mosaik Solutions
![Page 5: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/5.jpg)
About Mosaik
• Founded in 1988, creating roaming guides
• Transitioned into making “coverage map” art assets for carrier
retail locations and television
• Launched our first wireless industry intelligence web SaaS
application, WiSARD, in 1999
• We’ve built highly skilled GIS, Research, Creative, and
Development teams
• Launched MapELEMENTS in 2011, putting powerful GIS tools
into the hands of decision makers through the web browser
• Clients include Fortune 100 companies, Federal agencies, and
regional and international mobile operators
![Page 6: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/6.jpg)
![Page 7: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/7.jpg)
![Page 8: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/8.jpg)
On with the show!
![Page 9: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/9.jpg)
![Page 10: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/10.jpg)
Problem: “The cloud” gets
expensive (fast)
![Page 11: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/11.jpg)
“The cloud” gets expensive (fast)
Requirements
We need to run an application in the cloud. It costs $5,000
per month. We also need a replica of the application stack to
stage new releases for in-house and customer testing. We
also need a replica of the application stack for development.
Problem
We just tripled the cost of our application!
Solution
Run your non-production stacks in-house on commodity
hardware.
![Page 12: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/12.jpg)
Problem: Developers are Rock
Stars
![Page 13: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/13.jpg)
![Page 14: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/14.jpg)
Developers are Rock Stars
Requirements
Developer autonomy can often lead to new products,
increases in efficiency, and overall developer happiness.
Problem
Despite having your best interests in mind, one of your
developers accidentally left five very expensive test servers
running for two weeks.
Solution
Give your developers a sandbox that minimizes your
organizations operational expenditures.
![Page 15: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/15.jpg)
Problem: Time
![Page 16: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/16.jpg)
Time
Developer:
“Hi sysadmin! I hope all is well with you today! Um, yeah, I
need a server with 4 cores and 16GB of memory, networking,
DNS, accounts for my entire team with public keys uploaded,
and the list of software packages listed below installed and
patched. It also needs to ship logging information to our log
collector cluster. I need five of them. I need them for a
customer demo in 30 minutes, so if you could get those
together in the next 10, that’d be great. Mkaay?”
![Page 17: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/17.jpg)
Time
Systems Administrator:
“Sure, no problem! I just need to go show the sales team
how to restart their Outlook client and I’ll get right on that.
Oh, and I need to write a script to sanitize some of the data
in our CRM for marketing’s latest e-mail campaign. Uh oh, I
smell burning electronics. Also, even if I did know what you
were talking about, this is gonna take me 12 hours.”
![Page 18: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/18.jpg)
Time
Solution:
Provide your developers with a self-serve cloud
infrastructure. Sometimes developers need to deploy in-
house tooling to keep the software closer to a big dataset or
for security purposes. Empowering your developers to use
the same provisioning and infrastructure engineering tools
they utilize in the public cloud on-site will give your team a
serious efficiency edge.
![Page 19: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/19.jpg)
But is a private cloud for me?
![Page 20: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/20.jpg)
Money Money Money Money
• Time to put those Excel skills to use
• Get an idea of your overall cloud spending
• Don’t forget to investigate EC2 reserved instances, etc. as part
of your overall cloud savings plan
• Can any of my workloads by brought on-site?
• What are my capital expenditures going to be if I implement a
private cloud?
• What is the cost in man-hours of implementing my private cloud?
• Why haven’t you made a pretty graph yet of projected potential
savings over the next 36 months?
• Will you save enough money year over year for an additional
hire?
• Yes? What are you waiting for!?
![Page 21: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/21.jpg)
Back to Time
• If you’re heavily entrenched in a large-scale public cloud
deployment, hopefully your team has implemented (or is in the
progress of implementing) some infrastructure management and
server provisioning tooling using Chef or Puppet.
• Pick a private cloud provider that best “synergizes” with your
public cloud in order to minimize or eliminate re-tooling of your
DevOps codebase and processes.
• Not only will this provide you with additional man-hour savings
with your initial cloud deployment, but will allow you to migrate
stateless services between the public and private cloud with little
to no re-tooling. Some call this a “hybrid cloud”
![Page 22: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/22.jpg)
Our Use Cases
![Page 23: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/23.jpg)
Development and Staging
• We host a full development and staging stack of our
MapELEMENTS cloud-based GIS software solution on-site.
• We can play with new technologies and experiment on new Chef
cookbooks without having to spin up public cloud instances.
• Anything developed, improved or updated on-site can easily be
pushed into production in the public cloud thanks to Chef
managing our servers and watching our software repositories for
new commits to “production” branches.
• All internal tooling is now developed on and deployed to our
internal infrastructure with Chef and Eucalyptus.
![Page 24: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/24.jpg)
Another Problem: Solving
Complex Geospatial Problems
![Page 25: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/25.jpg)
Solution
Off-the-shelf desktop GIS software
![Page 26: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/26.jpg)
That was easy!
![Page 27: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/27.jpg)
Yet Another Problem: Solving Extremely
Complex Geospatial Problems Very
Quickly
![Page 28: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/28.jpg)
![Page 29: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/29.jpg)
![Page 30: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/30.jpg)
![Page 31: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/31.jpg)
Distributed Geoprocessor
• Break the problem up into small chunks
• Fire up “worker” instances with Chef in Eucalyptus
• Workers ask a “master instance” for the next task in a work
queue
• Workers complete their jobs and ask for a new task
• This process continues until the work queue is empty
• The job is done!
• This scales linearly. Should we need the job to complete faster to
meet a client deadline, we can simply fire up more worker
instances in Eucalyptus.
• Should we exceed our on-site resources, we can continue to fire
up more worker instances in EC2.
![Page 32: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/32.jpg)
Any Chef insights?
![Page 33: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/33.jpg)
Chef
Have an audit trail. You need to know when things work as
expected. More importantly, you need to know when things go
horribly wrong!
Also, prevent people from making stupid mistakes where possible.
![Page 34: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/34.jpg)
How you do that?
![Page 35: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/35.jpg)
Chef
One of our developers created knife-santoku, a replacement for
knife which supports callbacks and notifiers. Use it to send
messages to IRC, HipChat, etc. concerning who did what and
when. Also, have your chef clients phone home to your chat clients
as well concerning their current health, state of mind, and personal
feelings
https://github.com/knuckolls/knife-santoku/
![Page 36: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/36.jpg)
I’ll share a link to these slides on my Twitter:
@dboze
![Page 37: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/37.jpg)
![Page 38: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/38.jpg)
![Page 39: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/39.jpg)
© 2013 Eucalyptus Systems, Inc.
Supporting Private and Hybrid Cloud Infrastructure
David FederleinCustomer Success Team
![Page 40: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/40.jpg)
© 2013 Eucalyptus Systems, Inc.
Hello
40
![Page 41: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/41.jpg)
© 2013 Eucalyptus Systems, Inc.
Cloud vs. Traditional Enterprise
• Bottom Up vs. Top Down
• “It's just an extension of virtualized infrastructure.”
• Silo'ed Teams vs. Collaborative DEVOPS
41
![Page 42: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/42.jpg)
© 2012 Eucalyptus Systems, Inc.
Changes In Measurements of Success
• Useful Deployments vs. Simple Milestone Goals
• Engagement of Cross-functional Teams
• Not All Metrics are the Same Weight When Measuring Success
42
![Page 43: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/43.jpg)
© 2013 Eucalyptus Systems, Inc.
Support vs. Customer Success
• Metrics vs. Goal-oriented Success
• Cross-team Documentation and Communication
• “Knowing is half the battle.” (Go Joe!)
• Documentation of Infrastructure
• Documentation of Use Case
43
![Page 44: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/44.jpg)
© 2013 Eucalyptus Systems, Inc.
“So, what's your point, man?”
• Seamless support from on-boarding to end of life of platform built.
• Documentation is the key to reducing remedial engagement times regardless of communication method.
• Traditional sales/support model is inferior to cross-functional and success-oriented collaborative work.
44
![Page 45: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/45.jpg)
© 2013 Eucalyptus Systems, Inc.
Questions?
45
![Page 46: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/46.jpg)
© 2013 Eucalyptus Systems, Inc.
Learn More
46
Read the Mosaik Solutions Case Studyhttp://www.eucalyptus.com/customers/case-studies
Download Eucalyptus FastStarthttp://www.eucalyptus.com/faststart
Do More
![Page 47: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/47.jpg)
© 2012 Eucalyptus Systems, Inc.© 2012 Eucalyptus Systems, Inc.
Thank you.
David Federlein
http://engage.eucalyptus.com
![Page 48: Using AWS, Eucalyptus and Chef for the Optimal Hybrid Cloud](https://reader034.vdocument.in/reader034/viewer/2022042715/55985eeb1a28ab45398b466f/html5/thumbnails/48.jpg)