eucalyptus: our story. presented at lca2011
DESCRIPTION
This was presented at Linux.conf.au 2011 in Brisbane Australia as part of the Storage miniconf. It gives an introduction to Eucalyptus, and invites you to join the open source community.TRANSCRIPT
Our Story
The Scientists
Proceedings of the 9th IEEE International Symposium on Cluster Computing and the Grid: The Eucalyptus Open-Source Cloud-
Computing System
The Paper
EUCALYPTUS
• Elastic• Utility• Computing• Architecture• Linking• Your• Programs• To• Useful• Systems
Eucalyptus Systems, Inc
The architecture
WSDL components
• Every component is a web service• WS-security is used between components• components have a well defined WSDL• WSDL may change at every release with the addition of new
features• a component can thus be fully replaced provided it satisfy
the WSDL
Some Features
• Open Source: GPL3• Written in C & Java, multi-threaded• Linux hosted• Chose your own hypervisor: Xen, KVM, VMware, ...• AWS API
o EC2 ("ECC")o S3 ("Walrus")
• Your own Instance Types & Availability Zones
Walrus Overview
• Flat namespace• Unit of data is an object
o Objects are stored in "buckets"o Up to 5GB per bucket in S3 (customizable in Eucalyptus)
• Operations for manipulating buckets and objectso Objects cannot be modified "in place"
• Shares credentials/user account information with Cloud Controller (EC2)
• REST and SOAP API supporto REST is more popularo Ability to upload from web forms (POST)
• S3 API guideo http://docs.amazonwebservices.com/AmazonS3/2006-03-
01/API/
How is Walrus used?
• User facingo Create/modify buckets, upload/modify/delete/copy objects
• Used to store user image templateso Root partition, kernel, ramdisko Encrypted and uploaded to Walruso Walrus decrypts using user credentialso Node controller obtains decrypted image(s) from Walruso Uses image files to create and run instance
• Used to store EBS snapshotso Made available to storage controllerso Volumes are created from snapshots
Current Walrus Limitations
• Uses file system as backendo redundancy provided by storage systemo not distributed (yet)
• Performance may be limited by the backend• Admin has to worry about sizing
What is coming...
• More AWS APIs• Improved API support
o Reduced Redundancy, Bucket Policies, Notifications (via SNS), MultiPart Upload, Large Object support, Streaming, ...
• Improved scalability, redundancy
Launchpad.net
• launchpad.net/eucalyptus• code• bugs• we push up every night
open.eucalyptus.com
• wiki• forums• documentation• concourse
Be a contributor
• CLA• patch against lp:eucalyptus/eucalyptus-devel• submit to our issue tracker (RT)
• read & check RT• contributors can write to RT• others can use forum or email