solve the cross-cloud conundrum with jclouds at gluecon 2013

with jclouds

Solve the Cross-Cloud Conundrum

Everett Toews

Developer Advocate

@everett_toews

You need:

JDK 1.6+

Maven 3+

Rackspace and/or

HP cloud accounts

GlueconMay 22, 2013 at 10:30 pm

2RACKSPACE® HOSTING | WWW.RACKSPACE.COM

Intro

Developer


Committer on jclouds


Intro

Advocate


Intro


Intro

Operations


Co-author of The OpenStack Operation Guide

docs.openstack.org/ops


Intro

In startup we are not allow dev team for talk to ops team except by API.

@DevOps_Borat


Intro

rackspacecloudtrial.com

hpcloud.com/sign_up

http://rackspacecloudtrial.com/

http://hpcloud.com/sign_up


Agenda


The Workshop

•Introduction•jclouds Overview•Cloud Accounts•Installation•Compute Example•Next Steps•Wrap Up


Introduction


Rackspace


The Cloud

Infrastructure

with an API


SDK Deployment

YourSystem

SDK

CloudAP I

VMVM

VM

UserSystem


SDK Deployment

API

Cloud

YourSystem

SDK

UserSystem

VMVM

VMVM


Introduction to jclouds


jclouds

• Cross-cloud toolkit

• Open Source (Apache v2)

• Community

• Portable APIs

• Ecosystem APIs

• Provider APIs

• Java


jclouds’ Supported Clouds

•Compute• Rackspace Cloud Servers

• HP Cloud Compute• AWS EC2• ElasticHosts• GoGrid• All Clouds

•Storage• Rackspace Cloud Files

• HP Cloud Storage• AWS S3• Azure• CloudOne• All Clouds

http://www.jclouds.org/documentation/reference/supported-providers/

http://www.jclouds.org/documentation/reference/supported-providers/


jclouds Community


jclouds Compute Layers (APIs)•ComputeService• OpenStack• Rackspace• HP, AWS, etc.

•NovaApi (*Api)• OpenStack• Rackspace• HP

Portable

Ecosystem


jclouds Compute Venn (APIs)

Portable

Ecosystem


jclouds Storage Layers (APIs)•BlobStore• OpenStack• Rackspace• HP, AWS, etc.

•SwiftApi• OpenStack• Rackspace• HP

•CloudFilesClient• Rackspace

Portable

Ecosystem

Provider


jclouds Storage Venn (APIs)

Portable

Ecosystem

Provider


jclouds Community

After 3 beer I can able use any of cloud API.

@DevOps_Borat


What Can jclouds Do For You Today?


SDKs

Plumbing


SDKs

(Re)Authentication


SDKs

Pagination


SDKs

State Polling


SDKs

Rate Limiting


SDKs

Retry


SDKs

Smoothing

Rough Edges


SDKs

Open Source


SDKs

In devops nobody is get fire for buy open source.

@DevOps_Borat


SDKs

Community


SDKs

Packaged


SDKs

All-in-one


SDKs

Extensions


SDKs

No lock-in


SDKs

OpenStack


SDKs

Battle Tested Code


SDKs

Sample Code


SDKs

Documentation


SDKs

Support


SDKs

Survey is show junior devops are still believe in Tooth Fairy, Santa Claus and documentation. @DevOps_Borat


Code


Code

j.mp/jcldsglue2013


Code

Zack Shoylev


Cloud Accounts


Rackspace

•BYOB?

•rackspacecloudtrial.com•mycloud.rackspace.com•Note: Username, Password

http://rackspacecloudtrial.com/

https://mycloud.rackspace.com/


HP

•hpcloud.com/sign_up•console.hpcloud.com/compute•Activate AZ1 and AZ2•Top right > View API Keys•Note: Tenant Name, Username, Password




https://console.hpcloud.com/compute




Terminology


Terminology

jclouds Rackspace/OpenStack

Compute Cloud Servers/Nova

Node Server

Location Region

Hardware Flavor

NodeMetadata Server details

User Metadata Metadata

BlobStore Cloud Files/Swift

Blob File/Object


Installation


Maven

•mkdir jclouds-workshop•cd jclouds-workshop•Create pom.xml• gist.github.com/everett-toews/3861545

•mvn dependency:copy-dependencies "-DoutputDirectory=./lib"

https://gist.github.com/everett-toews/3861545




Ivy

•mkdir jclouds-workshop•cd jclouds-workshop•gist.github.com/everett-toews/5242573




Compute Example


Logging•Create logback.xml•gist.github.com/everett-toews/3862553•Full logback.xml example




https://github.com/jclouds/jclouds-examples/blob/master/rackspace/src/main/resources/logback.xml


Imports and Class•Create JCloudsWorkshop.java•gist.github.com/everett-toews/3861596• javac -cp ".:lib/*" JCloudsWorkshop.java

•Windows: Use ‘;’ for path separator•Note: Guice, Guava





main() and skeleton•gist.github.com/everett-toews/3862453• javac -cp ".:lib/*" JCloudsWorkshop.java







init()•gist.github.com/everett-toews/3862575• javac -cp ".:lib/*" JCloudsWorkshop.java•Note: Authentication






createNodes()•gist.github.com/everett-toews/3862480• javac -cp ".:lib/*" JCloudsWorkshop.java




configureAndStartWebservers()•gist.github.com/everett-toews/3862485• javac -cp ".:lib/*" JCloudsWorkshop.java•Note: Patterns




JCloudsWorkshop.java

Number of cloud instance launch by ops team is direct proportional with LOC write by dev team.

@DevOps_Borat


awaitSsh()•gist.github.com/everett-toews/3862516• javac -cp ".:lib/*" JCloudsWorkshop.java




detectExtensions()•gist.github.com/everett-toews/3867123• javac -cp ".:lib/*" JCloudsWorkshop.java



printResults()•gist.github.com/everett-toews/3862499• javac -cp ".:lib/*" JCloudsWorkshop.java





deleteNodes() and close()•gist.github.com/everett-toews/3862504• javac -cp ".:lib/*" JCloudsWorkshop.java





Run!• java -cp ".:lib/*" JCloudsWorkshop


JCloudsWorkshop.java

Hello World in cloud is involve 1 load balancer, 3 web server and 2 database server.

@DevOps_Borat


Potpourri

•Moved to Apache Software Foundation•groupId change

• 1.6.0: <groupId>org.jclouds.X</groupId>• 1.6.1: <groupId>org.apache.jclouds.X</groupId>

•Package change• 1.6.0: import org.jclouds• 1.7 (2.0?): import org.apache.jclouds


Potpourri

•Command Line Interface•Jenkins Plugin•jclouds-chef

http://cloud.dzone.com/articles/command-line-interface-jclouds

https://wiki.jenkins-ci.org/display/JENKINS/JClouds+Plugin

http://www.jclouds.org/documentation/quickstart/chef/


Who Uses jclouds?

•CloudBees•Cloudify•EnterpriseDB•Pallet•Whirr•...•You?

http://cloudbees.com/

http://www.gigaspaces.com/cloudify

http://www.enterprisedb.com/products-services-training/products-overview/postgres-plus-cloud-database

http://palletops.com/

http://whirr.apache.org/


Next Steps


Next Steps

•Full Example•Terminate your VMs!•Load Balancing•More examples•jclouds doc and Javadoc•Join [email protected]•jclouds and OpenStack•Contributing OpenStack Support to jclouds


https://github.com/jclouds/jclouds-examples/tree/master/rackspace

http://www.jclouds.org/documentation/

http://javadocs.jclouds.cloudbees.net/

http://jclouds.incubator.apache.org/documentation/quickstart/openstack/

http://jclouds.incubator.apache.org/documentation/quickstart/openstack/

http://blog.phymata.com/2012/10/03/contributing-openstack-support-to-jclouds/



Thank You

Everett Toews

Developer Advocate

@everett_toews

And don’t forget to terminate your VMs

developer.rackspace.com

j.mp/jcldsglue2013

solve the cross-cloud conundrum with jclouds at gluecon 2013

Business