openstack upstream training cisco live!

OpenStack Upstream.Training

©"2015" "Cisco" and/or"its"affiliates."All" rights"reserved." ""Cisco"PublicPresentation" ID

• Introduction

• OpenStack Release"Process

• Devstack!

• Contributor"Accounts

• Contribution"Workflow

• Committing"and"Reviewing

• Jenkins

• Community Engagement

• Next"Steps

Agenda

3

OpenStack Governance.and.Release.Cycle


• Open"source"software to"create"private"and"public"clouds

• Coordinated"software"from">"30"related"projects

What"is"OpenStack?

5


• 24,000"members

• 495"supporting"companies

• Over"20"million"lines"of"code

• Most"recent"(“Kilo”)"release:

• 1,500"developers

• 170"companies

• 20,000"patches

• November"2015"(“Liberty”)"release:

• 25,000"patches?

The"OpenStack Community

6


• Led by"OpenStack Foundation

• Nonprofit"to"“develop,"support,"protect,"and"promote”"OpenStack

• Creates"other"committees"for"dayatoaday"leadership• Technical"Committee• User"Committee• Adahoc"topical"Committees

• Foundation"Membership

• Individual"members

• Institutional"members

• Foundation"board"of"directors

OpenStackGovernance

7


• Technical leadership"over"all"projects

• Enforces"OpenStack ideals

• Establishes"standards"across"projects

• Final"appeals"board"for"alignment"between"projects

• Membership"elected"by"OpenStack ATCs

• Technical"contributor"past"2"releases

The"Technical"Committee

8


• Core"services

• Common"supporting"services

• Horizontal"focus"teams

• Each"team"led"by"a"PTL"elected"by"that"project’s"technical"contributors

• PTL"must"be"a"technical"contributor"to"the"project

OpenStack Project Teams

9


• Coordinated across"projects

• Released"every"six"months• All"projects"for"Austin"<a>"Kilo"releases

• Currently"being"reworked• Liberty:"integrated"projects"coordinated"by"Release"Management"Team

OpenStackReleases

10


• All"projects"which"contribute"to"the"overall"goal"can"participate

• No"longer"forced"to"use"same"release"cycle and"to"be"a"gating"process"for"integration

• “Tags”"concept"being"worked"out

• Adahoc"committee"forming

• Very"much"a"work"in"progress"still

The"Big"Tent

11


• Standardize"definition of"“OpenStack”

• Both"branding"and"technical• Compatibility"is"the"primary"concern

• Also"a"work"in"progress

Defcore

12


• Planning:"4"weeks,"with"Design"Summit"on"3rd week

• Milestone"releases

• Freezes

• Feature"proposal"freeze

• Feature"freeze

• String"freeze

• Release"Candidates

• Release

• Maintenance"as"stable"branch"for"one"year"while"next"two"releases"are"developed

• Downstream"vendors"may"then"maintain"further

OpenStackRelease"Cycle

13


• Branches• master• stable/kilo• stable/juno

• Two"stable"branchesmaintained"(1"yr maintenance)"in"the"community

• New"features"always"committed"to"master"first

Release"structure

14

DevStack)Intro)&)Lab

Anne$McCormickSoftware$Engineer,[email protected]

©$2015$ $Cisco$ and/or$its$affiliates.$All$ rights$reserved.$ $$Cisco$PublicPresentation$ ID

• AllHinHone$(AIO) installation$of$OpenStack

• “Standard”$tool$for$testing

• NOT$representative$of$a$“production”$install

What$is$DevStack?

2


• Iterative development

• Basis$of$automated$testing$(i.e.$Tempest)

Key$Uses

3


• Scale$issues$often$missed

• MultiHnode$issues$sometimes$missed

• Defaults are$not$necessarily$most$common$/$desirable

But,$it$worked$in$DevStack…

4


• http://devstack.org/ H main$page$for$overview,$documentation,$etc.• To$get$the$code$(e.g.$for$Kilo):

git$clone$–b$stable/kilo$https://github.com/openstackHdev/devstack.git$

Getting$DevStack

5


Lab:$Installing$DevStack

6

©$2015$ $Cisco$ and/or$its$affiliates.$All$ rights$reserved.$ $$Cisco$PublicPresentation$ ID 7

Lab$Topology

VMware VirtualBoxOR

Ubuntu$VM

DevStack

Horizon


• Ubuntu$14.04.2$Desktop$VM

Username:$demo

Password:$demo

• Access$the$web$server$using$a$web$browser$on$Ubuntu$VM

Lab$Information

8

http://localhost

Username:$admin

Password:$openstackUsername:$demo

Password:$openstack


• Install$VMware$Fusion$or$VirtualBox,$if$you$haven’t$done$so$already

• Installation$instructions$are$in$the$lab$guide

• For$VMware,$go$to$

http://www.vmware.com/products/fusion/fusionHevaluation

• For$VirtualBox,$go$to$http://virtualbox.org.$

Environment$Setup

9


• Task$1$– Bring$up$Ubuntu$VM

• Task$2$– Install$DevStack$from$stable$Kilo$branch

• Task$3$– Bring$up$DevStack$Horizon

• Task$4$– Configure$demo$tenant$network

• Task$5$– Configure$demo$tenant$router

• Task$6$– Configure$demo$tenant$instance

• Task$7$– Add$access$rules$to$allow$ping/ssh$to$instance

• Task$8$– Add$floating$IP$to$instance

• Task$9$– Much$fanfare$and$hoopla

Overall$Objectives

10


• Import$OVA$into$either$Fusion$or$VirtualBox

• Give$the$Ubuntu$VM$4GB$RAM• Select$“Import”

Task$1$– Bring$up$Ubuntu$VM

11


• Start$the$VM

• Log$in$as$demo$user

(demo,$demo)

Task$1$– Bring$up$Ubuntu$VM

12











Overall$Objectives

13


• Bring$up$Terminal$window• cd$/home/demo/CiscoLive• Edit$localrc,$comment$out$OFFLINE=True

Task$2$– Install$DevStack$from$stable$Kilo$branch

14


• cd$/home/demo

• git$clone$–b$stable/kilo$https://github.com/openstackHdev/devstack.git$


15


• cp$/home/demo/CiscoLive/localrc$/home/demo/devstack

• cd$/home/demo/devstack

• ./stack.sh

• Get$a$cup$of$coffee,$make$a$few$phone$calls…


16











Overall$Objectives

17


• Bring$up$Firefox$on$Ubuntu$VM• Go$to$DevStack$Horizonhttp://localhostadmin/openstackdemo/openstack

• Sign$in$as$admin

Task$3$– Bring$up$DevStack$Horizon

18


• Play$around$with$Horizon$for$a

bit$as$admin$user

Task$3$– Bring$up$DevStack$Horizon

19











Overall$Objectives

20


• Log$in$to$Horizon$as$demo$user

(password:$openstack)

• Bring$up$“Network$Topology”$UI

• Select$“+Create$Network”

Task$4$– Configure$demo$tenant$network

21


• Create$“testnet”

• Select$“Next”


22


• Configure$“testHsubnet”

Address:$192.168.0.0/24

Version:$IPv4

• Select$“Next”


23


• Configure$subnet$details

Alloc$Pools:$192.168.0.100,192.168.0.200

• Select$“Create”


24


• Network$Topology


25











Overall$Objectives

26


• From$Network$Topology,$

select$“+Create$Router”

• Create$“testHrouter”

• Attach$to$public$network

• Select$“Create$Router”

Task$5$– Configure$demo$tenant$router

27


• From$Network$Topology,$hoover

over$the$router$and$select

“View$Router$Details”


28


• Select$“Interfaces”$tab


29


• Select$“+Add$Interface”


30


• From$Subnet$pulldown,$

select$“testnet”$subnet

• Select$“Add$Interface”$


31




32











Overall$Objectives

33


• First$create$ssh$key

• From$Ubuntu$Terminal,

cd$/home/demo/.ssh

• Run$the$following$cmds:sshHkeygen$–t$rsa$–f$cloud.key

(no$passphrase$is$fine$for$now)

sshHadd$cloud.key$

• Copy$contents$of$

cloud.key.pub$to$clipboard$

Task$6$– Configure$demo$tenant$instance

34


• From$Network$Topology,

select$“Launch$Instance”


35


• Create$“testHinstance”

Avail$Zone:$nova

Flavor:$m1.micro

Boot$Source:$Image

Image$Name:

cirrosH0.3.4Hx86_64Husec

• Select$“Access$&$Security”

tab


36


• Select$“+”$to$add$a$keypair

• Create$“testHkeypair”

• Copy$public$key$contents

from$clipboard

• Select$“Import$Key$Pair”


37


• From$Launch$Instance$UI,select$“Networking”$tab

• Make$sure$testnet$is$inselected$networks$list

• Select$“Launch”


38




39











Overall$Objectives

40


• Bring$up$“Access$&$Security”$UI

• Select$“Manage$Rules”

Task$7$– Add$access$rules$to$allow$ping/ssh$to$instance

41


• Select$“+Add$Rule”


42


• Add$an$ingress$“All$ICMP”$

rule$as$follows:$

Rule:$All$ICMP

Direction:$Ingress• Select$“Add”

• Create$similar$rule$for

egress$ICMP


43


• Add$rule$for$ssh

• Select$“Add”


44


• Now$rules$should$look

like$this:


45











Overall$Objectives

46


• From$

ComputeH>Instances$UI

• Under$“testHinstance”,

select$Action$

“Associate$Floating$IP”

Task$8$– Add$floating$IP$to$instance

47


• From$

“Manage$Floating$IP$Associations”,

select$“+”


48


• From$

“Allocate$Floating$IP”$UI,

select$“Allocate$IP”


49


• From$

“Manage$Floating$IP$Associations”,

select$“Associate”


50


• From$“Instances”$UI,$you’ll$now$see$

local$IP$and$floating$IP$for$the$instance$


51


• Try$to$ping$and$ssh$to$your$instance


52











Overall$Objectives

53

Contributor)Accounts


• Hosted"service"from"Canonical• Used"by"OpenStack for"bug"tracking• Some"discussions"around"replacements"(storyboard,"others)

• Also used"as"SSO• This"use"is"slowly"being"phased"out

Launchpad

2


• Sign"up"at"https://launchpad.net/• Use the"same"email"address"for"all"the"accounts"which"will"be"discussed• Broken"by"many"password"management"tools

Getting"a"Launchpad"Account

3


• Join"the"OpenStack Foundation

• Required"for"legal"reasons

• Also"provides"an"SSO"which"is"becoming"the"standard"SSO"for"OpenStack development"tooling

OpenStack ID


• Sign"up"at"https://www.openstack.org/join/register

• Multiple"levels"of"membership• Must"be"a"foundation"member"to"contribute"code

• Individual"membership"is"free

Getting"an"OpenStack ID

5


• Gerrit implementation"used"for"code"review

• Google"tool"for"code"review• From"the"Android"project

• OpenStack implementation"tweaked"but"not"forked

review.openstack.org

6


• Sign"in"at"https://review.openstack.org/

• Fill"out"a"username

• Add"an"SSH"key• Specify"contact"info

• Complete"a"license"agreement

• Gerrit will" reject"all"code"submissions"from"you"until"steps"done"fully• Legal"mandate

Getting"a"review"account

7


• Most"individuals"have"to"fill"out"one•Government"employees"use"a"separate"form• Individuals"working"for"corporationsmay"also"need"a"corporate"form

OpenStackContributor"License"Agreements

8


Lab:"Setting"up"accounts

9

Contribution Workflow


• All"code"contributions"go"through"review• Automated"review• Human"review• Customized"per"project

• Strong"focus"on"making"all"contributions"code• Documentation• System"administration• Design• Other"“non^code”

review.openstack.org

11


Gerrit workflow

12


• Automated"static"analysis• Automated"integration"/"functional"/"unit"testing• Human review• Automated"third^party"review

Review"process

13


• “This"needs"improvement”:"^1

• “This"looks"good”:"+1

All"reviewers are"equal

14


• “Even"the"idea"of"this"is"wrong”:"^2• “This"is"ready"to"merge”:"+2• Core"project"contributors"only

Some"reviewers"are"more"equal

15


• No negative"reviews• At"least"two"+2"reviews• Applies"to"both"human"and"voting"automated"testing

The"rules

16


• You"WILL"get"^1."A"lot."It"doesn’t"mean"we"hate"you

• Reviews"should"be"constructive

• Reviews"meant"to"maintain"quality

• Reviews"also"function"to"keep"focus"aligned

Expectations

17


Lab:"Submitting"/"Reviewing"Changes

18

Committing Guidelines


• Small"bitesize changes•One"change"per"commit• Never"break trunk• Automation"should"prevent• Public"shaming"helps"prevent

Change"Structure

20


• Combining"whitespace"and"functional"changes• Combining unrelated"changes"in"a"commit

Bad"Ideas

21


• Standards"defined:"https://wiki.openstack.org/wiki/GitCommitMessages

• Messages"Matter!

• Standards"actively"enforced"by"negative"review• Human"enforcement"so"inconsistent

• ^1"because"of"commit"message"doesn’t"mean"we"hate"you

Commit"Messages

22


Live)Examples

23


• Don’t"assume"reviewer knows"history"behind"change• Don’t"assume"reviewer"has"access"to"external"links

Commit"Gotchas

24


• Change^ID• Bug• Blueprint

• Enables"some"level"of"automation"between"tooling

Commit"Cross^references

25


Integration)Example

26


• DocImpact

• SecurityImpact

• UpgradeImpact

• Backport

Commit"Tags

27


• Revision after"constructive"criticism:"git commit"^^amend

• Change^Id must"be"preserved"in"the"commit"message

• Allows" for"consistent"tracking"in"project"history

Amending"Commits

28


• WIP"tag• Enables"collaboration"without"wasting"review"time"prematurely

Staging Reviews

29


• Indicate a"temporal"ordering"to"merge• Land"an"API,"then"land"its"consumer

Commit"Dependencies

30


• Static"analysis• Unit"/"Functional"/"Integration"tests• Manual• Tempest"automation"suite• Rally"scale"wrapper"around"Tempest

Local"Testing

31


• Official"test"suite

• Service"endpoint"testing• Exercise"API,"validate"response

• Used"as"gating"in"conjunction"with"devstack

Tempest

32


Rally

33


Lab:"Local"Testing"and"Amended"Commits

34

The)Role)of)Jenkins


• Openstack"Infra"Config"Files

https://github.com/openstack^infra/project^config

• Gerrit"Code"review"system

• Jenkins"Job"builder

Reads"YAML"files"in"openstack^infra/project^config"and"injects"jobs"in"Jenkins

• Zuul"for"predictive"gating

• Puppet"modules"consume"config"files"to"setup"openstack"Infrastructure

Openstack"CI"system

36


Development"Workflow

37


• Uses"different"pipelines"– check,"gate"etc.

• Watches"gerrit"event"and"adds"changes"to"pipeline

• Check

Verify"every"patch"set"pushed"to"gerrit

Failure"prevents"patch"approval

• Gate

Verify"patches"once"they"are"approved

Failure"prevents"patch"landing"and"causes"pending"patches"to"be"retested

Zuul

38


• Static Analysis• Policy"conformance• Security"analysis

• Functional"Analysis• Tempest"unit"testing• 3rd Party"CI"integration

Runs"On"Every"Proposed"Commit

39


CI)Demo

40


• http://status.openstack.org/zuul/• http://status.openstack.org//elastic^recheck/

Status"Pages

41


• Gerrit:"recheck"bug#•Gerrit:"recheck"no^bug

Bypass"Erroneous"Failures

42

Community)Engagement


• Launchpad"is"upstream"bug"tracker

• Critical"fields:• Bug"status• Assigned To

• Potentially"downstream"vendor"bug"trackers"also

Bug"Tracking

44


Launchpad)Demo

45


• Low^hanging^fruit

• Documentation

• I18n

• Security

• Ops

• $release^backport^potential

Bug"Tags

46


• All"changes"land"in"master"first• Low^risk"changes"may"be"backportedif"align"with"policy

Backport Policies

47


• New"features• Changes"to"external"REST"APIs

• Changes"to"internal"AMQP"messaging

• Changes"to"event"notifications• Schema"changes• Config file"changes

Forbidden Backport Changes

48


• Every"change"requires"at"least"2"reviews,"and"most"many"more• Keep"reviews"constructive

Reviewing Is"Critical

49


• #openstack*"channels"on"freenode• Logged and"publically"archived•Meetbot for"automation• Primary"communication"channel

IRC

50


• https://wiki.openstack.org/wiki/Mailing_Lists• Secondary"communication"channel

Mailing"Lists

51


• Schedule"at"http://eavesdrop.openstack.org/• Constructively"participate"to"be"part"of"the"community

Project"Meetings

52


• Design"Summits•Mid^cycle"Meetups• User"Groups

In^Person"Meetings

53


• Developer"handbook• http://docs.openstack.org/infra/manual/developers.html

• Project^specific"developer"guides• http://docs.openstack.org/developer/openstack^projects.html

OpenStackDeveloper"Documentation

54

Next)Steps


• Pick"a"project

• Find"a"small"bug• Low^hanging^fruit"– see"list

• Run"the"review"gauntlet

Bug"Fixing

56


• Bug"triage• Code"review• Documentation• Community"help

Other"Places To"Start

57


Stuck?"Ask"Shannon!"(or"anyone"else"here"helping)

58

openstack upstream training cisco live!

Technology

cisco andoritsaffiliates

cisco amccormi

openstack project teams

theopenstack community

mccormick software

devstackintrolab anne