manchester geek night pcf 101

Pivotal Cloud Foundry 101

Sufyaan Kazi

Trusted partner for IT innovation and digital transformation

New mode for cloud-computing – open and enterprise ready

Gold standard for modern software development

3© 2016 Pivotal Software, Inc. All rights reserved.

Who are Pivotal? http://bit.ly/2cmRm9m

4© 2016 Pivotal Software, Inc. All rights reserved.

Who are Pivotal? http://bit.ly/2cmS86h

5© 2016 Pivotal Software, Inc. All rights reserved.

Cloud Native Power Lunch Series

Sufyaan Kaziskazi@pivotal.io@sufyaan_kazi

CI/CD Pipeline

What is your target process?Create an

environment for the app

• Install the OS, correct appservers, libraries etc

• Or create a Docker image/container (?)

Execute this application somewhere

• Find “compute” to run this app (a VM, containers etc)

• Or use Kubernetes (?)

Build an Artifact

• Run gradle, maven etc.

App & Container ? ???

• Is the app tied to that image?

• What happens when the (OS) needs patching?

• How do you access log files?

• How do you connect to a backing service?

???• Is their anything hardcoded

in the image for each environment?

• What licenses, ports etc. are open?

• Any network updates required?

???• What is the network

path to access the app?• What controls

autoscaling?• What happens when the

container crashes?

And repeat for SIT,

PreProd, Prod …

And repeat for Version 2

….

???• Is the original image still

valid?

???• Can we have both old

and new running at the same time?

7© 2016 Pivotal Software, Inc. All rights reserved.

PlatformDeliver a modern application development and operations environment that lets your developers focus on generating value for customers.

Microservices Open Source Continuous Delivery Containers DevOps

8© Copyright 2016 Pivotal. All rights reserved.

BOSH pre 2013 ...

VSphereBOSH

BOSH Worker VMs

9© 2016 Pivotal Software, Inc. All rights reserved.

What does it mean to have a “Platform” ? The minimum features needed…

PaaS

Routing

Load Balancing

Service Brokers

Infrastructure automation

Log aggregation

Health monitoring &

recovery

Immutable artifact

repository

10© Copyright 2016 Pivotal. All rights reserved.

Demohttps://github.com/ihuston/python-cf-examples

11© 2016 Pivotal Software, Inc. All rights reserved.

ORIGINS

2013

Transferred to Pivotal from Vmware● Open Source● Cloud Native Architecture

2014

First commercialized by Pivotal● Pivotal Cloud Foundry (PCF)● Pivotal Web Services (PWS)● 1 trillion dollars in market cap

supporting the project● Top talent recruited from Puppet,

AWS, Google, etc

2015

Governance passed to Cloud Foundry Foundation

2016

On 7th release of PCF

11

https://github.com/cloudfoundry

12© 2016 Pivotal Software, Inc. All rights reserved.

CLOUD FOUNDRY FOUNDATIONAN OPEN INDUSTRY STANDARD

PLA

TIN

UM

SILV

ERG

OLD

12

13© Copyright 2016 Pivotal. All rights reserved.

Many flavours of CF

14© Copyright 2016 Pivotal. All rights reserved.

Message Bus

Extend the CF Runtime with Cloud Foundry BOSH

IaaSCloud Foundry

Operations Manager/BOSH

DB

BOSH Director

Blobs

Health MonitorDeployment• Packages

• Blobs• Source

• Jobs• Manifest

Deploy my CF

etcd

Target VM

Operator

CELL

Target VMCloud Controller

Target VM

15© Copyright 2016 Pivotal. All rights reserved.

CF High Level Architecture

Elastic Runtime

Dynamic Router

OAuth 2.0 Server (UAA)

CELL

Garden

Build Packs

Login Server

CC & CC Bridge

Blob Store

BBS/etcd

Sys Log

Serv

ice

Bro

kers

Collector App Log

ROUTING

AUTHENTICATION

APP LIFECYCLE

APP STORAGE& EXECUTION

MESSAGING

METRICS & LOGGING

BBS Converger

BOSH

16© Copyright 2016 Pivotal. All rights reserved.

R

ou

ter

Cloud Controller Cloud Controller Bridge

Auctioneer BBS

CELL Rep

Executor

CELL Rep

Executor

CELL Rep

Executor

Stage an Application

17© Copyright 2016 Pivotal. All rights reserved.

Demohttps://github.com/Pivotal-Field-Engineering/PCF-demo

18© Copyright 2016 Pivotal. All rights reserved.

CELL

Stage an ApplicationR

ou

ter

Cloud FoundryElastic Runtime

Blobstore DB

Detect Compile UploadNoYes

SystemBuildpacks

+ =

Cloud Controller

Servicecredentials

Cloud Controller Bridge

Task

19© Copyright 2016 Pivotal. All rights reserved.

R

ou

ter

Cloud Controller Cloud Controller Bridge

Auctioneer BBS

CELL Rep

Executor

CELL Rep

Executor

CELL Rep

Executor

ACCESS APP

Deploying an Application

20© 2016 Pivotal Software, Inc. All rights reserved.

Containers Pre-date the Docker Hype

Google started Linux container effort “Control

Groups”

Added to the Linux Kernel in

2007

Cloud Foundry uses Linux container

technology - “Warden

containers” early 2012

Docker is like github for container images

Docker joins Cloud Foundry

Foundation

Google, MSFT, IBM working on orchestration of multiple Docker

containers

2006 2014

Cloud Foundry has been using container technology pre-Docker

2012

21© 2016 Pivotal Software, Inc. All rights reserved.

Platform provides standard Buildpack for runtime*

Platform provides fixed OS container image

Developer brings app

Developer brings runtime Docker image

Developer brings Docker OS image

Developer brings app

Buildpacks Docker

* Devs may also provide their own buildpacks

Platform provides fixed host OS Kernel

Platform provides fixed host OS Kernel

ApplicationContainer

Standardization or Customization is Your Choice

AND

22© 2016 Pivotal Software, Inc. All rights reserved.

BUILD PACKS

23© 2016 Pivotal Software, Inc. All rights reserved.

Use 12 factor app principles to create cloud ready applications➢ A set of best practices for

developing and deploying cloud-native software.

➢ Practices translate into platform features and workflow requirements.

Codebase Dependencies Config Backing Services

Build, Release,

RunProcesses Port

Binding Concurrency

DisposabilityDev/Prod

Parity Logs Admin Processes

Source: “The Twelve-Factor App.”

24© 2015 Pivotal Software, Inc. All rights reserved.

But Microservices!

25© Copyright 2016 Pivotal. All rights reserved.

Demohttps://github.com/skazi-pivotal/spring-boot-cities-servicehttps://github.com/skazi-pivotal/spring-boot-cities-ui

26© 2016 Pivotal Software, Inc. All rights reserved.

• Eureka

• Hystrix + Turbine

• Ribbon

• Feign

• Zuul

http://netflix.github.io

27© 2016 Pivotal Software, Inc. All rights reserved.

MODERN CLOUD NATIVE PLATFORM

Pivotal Cloud Foundry empowers companies with a cloud platform engineered for start-up speed—designed for continuous innovation, across multiple clouds, at scale.

28© Copyright 2016 Pivotal. All rights reserved.

Message Bus

Extend the CF Runtime with Cloud Foundry BOSH

IaaSCloud Foundry

Operations Manager/BOSH

DB

BOSH Director

Blobs

Health MonitorDeployment• Packages

• Blobs• Source

• Jobs• Manifest

Extend my CF

etcd

Target VM

Operator

CELL

Target VMCloud Controller

Target VM

Jenkins

AGENT

MySQL

AGENT

Cassandra

AGENT

29© Copyright 2016 Pivotal. All rights reserved.

Pivotal CF High Level Architecture

Elastic Runtime

Dynamic Router

OAuth 2.0 Server (UAA)

CELL

Garden

Build Packs

Login Server

CC & CC Bridge

Blob Store

BBS/etcd

Sys Log

Serv

ice

Bro

kers

Collector App Log

ROUTING

AUTHENTICATION

APP LIFECYCLE

APP STORAGE& EXECUTION

MESSAGING

METRICS & LOGGING

BBS Converger

BOSH

30© Copyright 2016 Pivotal. All rights reserved.

Demohttps://github.com/pivotal-bank/cf-SpringBootTrader

31© 2016 Pivotal Software, Inc. All rights reserved.

CI/CD with Concourse (http://concourse.ci/)

32© Copyright 2016 Pivotal. All rights reserved.

Demo

33© 2015 Pivotal Software, Inc. All rights reserved.

We’re Hiring!!

pivotal.io/careers

35© 2016 Pivotal Software, Inc. All rights reserved.

CF OPEN SOURCE MOMENTUM

Source: http://cloud-foundry.meetup.com/ on Jun 12 2015

53 CORPORATIONS

158 MEETUPS 49 COUNTRIES

21K MEMBERS

2200 DEVELOPERS

65K COMMITS

650 CODE SUBMITTERS

SUBMITTERS

COMMITS

in

from

35

36© 2016 Pivotal Software, Inc. All rights reserved.

36

● Absolutely critical for CF users and ecosystem● Make it lasting and durable● CF “Core”:

○ Cloud Foundry Certified PaaS○ Target Q4 2015

● CF Extensions○ Target Early 2016

CLOUD FOUNDRY CERTIFICATION PROGRAMCloud Foundry Core• Certified Products and “As a

Service” Implementations• Must Use Specific CF-Release

CFF Maintained Add-ons• Projects owned by Foundation• Extend or work with CF Core• Must meet qualifications for

relevant CF Extension certification

Certified CF Extensions• Projects and products external

to the foundation• Are certified by the foundation

as interoperable with CF Core

Extended Ecosystem• Projects and products external

to the foundation• Not certified

BOSH, while not in CF Core, remains critical to our ecosystem development efforts and represents several opportunities for certification programs.

37© 2016 Pivotal Software, Inc. All rights reserved.

PIVOTAL IS THE LEADING CONTRIBUTOR & EXPERT….

37