manchester geek night pcf 101
TRANSCRIPT
Pivotal Cloud Foundry 101
Sufyaan Kazi
Trusted partner for IT innovation and digital transformation
New mode for cloud-computing – open and enterprise ready
Gold standard for modern software development
3© 2016 Pivotal Software, Inc. All rights reserved.
Who are Pivotal? http://bit.ly/2cmRm9m
4© 2016 Pivotal Software, Inc. All rights reserved.
Who are Pivotal? http://bit.ly/2cmS86h
5© 2016 Pivotal Software, Inc. All rights reserved.
Cloud Native Power Lunch Series
Sufyaan [email protected]@sufyaan_kazi
CI/CD Pipeline
What is your target process?Create an
environment for the app
• Install the OS, correct appservers, libraries etc
• Or create a Docker image/container (?)
Execute this application somewhere
• Find “compute” to run this app (a VM, containers etc)
• Or use Kubernetes (?)
Build an Artifact
• Run gradle, maven etc.
App & Container ? ???
• Is the app tied to that image?
• What happens when the (OS) needs patching?
• How do you access log files?
• How do you connect to a backing service?
???• Is their anything hardcoded
in the image for each environment?
• What licenses, ports etc. are open?
• Any network updates required?
???• What is the network
path to access the app?• What controls
autoscaling?• What happens when the
container crashes?
And repeat for SIT,
PreProd, Prod …
And repeat for Version 2
….
???• Is the original image still
valid?
???• Can we have both old
and new running at the same time?
7© 2016 Pivotal Software, Inc. All rights reserved.
PlatformDeliver a modern application development and operations environment that lets your developers focus on generating value for customers.
Microservices Open Source Continuous Delivery Containers DevOps
8© Copyright 2016 Pivotal. All rights reserved.
BOSH pre 2013 ...
VSphereBOSH
BOSH Worker VMs
9© 2016 Pivotal Software, Inc. All rights reserved.
What does it mean to have a “Platform” ? The minimum features needed…
PaaS
Routing
Load Balancing
Service Brokers
Infrastructure automation
Log aggregation
Health monitoring &
recovery
Immutable artifact
repository
10© Copyright 2016 Pivotal. All rights reserved.
Demohttps://github.com/ihuston/python-cf-examples
11© 2016 Pivotal Software, Inc. All rights reserved.
ORIGINS
2013
Transferred to Pivotal from Vmware● Open Source● Cloud Native Architecture
2014
First commercialized by Pivotal● Pivotal Cloud Foundry (PCF)● Pivotal Web Services (PWS)● 1 trillion dollars in market cap
supporting the project● Top talent recruited from Puppet,
AWS, Google, etc
2015
Governance passed to Cloud Foundry Foundation
2016
On 7th release of PCF
11
https://github.com/cloudfoundry
12© 2016 Pivotal Software, Inc. All rights reserved.
CLOUD FOUNDRY FOUNDATIONAN OPEN INDUSTRY STANDARD
PLA
TIN
UM
SILV
ERG
OLD
12
13© Copyright 2016 Pivotal. All rights reserved.
Many flavours of CF
14© Copyright 2016 Pivotal. All rights reserved.
Message Bus
Extend the CF Runtime with Cloud Foundry BOSH
IaaSCloud Foundry
Operations Manager/BOSH
DB
BOSH Director
Blobs
Health MonitorDeployment• Packages
• Blobs• Source
• Jobs• Manifest
Deploy my CF
etcd
Target VM
Operator
CELL
Target VMCloud Controller
Target VM
15© Copyright 2016 Pivotal. All rights reserved.
CF High Level Architecture
Elastic Runtime
Dynamic Router
OAuth 2.0 Server (UAA)
CELL
Garden
Build Packs
Login Server
CC & CC Bridge
Blob Store
BBS/etcd
Sys Log
Serv
ice
Bro
kers
Collector App Log
ROUTING
AUTHENTICATION
APP LIFECYCLE
APP STORAGE& EXECUTION
MESSAGING
METRICS & LOGGING
BBS Converger
BOSH
16© Copyright 2016 Pivotal. All rights reserved.
R
ou
ter
Cloud Controller Cloud Controller Bridge
Auctioneer BBS
CELL Rep
Executor
CELL Rep
Executor
CELL Rep
Executor
Stage an Application
17© Copyright 2016 Pivotal. All rights reserved.
Demohttps://github.com/Pivotal-Field-Engineering/PCF-demo
18© Copyright 2016 Pivotal. All rights reserved.
CELL
Stage an ApplicationR
ou
ter
Cloud FoundryElastic Runtime
Blobstore DB
Detect Compile UploadNoYes
SystemBuildpacks
+ =
Cloud Controller
Servicecredentials
Cloud Controller Bridge
Task
19© Copyright 2016 Pivotal. All rights reserved.
R
ou
ter
Cloud Controller Cloud Controller Bridge
Auctioneer BBS
CELL Rep
Executor
CELL Rep
Executor
CELL Rep
Executor
ACCESS APP
Deploying an Application
20© 2016 Pivotal Software, Inc. All rights reserved.
Containers Pre-date the Docker Hype
Google started Linux container effort “Control
Groups”
Added to the Linux Kernel in
2007
Cloud Foundry uses Linux container
technology - “Warden
containers” early 2012
Docker is like github for container images
Docker joins Cloud Foundry
Foundation
Google, MSFT, IBM working on orchestration of multiple Docker
containers
2006 2014
Cloud Foundry has been using container technology pre-Docker
2012
21© 2016 Pivotal Software, Inc. All rights reserved.
Platform provides standard Buildpack for runtime*
Platform provides fixed OS container image
Developer brings app
Developer brings runtime Docker image
Developer brings Docker OS image
Developer brings app
Buildpacks Docker
* Devs may also provide their own buildpacks
Platform provides fixed host OS Kernel
Platform provides fixed host OS Kernel
ApplicationContainer
Standardization or Customization is Your Choice
AND
22© 2016 Pivotal Software, Inc. All rights reserved.
BUILD PACKS
23© 2016 Pivotal Software, Inc. All rights reserved.
Use 12 factor app principles to create cloud ready applications➢ A set of best practices for
developing and deploying cloud-native software.
➢ Practices translate into platform features and workflow requirements.
Codebase Dependencies Config Backing Services
Build, Release,
RunProcesses Port
Binding Concurrency
DisposabilityDev/Prod
Parity Logs Admin Processes
Source: “The Twelve-Factor App.”
24© 2015 Pivotal Software, Inc. All rights reserved.
But Microservices!
25© Copyright 2016 Pivotal. All rights reserved.
Demohttps://github.com/skazi-pivotal/spring-boot-cities-servicehttps://github.com/skazi-pivotal/spring-boot-cities-ui
26© 2016 Pivotal Software, Inc. All rights reserved.
• Eureka
• Hystrix + Turbine
• Ribbon
• Feign
• Zuul
http://netflix.github.io
27© 2016 Pivotal Software, Inc. All rights reserved.
MODERN CLOUD NATIVE PLATFORM
Pivotal Cloud Foundry empowers companies with a cloud platform engineered for start-up speed—designed for continuous innovation, across multiple clouds, at scale.
28© Copyright 2016 Pivotal. All rights reserved.
Message Bus
Extend the CF Runtime with Cloud Foundry BOSH
IaaSCloud Foundry
Operations Manager/BOSH
DB
BOSH Director
Blobs
Health MonitorDeployment• Packages
• Blobs• Source
• Jobs• Manifest
Extend my CF
etcd
Target VM
Operator
CELL
Target VMCloud Controller
Target VM
Jenkins
AGENT
MySQL
AGENT
Cassandra
AGENT
29© Copyright 2016 Pivotal. All rights reserved.
Pivotal CF High Level Architecture
Elastic Runtime
Dynamic Router
OAuth 2.0 Server (UAA)
CELL
Garden
Build Packs
Login Server
CC & CC Bridge
Blob Store
BBS/etcd
Sys Log
Serv
ice
Bro
kers
Collector App Log
ROUTING
AUTHENTICATION
APP LIFECYCLE
APP STORAGE& EXECUTION
MESSAGING
METRICS & LOGGING
BBS Converger
BOSH
30© Copyright 2016 Pivotal. All rights reserved.
Demohttps://github.com/pivotal-bank/cf-SpringBootTrader
31© 2016 Pivotal Software, Inc. All rights reserved.
CI/CD with Concourse (http://concourse.ci/)
32© Copyright 2016 Pivotal. All rights reserved.
Demo
33© 2015 Pivotal Software, Inc. All rights reserved.
We’re Hiring!!
pivotal.io/careers
35© 2016 Pivotal Software, Inc. All rights reserved.
CF OPEN SOURCE MOMENTUM
Source: http://cloud-foundry.meetup.com/ on Jun 12 2015
53 CORPORATIONS
158 MEETUPS 49 COUNTRIES
21K MEMBERS
2200 DEVELOPERS
65K COMMITS
650 CODE SUBMITTERS
SUBMITTERS
COMMITS
in
from
35
36© 2016 Pivotal Software, Inc. All rights reserved.
36
● Absolutely critical for CF users and ecosystem● Make it lasting and durable● CF “Core”:
○ Cloud Foundry Certified PaaS○ Target Q4 2015
● CF Extensions○ Target Early 2016
CLOUD FOUNDRY CERTIFICATION PROGRAMCloud Foundry Core• Certified Products and “As a
Service” Implementations• Must Use Specific CF-Release
CFF Maintained Add-ons• Projects owned by Foundation• Extend or work with CF Core• Must meet qualifications for
relevant CF Extension certification
Certified CF Extensions• Projects and products external
to the foundation• Are certified by the foundation
as interoperable with CF Core
Extended Ecosystem• Projects and products external
to the foundation• Not certified
BOSH, while not in CF Core, remains critical to our ecosystem development efforts and represents several opportunities for certification programs.
37© 2016 Pivotal Software, Inc. All rights reserved.
PIVOTAL IS THE LEADING CONTRIBUTOR & EXPERT….
37