dev2133bu designing an application-centric or distribution€¦ · designing an application-centric...

Michael Gasch – Application Platform ArchitectMartijn Baecke – Cloud Evangelist & Strategist

DEV2133BU

#VMworld #DEV2133BU

Designing an Application-Centric Infrastructure Platform: Experience from the Field

VMworld 2017 Content: Not fo

r publication or distri

bution

• This presentation may contain product features that are currently under development.

• This overview of new technology represents no commitment from VMware to deliver these features in any generally available product.

• Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind.

• Technical feasibility and market demand will affect final delivery.

• Pricing and packaging for any new technologies or features discussed or presented have not been determined.

Disclaimer

2#DEV2133BU CONFIDENTIAL



bution

Designing an Application-Centric Infrastructure Platform:

Experience from the Field




bution

In the age of digital transformation, businesses want a competitive advantage. They rely heavily on agile

applications with just-in-time data intelligence. To meet these expectations, architects must provide platforms that are agile

across the application layer and infrastructure, along with operational excellence. It is imperative that developers and infrastructure operations work closely together to build the

necessary architecture with flexibility and robustness in mind from the beginning.




bution








bution

“It is not the strongest of the species that survive, nor the most intelligent, but the one most responsive to change”

Charles Darwin




bution

Not Too Long Ago Life Was Easy…

12

Apps!

Access to

virtual machine

for coding!

Users Developers

#DEV2133BU CONFIDENTIAL



bution

Digital Transformation Changes IT Demands…

13

Apps!

Access to

virtual machine

for coding!

Users Developers

Apps! Apps! More

Apps! Apps!

New features!

Apps! NOW!

APIs! DevOps!

Containers!

Control the

infrastructure!




bution

DevOps

Digital Transformation

14

Business Applications Infrastructure




bution

15

Business Applications Infrastructure

Build New Functionality

Deploy New Functionality

Monitor Applications

Provide Feedback /

Input

New App / Features




bution

Disruptor

Innovators

Followers

Do nothing

Diamond of Innovation




bution

Digital Business Driving Software Development

Source: Gartner

75%of application development

supporting digital business will

be built not bought by 2020




bution

Developers’ Pyramid of Needs

Performance

Scalability

Availability

Security

Manageability

Functional Differentiation What the Developer cares about

What should be provided as a service




bution

DevOps From an Infrastructure Perspective

19

APP

APP

Developer Code Repository

CI/CD

Which infrastructure to use?

How tomanage

this?

DevOps in a nutshell




bution

20

Rethink OperationsRethink Infrastructure




bution

Rethink Infrastructure




bution

``

DeveloperMindset

22

DevOps Ready Application Centric Platform #DEV2133BU CONFIDENTIAL



bution

Programmable

Self-Service

On-Demand#DEV2133BU CONFIDENTIAL



bution

Virtualize

Automate, like crazy!#DEV2133BU CONFIDENTIAL



bution

CONFIDENTIAL25

Infrastructure as Code




bution

OOTBDIY

Unstructured

Components

approach

maximizes

flexibility, but at

cost of integrating

and maintaining

platform

infrastructure.

Structured

Packaged product

for deployment of

Cloud Native apps.

Simplifies

experience for both

Developers and

Operations.

Best Practice : How to Build a Platform




bution

Rethink Infrastructure

Mission

Critical Apps

Virtual

Desktops

Data Analytics/

Hadoop

Traditional

Apps

Container

AppsIoT

Private cloud Public cloud

Cross

Cloud ServicesvRealize

Container Services

VMware SDDC

vSANvSphere NSX

Application Platform



bution

Rethink Operations




bution

A Typical Discussion in the Enterprise Today




bution

Operations Also Needs To Evolve

30

Developers

Platform Engineers

IT Operations

Serv

ices

Co

ns

um

es




bution

Developers’ Pyramid of Needs

Performance

Scalability

Availability

Security

Manageability

Functional Differentiation What the Developer cares about

What should be provided as a service

31

RESPONSIBILITY OF PLATFORM

ENGINEERING




bution

Platform Engineering (PE) Responsibilities

32

Application Platform(e.g. Kubernetes, Pivotal Cloud Foundry)

Service 1

Service 2

Service "n"

Service 1

Service 2

Service "n"

Service

Boundary

Service

Boundary

CI/CD Tooling & Processes

Resiliency

Resource Optimization

Communication

Observability

Enterprise Developers

Security

State Management

App Runtime

Platform Management

VMware Software-Defined Data Center (SDDC)




bution

Learn From The Disruptors




bution

Disruptor

Innovators

Followers

Do nothing

Learn From The Disruptors

1%

99%“The Rest”




bution

Rethink Operations




bution

Tales from

the Field




bution

From vSphere Operations to Platform Engineering

38

Developers

Platform Engineers

IT Operations

Se

rvic

es

Co

ns

um

es

vSphere Operators are best positioned to become Platform Engineers.




bution

Platform Engineering Responsibilities

39



bution

Some Background on the following Examples

• Developers could tackle all Platform Engineering Responsibilities in each Service

– Analogy: Microsoft Exchange DAGs or SQL Server Always-on Group

– Downside: Complexity and Sprawl

• Alternative: let the Platform handle non-functional Service Requirements

– Analogy: vSphere HA

– Advantage: Common Knowledge and Methodology (Standardization)

• Examples show various Platform Engineering Approaches and simple but powerful Patterns




bution

Example #1 – Health Checks & Rolling Updates

42

Distributed Application Runtime (Kubernetes)

Instance

(Container)

v1.0

Client

Requests

Loadbalancer (VIP)

Instance

(Container)

v1.0

Instance

(Container)

v1.0

myA

pp

Instance

(Container)

v2.0

Instance

(Container)

v2.0

Instance

(Container)

v2.0

Instance

(Container)

v2.0

Instance

(Container)

v2.0

Instance

(Container)

v2.0

http Endpoints: /prestop & /ready




bution

Example #2 – Logging and the Non-12-Factor App

43

Pod (Single Container)

web

/var/vendor/ABC

/custom.log

Console

~# kubectl logs <ID>

~# <empty_reply>

std

out

Pod (with Sidecar)

web

/var/vendor/ABC

/custom.log

tailf

<stdout>

Console

~# kubectl logs <ID>

~# <log_reply>

std

out




bution

Example #3 – App Auto-Scaling

44

Client

Requests

Loadbalancer (VIP)


Worker

Message Queue

Worker Worker WorkerWorker Worker Worker




bution

Example #3 – App Auto-Scaling

45

Client

Requests

Loadbalancer (VIP)


Worker

Message Queue

Worker Worker WorkerWorker Worker WorkerAuto-

Scaler




bution

Example #3 – App Auto-Scaling Integration in vRealize LogInsight (vRLI)

• Uses vRLI REST API

• Auto-Scaler (“Custom Controller”) emits Events from Kubernetes to vRLI API

• Note: not a supported Integration by VMware today (Proof of Technology)

46

LogInsight Custom DashboardRabbitMQ UI




bution

Wrapping Up



bution




bution

50

The vSphere Operator of Today, is the Platform Engineer of Tomorrow!




bution



bution

Further Resources

• VMware Cloud-Native Applications

• Site Reliability Engineering (Free Google eBook)

• Dockerfile Best Practices

• Kubernetes Pod (Container) Mechanics for Application Integration (ff.)

• Pid 1, Zombie Processes and handling graceful Shutdowns/ SIGs

• The 8 Fallacies of Distributed Computing – Explained

• The Datacenter as a Computer

• Github Repo (Sources & READMEs)

53



bution

https://www.vmware.com/solutions/cloudnative.html

https://landing.google.com/sre/book/index.html

https://docs.docker.com/engine/userguide/eng-image/dockerfile_best-practices/

https://kubernetes.io/docs/tasks/configure-pod-container/assign-cpu-ram-container/

https://engineeringblog.yelp.com/2016/01/dumb-init-an-init-for-docker.html

http://www.rgoarchitects.com/Files/fallacies.pdf

https://research.google.com/pubs/pub41606.html

https://github.com/embano1/vmworld2017

dev2133bu designing an application-centric or distribution€¦ · designing an application-centric...

Documents