stream is the new batch

35
STREAM IS THE NEW BATCH

Upload: donovan-muller

Post on 11-Apr-2017

140 views

Category:

Software


0 download

TRANSCRIPT

STREAMIS THE

NEW BATCH

A BIT ABOUT MEDONOVAN MULLER

LEAD TECHNICAL PARTNER AT ABSA

DONOVANCMULLER

WHAT THIS TALK IS ABOUTNOT

STREAMING ANALYTICS, BIG DATAAPACHE SPARK, SAMSA

HADOOP

THAT'S ONE BIG BATCHCURRENT STATE OF AFFAIRS

SCHEDULED / FILE DRIVEN

MONOLITHIC APPLICATIONSTRIGGERED BY CONTROL PROGRAMS

HARD TO SCALESUITED TO BIG TIN / MAINFRAME

LETS BUILD LEGACYMONOLITH

SPRING BATCH

SPRING BATCHJOBS

READERS, ... AND WRITERSREADERS

DEMOHTTPS://GITHUB.COM/DONOVANMULLER/ICODEJAVA-LEGACY-BATCH

IT WORKS, BUTIT'S A BATCH TO WORK ON

WHAT DO WE NEED?SINGLE, FOCUSED MODULES (FUNCTIONAL)

EASILY COMPOSABLEAUTONOMOUSEASY TO TEST

WHEN DO WE NEED IT?EASILY DEPLOYABLE

EASILY SCALABLEEASILY DISTRIBUTABLE

MICROSERVICES, MICROSERVICES,MICROSERVICES

MICROSERVICESSOA FOR HIPSTERS

SPRING BOOTSELF CONTAINED / SELF EXECUTING

AUTO CONFIGURATION FTW

SPRING BOOTCHKICKING THE KITTY

DEMOHTTPS://GITHUB.COM/DONOVANMULLER/ICODEJAVA-SPRING-BOOTCH

ONE STEP AT A TIMEBREAKING APART THE MONOLITH

SPRING CLOUD STREAMI/O, I/O, OFF TO WORK WE GO

FRAMEWORK FOR BUILDING MESSAGE-DRIVEN MICROSERVICESOPINIONATED CONFIGURATION OF MESSAGE BROKERS

SOURCE, PROCESSOR, SINK

... AND IN THE DARKNESS BIND THEMRABBIT MQ

KAFKAJMS (COMING SOON)

ROLL YOUR OWN

OOTBOUT OF THE BOX APPS FOR SIMPLE USE CASES

ORCHESTRATING THE GREMLINSSPRING CLOUD DATA FLOW

SPRING | CLOUD | DATA | FLOW

UNIX SYNTAXTASKS AND STREAMS

CLOUD NATIVE PROGRAMMING AND OPERATINGMODEL FOR COMPOSABLE DATA MICROSERVICES

TASKSON DEMAND EXECUTION

SHORT LIVED, PROCESS AND DIEGREAT FOR BATCH

DEMOHTTPS://GITHUB.COM/DONOVANMULLER/ICODEJAVA-SPRING-BOOTCH-SCDF-TASK

STREAMSALWAYS ON

DIRECTED GRAPH OF APPLICATIONSSOURCES, PROCESSES, SINKS

DEMOHTTPS://GITHUB.COM/DONOVANMULLER/ICODEJAVA-SPRING-BOOTCH-SCDF-STREAM

LOCAL IS LEKKER...... BUT WE NEED MORE

SPRING CLOUD DEPLOYERABSTRACTION FOR DEPLOYING BOOT APPS

DEPLOYER SPIDEPLOYS APPS AND TASKS

MESOS

YARN

CLOUD FOUNDRY

CURRENT DEPLOYER IMPLS

KUBERNETES

OPENSHIFT 😎

OPENSHIFTREDHAT - ORIGIN & CONTAINER

PLATFORM

EXTENDS KUBERNETES

SCHEDULES DOCKER CONTAINERS

package i.code.java;

public interface OpenShift extends Kubernetes {

// Build the Dockers BuildConfig buildConfig();

// Deploy the Dockers, // more smarter than ReplicationController DeploymentConfig deploymentConfig();

// Expose the Dockers Route route();

...}

DEMOHTTPS://GITHUB.COM/DONOVANMULLER/ICODEJAVA-SPRING-BOOTCH-SCDF-

STREAM/TREE/OPENSHIFT

HELM, WARP ONE ENGAGE! SCALE INDEPENDANT APPLICATIONS IN STREAMS

SMARTER APP DISTRIBUTION

THESE ARE THE VOYAGES OF THEENTERPRISE BATCH

... TO EXPLORE STRANGE NEW WORLDS

YEAH BUT NO, BUT YEAH BUT NO, BUTCULTURE - DEVOPSAFFORDS AGILITY

BEGINNINGS OF REACTIVE

QUESTIONS?