eng computaon & data scienceeng computaon & data science the historical approach the...

34
Eng Computa,on & Data Science

Upload: others

Post on 29-Aug-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

EngComputa,on&DataScience

Page 2: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

TheHistoricalApproach

Page 3: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

TheChallenge:ComplexSo7wareSystems

Page 4: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

CLIENT SERVER MIDDLEWARE DATA STORE

NTiersSystems

Page 5: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

SystemBuildingBlocks

Page 6: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Applica;onServers:•  Small•  Easytouse•  LowCost•  Ubiquitous•  LooselyJoined

Page 7: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Applica;onServerSkills

•  ServiceCrea;on•  ServiceConsump;on•  ServiceIntegra;on•  DataTransforma;ons•  Concurrency•  Coordina;on

Page 8: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

PackageManagement

•  Registry•  Crea;on•  Distribu;on•  Scalability

Page 9: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

ParallelHappens–AsyncPrograms

•  Non-Blocking•  Event-loop•  Callbacks•  Promises

Page 10: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

StateManagement

•  RecordandReplay•  PredictableContainers•  Logging•  TimeTravel

Page 11: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

EventStreams

•  EventManagement•  Eventbubbling•  EventDrivenProgramming•  Reac;vePaNerns

Page 12: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Coordina;on

•  Orchestra;on•  Integra;on•  ErrorHandling

Page 13: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

REST

•  Microservices•  RouteMgmt.•  TokenMgmt.•  APIDesign

Page 14: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Containers

•  ContainerMgmt.•  Docker•  Mesos•  Kubernetes

Page 15: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Collabora;on

•  Issues•  Tracking•  History•  No;fica;ons•  Visualiza;on•  PaNerns

Page 16: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Collabora;on

Page 17: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Con;nuousIntegra;on

Page 18: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Con;nuousIntegra;on

Page 19: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Con;nuousIntegra;on

•  PullRequests•  BranchSelect•  No;fica;on•  Tes;ng•  Containers•  Deployment

Page 20: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

BigData

•  Volume•  Variety•  Velocity•  Transforma;ons

Page 21: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

CommodityHardware

•  LowCost•  Easytouse•  RunsNode•  Manychoices

Page 22: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Security

•  Iden;fy•  Protect•  Detect•  Respond•  Recover

Page 23: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Technology

Page 24: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

CLIENT SERVER MIDDLEWARE DATA STORE

OpenSource,Scalable,LargeAdop;on

Page 25: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Someofthenumbers

Page 26: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Construc,onCycle

Page 27: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

understandtheproblem

architectsystem

buildsystem

testsystem

learnfromtest

demosystem

ComplexSo7wareSystemCycle

Page 28: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Step1:Understandtheproblemdeeply

Page 29: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Step2:ArchitectSystem

Page 30: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Step3:BuildSystem

Page 31: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Step4:TesttheSystem

Page 32: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Step5:DemoSystem

Page 33: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Step6:Learn

Page 34: Eng Computaon & Data ScienceEng Computaon & Data Science The Historical Approach The Challenge: Complex So7ware Systems CLIENT SERVER MIDDLEWARE DATA STORE N Tiers Systems System Building

Step7:Iterate