think like an ant, distribute the workload - phpday, italy, 2011

Distribute the workload

Helgi Þormar ÞorbjörnssonPhpDay, Italy, Verona, 13th May, 2011

Saturday, 14 May 2011

Who am I?

VP of Engineering at Orchestra.io

Developer at PEAR

From Iceland

Developer at PEAR

From Iceland

@h on Twitter

Why Distribute?

Budget

Why Distribute?

Budget

Efficiency

Why Distribute?

Budget

Efficiency

Perception

Budget

Spend wisely

Budget

Spend wisely

Commodity servers

Budget

Spend wisely

Commodity servers

Low overhead, high yield

Budget

Spend wisely

Commodity servers

Low overhead, high yield

Cloud Computing (EC2)

Efficiency

10 small servers > 1 big

Venue Security

1000 people can exit quicker through 10 small doors than 1 big

1000 people can exit quicker

through 10 small doors than 1 big

1000 people can exit quicker

through 10 small doors than 1 big

1000 people can exit quicker through 10 small doors than 1 big

Perception

Defer intensive processes

Perception

Give instant feedback

Perception

Users keep on browsing

Perception

Users keep on browsing

Chapter from Nature

Ant Colonies

Algorithms

Scheduling

Algorithms

Scheduling

Vehicle Routing

Algorithms

Scheduling

Vehicle Routing

Assignment

Algorithms

Scheduling

Vehicle Routing

Assignment

Algorithms

Scheduling

Vehicle Routing

Assignment

Algorithms

Scheduling

Vehicle Routing

Assignment

How do ants fit?

Strength in numbers

How do ants fit?

Strength in numbers

Work together

How do ants fit?

Strength in numbers

Work together

Size benefits them

Teamwork

When faced with a problem they will solve the problem as one.

What if they were bigger?

Types of Ants

Military

Types of Ants

Military

Types of Ants

Military

Tunnel diggers

Types of Ants

Military

Tunnel diggers

Food gatherers

How does this map to my application?

Colony = Application

Colony = Application Ants = Components

Ants do many different types of work to keep their colony running

Architect for Distribution

Characteristics

Decoupling

Characteristics

Decoupling

Elasticity

Characteristics

Decoupling

Elasticity

High Availability

Characteristics

Decoupling

Elasticity

High Availability

Concurrency

Decoupling

Application

DB API

Cache FE

Application

DB API

Cache FE

ApplicationDB API

Cache FE

ApplicationDB API

Cache FE

ApplicationDB API

Cache FE

ApplicationDB API

Cache FE

Elasticity

Cloud Computing

Load Balancing

HA Proxy

My Favourite

Monitoring

Automation

High Availability

Benefits

Easy management

Benefits

Easy management

Ability to stop / start servers quickly

Benefits

Easy management

Responsibilities are separate

Benefits

Easy management

Quickly move to a new cluster

Benefits

Easy management

Quickly move to a new cluster

Reduced risk

What to avoid

What to avoidLocal:

Sessions

What to avoidLocal:

Sessions

What to avoidLocal:

Sessions

Memory

What to avoidLocal:

Sessions

Memory

Uploads

What to avoidLocal:

Sessions

Memory

Uploads

Writing to /tmp

Solutions

Store sessions in DB / Memcache

Solutions

Use S3 to store uploaded files

Solutions

Use networked Memcache

Solutions

Serve up static files from a CDN

Solutions

Serve up static files from a CDN

Or... A multi domain solution

Internal APIs

Application

MySQLMongo FS

Internal Storage API

Service Oriented Architecture

Sort of :-)

Eventually Consistent

CAP Therom

Consistency

Availability

Partition Tolerance

Queue Systems

Good for

Good forImage Processing

Distributed Logs

Data Mining

Distributed Logs

Data Mining

Mass Emails

Distributed Logs

Data Mining

Mass Emails

Intensive transformation

Distributed Logs

Data Mining

Mass Emails

Intensive transformation

Search

Common Tools

Gearman

Common Tools

Gearman

Hadoop

Common Tools

Gearman

Hadoop

Zero MQ (0MQ)

Common Tools

Gearman

Hadoop

Zero MQ (0MQ)

RabbitMQ

Common Tools

Gearman

Hadoop

Zero MQ (0MQ)

RabbitMQ

And many others!

Gearman

Your Client Code

Gearman Client API(C, PHP, Perl, MySQL UDF, ...)

Gearman Job Servergearmand

Gearman Worker API(C, PHP, Perl, Python, ...)

Your Worker Code

Your App Gearman

Story time

Questions?

helgi@orchestra.ioTwitter: @h

Joind.in: http://joind.in/3027

think like an ant, distribute the workload - phpday, italy, 2011

Technology

ca workload automation agent for peoplesoft workload...

ca workload automation agent for web services workload...

cmf: a pain in the f @ phpday 05-14-2011

symfony & jquery (phpday)

tivoli workload scheduler: scheduling workload...

managing oracle workload with z/os workload manager€¦ ·...

evaluating cloud database migration options using workload...

perf scripts jiri olsa - events.static.linuxfound.org3 perf...

ca workload automation - gsebelux.com belux - ca workload...

workload reporting workload reporting workload … reporting...

mastering php data structure 102 - phpday 2012 verona

wordpress for developers - phpday 2011

load balancing in public cloud using partitioning...

ca workload automation application services agent workload...

phpday 2013 - high performance php

high gear php with gearman (phpday 2010)

detrás del backend [phpday 2015]

tivoli workload scheduler: dynamic workload console...

lazy evaluation: stop wasting memory and time - phpday

how badoo saved $1m switching to php7 - nikolay krapivnyy -...