gearman to distribute server load

An application framework to distribute work

Presenter: Biswajit Maji, Mindfire SolutionsDate: 1/04/2014

Presenter: Biswajit Maji, Mindfire Solutions

OCP – Oracle certified professional developer

About Me

Skills : Mysql, php, jQuery, html, VCS(svn, git), Webservices, Linux

Connect Me:Facebook: https://www.facebook.com/biswajitmaji.techLinkedIn: http://www.linkedin.com/profile/view?id=133902574Google+: https://plus.google.com/105085556902166170611/

Contact Me:Email: biswajitm@mindfiresolutions.com / biswajitmaji.tech@gmail.comSkype: mfsi_biswajitm

Presenter: Biswajit Maji, Mindfire Solutions

AGENDA

• Why Gearman

• What is Gearman

• Terminology

• How Gearman works

• Available APIs

• Advantages

Presenter: Biswajit Maji, Mindfire Solutions

Why GEARMAN

Presenter: Biswajit Maji, Mindfire Solutions

What is Gearman

Open source application framework

To distribute appropriate computer tasks to multiple computers

So large tasks can be done more quickly

In some cases, load balancing rather than raw speed may be the main goal

A Web server, can use Gearman to send tasks to another computer which is optimized to do that particular task (may be running on a different architecture, using another operating system, or loaded with a different computer language better suited to a particular operation).

It is an application framework to distribute work

Presenter: Biswajit Maji, Mindfire Solutions

Terminology

Create jobs to be run and send them to a Gearman server

Register with a Gearman server and grab jobs to run

Coordinates assignment from clients to workers, handles restarts

Client

Worker

Gearman Server

Presenter: Biswajit Maji, Mindfire Solutions

Gearman Working Structure

Presenter: Biswajit Maji, Mindfire Solutions

Gearman Work Flow

Presenter: Biswajit Maji, Mindfire Solutions

How Gearman works

Presenter: Biswajit Maji, Mindfire Solutions

Available Client and Worker Libraries

.NETCDjangoDrizzleJavaJMSLispMySQL

Node.jsPerl PHPPostgreSQLPythonRubyTwisted ...

Presenter: Biswajit Maji, Mindfire Solutions

Advantages

Speed up work

Load balance since the job server only sends new jobs to idle workers

Parallel and asynchronous work

Scales well

Architecture-based workload distributing

Fault tolerance using multiple server.

Can be used as an interface between a client and a worker written in different languages.

Presenter: Biswajit Maji, Mindfire Solutions

References

http://gearman.org/

http://blog.zitec.com/2011/parallel-processing-with-php-and-gearman/

http://www.phpclasses.org/blog/post/108-Distributing-PHP-processing-with-Gearman.html

http://www.cirello.org/2012/05/scalable-architecture-with-gearman-job-server/

Presenter: Biswajit Maji, Mindfire Solutions

Question and Answer

Presenter: Biswajit Maji, Mindfire Solutions

Thank you

www.mindfiresolutions.com

https://www.facebook.com/MindfireSolutions

http://www.linkedin.com/company/mindfire-solutions

http://twitter.com/mindfires