open stack bigdata ny cloudcamp

Download Open stack bigdata NY cloudcamp

If you can't read please download the document

Upload: guy-korland

Post on 16-Apr-2017

698 views

Category:

Technology


2 download

TRANSCRIPT

BIGDATA APPS
ON OPENSTACK

thanks:Uri Cohen

V.P. PM @ [email protected]/uric

about:me

V.P. R&D @ GigaSpaces@g_korlandgithub.com/gkorland

Big data and cloud technology
go hand-in-hand. Big data needs clusters of servers for processing, which clouds can readily provide.

Ed Dumbill, The OReilly Radar

Why OpenStack?

Everyone (well, almost) is in

HP, RackSpace, Dell, IBM, RedHat

Public / Private cloud interopCloud bursting

Portability

The 3 Vs of Big Data

Big Data Is Not Just About Elephants

Distributed File System

Map/Reduce

Data Mining

Data Access

Discovery & Orchestration

Real Time Event Processing

HDFS, in Reality

Map/Reduce, in Reality

Data Access, in Reality

Mongo, in Reality

Storm

Storm, In Reality

And What about Other Parts
of Your App??

And This is What Your Big Data
App Will Eventually Look Like

Managing All of That In the Cloud

Start VMs

Install and configure components

Monitor

Repair

(Auto) Scale

Burst

Managing Big Data Apps

Managing Big Data

Primary and Backup dependency Moving data around for scaling Availability - moving data without losing it.Moving processes to the data rather than the other way aroundManaging the app as a whole

Some Existing (incomplete) Solutions

Introducing Cloudify
the Open Paas Stack (Pun Intended)

When PaaS Met DevOps

Your App, Your Recipe

How It Works

CommandsResource AllocationInvokes IaaSAPIBootstrapJava & Cloudify AgentInstallConfigureStart Monitor& Ensures H/A

Process Application RecipeComputeServices

Demo

Getting Started

Community site
http://www.cloudifysource.org

OSS project repo:
https://github.com/CloudifySource/cloudify

Jira:
https://cloudifysource.atlassian.net

Travis-CI: http://travis-ci.org/#!/CloudifySource/cloudify

Get Involved!

Q&A

Thank You!

Get it today, for free: www.cloudifysource.org

Click to edit the title text formatClick to edit Master title style

6/12/12

Click to edit the title text formatClick to edit Master title style

Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline Level

Seventh Outline LevelClick to edit Master text styles

Second level

Third level

Fourth level

Fifth level

6/12/12

Click to edit the title text formatClick to edit Master title style

Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline Level

Seventh Outline LevelClick to edit Master text styles

Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline Level

Seventh Outline LevelClick to edit Master text styles

Second level

Third level

Fourth level

Fifth level

Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline Level

Seventh Outline LevelClick to edit Master text styles

Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline Level

Seventh Outline LevelClick to edit Master text styles

Second level

Third level

Fourth level

Fifth level

6/12/12

Click to edit the title text formatClick to edit Master title style

6/12/12

Click to edit the title text formatClick to edit Master title style

Click to edit the outline text formatSecond Outline LevelThird Outline LevelFourth Outline LevelFifth Outline LevelSixth Outline Level

Seventh Outline LevelClick to edit Master text styles

6/12/12

Click to edit Master title style

Click to edit Master text styles
Second level
Third level
Fourth level
Fifth level

6/12/12

6/12/12

Click to edit Master text stylesSecond levelThird levelFourth levelFifth level