big data in the cloud: 5 considerations for success - toby owen, rackspace

Big Data on the Cloud: Five considerations for success • Toby Owen • Head of International Big Data Strategy

19/06/2014 | Rackspace Public

RACKSPACE® HOSTING | WWW.RACKSPACE.COM

[email protected] Office: 020 8734 4459 www.rackspace.co.uk


What is Cloud

What is Big Data

The Five Ss

Why Rackspace?


V V V V What is Big Data?

Volume Velocity Variety Veracity = complexity A set of data that can't be managed adequately by the

current technology stack.

What is Big Data


What is Cloud?


infrastructure you don’t manage

What is Cloud

utility billed, on-demand, unlimited resource, programmatically accessible, broad access

NIST

EASIER


S S S S S The Five Ss


Scalability


Scalability 50 million events/day today 5 billion a day in 3 months DO YOU HAVE PLANS FOR THIS KIND OF SUCCESS?

Apple: demanded data from operators seeking to sell the iPhone. THEY SOLD A LOT OF IPHONES THAT’S A LOT OF DATA!

Can your system scale? THIS IS WHAT THE CLOUD WAS BUILT FOR!

You grow quickly you run out of space your database stops WHAT’S THE IMPACT TO YOUR BUSINESS

What if you spike, but only once a week? IS IT ECONOMICAL TO HAVE ALL THAT IDLE CAPACITY SITTING AROUND?

“IT’S BETTER TO HAVE INFINITE SCALABILITY AND NOT NEED IT, THAN TO NEED INFINITE SCALABILITY AND NOT HAVE IT”

Adam Clay Shaffer (@littleidea) Co-founder of Puppet Labs


Speed


Speed • Scaling - not just about storage space • Need to maintain performance at increasingly large scale • More data = harder to get performant queries and analytics (without purpose built solutions for the job)

• Speed is also about how quickly you can provision a new environment, or add capacity on your existing solution

• Hardware is expensive, and there are great benefits of using a specialist provider that has engineered a purpose-built solution for your big data solutions


Safety


Safety • The more data solutions become critical to your business, the more critical it is that they stay online

• Things to consider. Do you have: – Multiple hot copies of your data? – Daily backups? – Multiple internet links – Encryption between app and DB? – Using OpenSSL? ;)

• Managing availability and security is hard. But it pays off for those that get it right. When was the last Facebook outage you can remember?


Support


Support • MongoDB, Hadoop, Redis, Neo4J, Impala, Sqoop, Flume, HBase, ElasticSearch. Do you have experts in all these technologies? Most don’t!

• NoSQL, like MongoDB, are wildly popular with developers. –Easy to get started –PILOT –Not always easy to scale –Do you want your devs being sysadmins too?

• Mongo DBA’s are hard to find, and in demand


Source: indeed.com


Sustainability


Sustainability • Your big data initiative delivers measurable value back to the business – it has a positive ROI

• It’s the fifth “V” = value – What is the business question you are aiming to solve? – Does your strategy allow for future growth in your business? Will it scale properly with you? – How can you monetize your data (the data you are already storing)?


Next Steps

• Who is your sponsor? Should be the one that owns the outcome of the business question you want answered

• There is a lot of work here – you’re going to need some help • New technologies – does your IT staff have the skills necessary? Will you be able to hire, or do you want to partner?

• New apps – building “Big Data” apps also requires a new development skillset – the data scientist. Make sure you have this budgeted and planned for!

• START STORING EVERYTHING!


How Rackspace can help Why Rackspace?

RACKSPACE® HOSTING | © RACKSPACE US, INC. | RACKSPACE® AND FANATICAL SUPPORT® ARE SERVICE MARKS OF RACKSPACE US, INC. REGISTERED IN THE UNITED STATES AND OTHER COUNTRIES. | WWW.RACKSPACE.COM RACKSPACE® HOSTING | © RACKSPACE US, INC. | RACKSPACE® AND FANATICAL SUPPORT® ARE SERVICE MARKS OF RACKSPACE US, INC. REGISTERED IN THE UNITED STATES AND OTHER COUNTRIES. | WWW.RACKSPACE.COM

RACKSPACE® HOSTING | 5 MILLINGTON ROAD | HAYES, UNITED KINGDOM UB3 4AZ UK SALES: +44 (0)20 8712 6507 | UK SUPPORT: 0800 988 0300 | WWW.RACKSPACE.CO.UK

big data in the cloud: 5 considerations for success - toby owen, rackspace

Data & Analytics

rackspace hosting rackspace

rackspace public

helpwhy rackspace

lot of data

service marks of rackspace

big data solutions

big data apps

data scientist