choose the right tools for big data development
TRANSCRIPT
Choose the Right Tools for Big Data DevelopmentLeverage Hadoop as your pilot project to gain organization buy-in and build institutional learning.This research is designed for data scientists, app development managers, and developers who:Need to analyze vast quantities and varieties of data quickly.Are looking for strategies to decrease data storage and computing power.Are seeking learning opportunities to apply big data development practices within the organization and other development projects. Data is growing exponentially and the business community feels the need to adopt and service value from big data to stay competitive, but this isn’t easy. Start with a Hadoop pilot to gather institutional learning and validating its fit. Schools of thought for your Hadoop pilot:Custom: Install each Hadoop component by yourself for maximum learning.Stack: Use a pre-fabricated stack with all components integrated for maximum speed.Cloud: Use a cloud vendor with individual components for maximum elasticity. Drivers/Trends/Change:Data is growing exponentially. “CSC estimates that data production will be 44 times greater in 2020 than it was in 2009.” (Computer Sciences Corporation (CSC), 2012)The need to analyze vast quantities and a variety of data quickly is imperative; “50.6% of respondents indicated speed of processing response and 41.3% indicated combining data structure as their initiative big data use case in 2012.” (Enterprise Management Associates (EMA), Operationalizing the Buzz: Big Data 2013, Nov 2013)There is no single product that does all of big data well. It is fragmented.Drastic decrease in cost of storage and computing power. Value Creation:Allows the business to make decisions using vast quantities of data across multiple data sources.See Project Steps Table Below Style Guide - Designers: Use the style guide to get a feel for our brandRough SketchThis infographic is the creative art of our research. As such, we want to make sure each one is unique and creative. The only real guideline is our fixed width and call to action image. The rest is up to you.1) Big Data Project Plan – Excel Tool2) Big Data Business Requirements Template – Word Template3) 4)5)6)1) Assess your fit and readiness for big data2) Prepare and roll out your Hadoop pilot3) Roll out Hadoop in your organization4)5)6)Choose the Right Tools for Big Data Development
Step 1Assess Your Fit and Readiness for Big DataYour fit for big data will hinge on your current data flow and whether your data stack can accommodate new entities while remaining intact.Step 2Build Your Project TeamGive your team time to understand Hadoop and create a team of data, operations, project management, and product owners to maximize learning potential.Step 3Roll Out Your Hadoop PilotDon’t rush into big data; understand what it can and cannot do for the business before implementing a major rollout. Not every project needs to incorporate big data technologies, especially where security is paramount.Step 4Roll Out Hadoop in Your OrganizationYour list of metrics will build over time as you begin to conduct performance optimization activities to identify the fit of Hadoop in other areas of your organization.
