#dataoncloud new york event
TRANSCRIPT
TAME DATA ON CLOUD.
Welcome to #DataOnCloud
WE HELP OUR CLIENTS…
MOVE THEIR BUSINESS
TO THE CLOUD
Aditi Promise
USER EXPERIENCE
MODERNIZATION MOBILE AND
MULTICHANNEL
DATA AND
ANALYTICS SOCIAL BUSINESS
SAAS ENABLEMENT INFRASTRUCTURE MIGRATION
CLOUD OPS CLOUD INTEGRATION
BUILD WITH AGILE ENGINEERING
PLAN AND
ARCHITECT
CONTINUOUS DEPLOYMENT AND SUPPORT
TEST AUTOMATION
INCREASE MARKET REACH REDUCE COST OF SERVING MARKETS ACCELERATE TIME TO MARKET
Aditi Solutions
Agenda
Industry Landscape Insights. Facts. Figures
By Jeff Kaplan, MD, THINK Strategies
Tame Data On Cloud Data problems. Why Cloud. Myth busting. Solution Roadmap
By Jeff Nuckolls, GM-Cloud, Aditi Technologies
Windows Azure: Bringing Cloud to your Enterprise By John Coleman, Windows Azure Technology Specialist, Microsoft
Panel Discussion followed by Q&A Discover Risks, Strategies & Roadmap for Cloud adoption
AlixPartners/CFO Research survey of 150
senior finance executives:
Only 3% rate their companies as "excellent” at converting business spend to technology value.
66% give their companies a "C" or "D" grade measuring financial returns from discretionary IT projects,
such as big data ones.
Failing to Reap Business Benefits From IT
CMOs will outspend CIOs by 2017 seeking
to better understand & influence
customers.
Real-Time Analytics of Social Networks
Essential
M2M connections will
jump from
approximately 100
million in 2011 to grow
to 2.1 billion by 2021.
Source: Analysys Mason
Data Multiplying In A Connected World
Geo-Spatial Data Exploding
Mobility = More Data Sources & Analytics
Access Devices
Few Organizations Have Systems & Skills to
Succeed
More than 85% of Fortune 500 organizations will fail
to effectively exploit Big Data for competitive
advantage through 2015.
Why Old BI Systems Failed
Inflexible Fortress
Dashboards Don’t Provide Useful
Information or Insight
Today BI Must Be Accessible to Everyone
Timely Analysis Must Be Available Anywhere
How the Cloud Helps…
The Cloud Transforming Every Industry
Cloud Solves BI / Big Data Challenges at Multiple Levels
IaaS = More Economical Data Capture/Storage
SaaS = More User Friendly Application Access
PaaS = More Powerful Solution Development
More Visible
More Usable
“I like expensive hotels.”
Better Targeted
+ Heuristics
+ Aggregated
Metadata
= Meaningful
Benchmark
Statistics/KPIs
Cloud Analytics Is More Than Just Better Dashboards
Customer Experience
Communications Collaboration
Community
Key Value-Add of SaaS/Cloud Computing
Software
Services
Business
Services
Strategic
Information
Services
“Like It or Not,
You’re in the Data Business” Tom Davenport
WSJ CIO Journal
April 10, 2013
Cloud Analytics Can Redefine Your Business
• Companies understand “Cloud Curve”.
• Lack actual framework for defining data
requirements.
• Require real-world use case scenarios for
making the transition.
Conclusion
Why consider the cloud?
Cloud innovation presents challenges for IT
Identity
Virtualization
Data Platform
Development DevOps and mgmt
33
35
36
₩ ¥
€ руб
$
$ £
$
Rp
TL
chf
kr kr
$ R $
$
3
Major datacenter
CDN node
Live sub-region
Announced sub-region
Partner-operated sub-
region
vpn
Power your business with Windows Azure
TAME DATA ON CLOUD.
Jeff Nuckolls Aditi Technologies GM of Cloud Solutions/Services
King of your…
…is King
Is this true? Or are you…
Meet your data challenge…
High Volume
Data Growth Quality of
Data
Increased
Frequency of
Data Collection
Data Beyond
Relational
Valuable Insights Budget for Growth Globally Accessibility
Volume Velocity Variety Veracity
Security Reliability
From Where Does this Data Come?
Device + Sensors Social Feeds
Relational Databases
Trading Desks Web Logs
Document Stores No SQL or Table Storage
SQL
Use of Data? KPI Dashboards
Trading Stations
Alert/Notifications
Personalized Web
What’s the Opportunity?
Sensor on Plant Floor
10,000 events/sec
Click-Stream Data etc.
Personalized pages
100,000 events/sec.
Fraud Detection
Algorithmic Trading
100,000 events/sec.
Energy Consumption
Smart Grids
100,000 events/sec.
Case Study # 1: HealthCare Company Improves
Hospital Hygiene Using Sensor Data
Aggregate and report “Hand Hygiene Compliance” for hospitals
Identify increased patient risk, provide notification in real-time
Azure based storage for unstructured data - RFID data and video collection
for 100+ doctors
Azure based computation scalability and push live notifications
Single sign-on authentication using Active Directory
Render reports using predefined views
Storage scalability
Reduced costs
Streamlining unstructured data
Case Study # 2: Big European Travel
Conglomerate Optimizes Product Pricing
Price their products better based on competitor data using web crawlers
Collect web logs to analyze customer behavior and deliver better pricing
Deliver predictive models to forecast future prices of products during
holiday seasons
Utilize Cloud storage to capture data from web crawlers as raw data
Use Hadoop to segment and identify best price from logs and crawler data
Scheduling and computing using the cloud
Render KPIs using visualizations
Run machine learning algorithms
Storage scalability
Idea to production in six weeks
High performance computing
Case Study # 3: Financial Services Company
Reduces Costs & Increases Reliability of Services
Reduce ever-increasing on-going capital investments
Increase reliability of services serving over 100,000 members in Illinois
Windows Azure based provisioning of server Virtual Machines (VMs)
Replication of Windows Azure Active Directory and extension on Cloud
Single sign-on authentication using Active Directory
Implementation of Disaster Recovery solution
Storage scalability
Reduced costs
Disaster recovery & backup solutions
Case Study # 4: Leading Integrator in Cinema
Improves Scalability with Media Digitization
Provide automatic scalability to manual process of delivering media content
Increase reliability of services serving over 16,000 screens worldwide
Windows Azure Media Services (WAMS) provides automatic scalability by
leveraging the benefits of Windows Azure Cloud, including the increase of
capacity on demand
Data storage for unstructured data using Windows Azure Blobs
Creating eco-system with complete media digitization enabling playback on
multiple devices and formats
Improved Revenue management with end-to-end visibility
DUDE….
Wait, WHAT?
How Does Cloud Solve the 4V’s?
High Volume
Data Growth Quality of
Data
Increased
Frequency of
Data Collection
Data Beyond
Relational
Volume Velocity Variety Veracity
How Cloud Helps Solve the Data Problem
↑ Ability to add storage dynamically
↑ Increase computing power on demand
↑ Use global distributed data centers for localized processing High Volume
Data Growth
VOLUME
How Cloud Helps Solve the Data Problem
↑ Use Azure networks to collect data with
very low latency
↑ Leverage CEP on Azure to do real time
event processing
↑ Distribute notifications and alerts
VELOCITY
Increased
Frequency of
Data Collection
How Cloud Helps Solve the Data Problem
↑ Azure supports Relational, No SQL and
Blob locally
↑ Ability to process and enrich all kinds of
data using HDInsights
↑ Combine relational and non relational
data in one service
VARIETY
Data Beyond
Relational
How Cloud Helps Solve the Data Problem
↑ Ability to add storage dynamically
↑ Increase computing power on demand
↑ Use global distributed data centers for
localized processing
VERACITY
Quality of
Data
OK yeah….
Then WHAT?
Approach for USING DATA with the CLOUD
Aggregate
Fragmented
data sources
Non relational
information Unclean data DATA SOURCE
Relational
historic data
DATA INJECTION Use DataHub to load data
into Azure Blob storage
Classify data into tables,
blobs, SQL Azure Enable the blob storage
as HDFS for HDInsights
Enrich
Filter data using
MAPREDUCE REFINE
TRANSFORM
CLEANSE
Apply transformations Segment data based on
multiple variables
Remove duplicates
Eliminate non required information
Leverage HIVE to use
HDInsights as a DW
Prepare and load it into
relational format if required
Load data into
clusters using PIG
Analyze
ANALYZE
VISUALIZE
Access HDFS data using
Excel data explorer
Implement Embedded
visualizations using Power view
Leverage machine learning
Deliver alerts and notifications
Implement statistical algorithms
like Naïve baiyes,Clustering
Process real time business
events using StreamInsight
Visualize
Starting the Journey
Data & Cloud Quick Start
• 1-day with a Cloud
Architect
• Detailed review of data
challenges and cloud
maturity
• Cost/Benefit Analysis
• Roadmap for Success!
Additional QuickStarts
• Cloud Fit Assessment
– (Business/Portfolio Strategy Alignment)
• HA SQL Server in the Cloud
• Migrating SharePoint Workloads to the Cloud
• Cloud-Based Dev/Test Environments
• Cloud-Based Core Infrastructure
• AD/IAM in the Cloud
Quick Question…
WHAT?
Web | Blog | Facebook | Twitter | LinkedIn