microsoft data warehousing

44
DATA WAREHOUSING

Upload: glenture

Post on 24-Dec-2014

153 views

Category:

Business


0 download

DESCRIPTION

Overview of data warehousing.

TRANSCRIPT

Page 1: Microsoft Data Warehousing

DATA WAREHOUSING

Page 2: Microsoft Data Warehousing

AGENDA

IntroductionNext Generation Performance and AvailabilityInsights for EveryoneFastest Time to Solution at Lowest Cost

Page 3: Microsoft Data Warehousing

IntroductionData Warehousing with a Vision

Page 4: Microsoft Data Warehousing

IMAGINE …

You’re at a station in an unfamiliar city on business and your train is delayed

Your smart phone, aware of the delay, alerts you to the fact that you will be late for your scheduled meetingIt offers to direct you to a bus stop, calculating that you can still arrive on time by taking the next bus

Instead you decide use an app on your phone that contacts local cab firms and automatically orders a car from the company that can get to you fastest

The cab locates you by GPS, gets you to your meeting on time, and the fare is paid automatically via your phone

Page 5: Microsoft Data Warehousing

GETTING THEREIt’s all about the data warehouse

Availability

Performance

Scale

Delivery

Scale to house massive volumes

of data from multiple sources

Answer complex queries almost

instantly

Ensure that the service remains available at all

times

Deliver accurate information to any device, any time, and any

place

Page 6: Microsoft Data Warehousing

GETTING THEREWhere are we now?

Transport for London has already implemented a Microsoft solution that offers real-time journey options through mobile devices, making it faster and simpler for travellers to find their way around in this very large city“Portable and mobile devices in people’s hands are a great way to help customers benefit from our data. Our challenge is to get information to people in a way that helps them make their journeys better, faster, and less stressful.”

- Michael Gilbert, Chief Technology Officer, Transport for London

Page 7: Microsoft Data Warehousing

WHY SQL SERVER FOR DATA WAREHOUSING?

… the power and scalability to handle the largest, most demanding workloads

…the reliability to ensure virtually 100% availability

Plus …

Increased productivity

with integrated

tools

Credible and consistent data with built-in EIM

Easy to use, familiar BI

tools

Reference architectures and appliance

options

Fastest time to solution

Low cost of acquisition,

operation, and maintenance

Fast insights with built-in analysis and

reporting

Page 8: Microsoft Data Warehousing

End-to-End Data Warehousing PlatformDriving Analytics on any Data

NON RELATIONAL

100111

DATA MANAGEMENT

SHAREAND GOVERN

DISCOVERAND RECOMMEND

TRANSFORMAND CLEAN

ANALYTICS

DATA ENRICHMENT

OPERATIONAL

SELF-SERVICE MOBILE

PREDICTIVE

REAL-TIME

COLLABORATIVE

MA

RK

ETPLA

CE

Exte

rnal

Data

and

Serv

ices

RELATIONAL MULTIDIMENSIONAL STREAMING

Page 9: Microsoft Data Warehousing

LEADERS IN BOTH DATA WAREHOUSING AND BI

Challengers

Leaders

Niche players Visionaries

Completeness of Vision

Abili

ty t

o

Exe

cute

Gartner magic quadrants

“Microsoft exhibits one of the best value propositions on the market with a low

cost and a highly favorable price / performance ratio”- Gartner, February 2012

[Gartner, Inc., Magic Quadrant for Data Warehouse Database Management Systems Magic Quadrant, Mark A. Beyer, Donald Feinberg, Merv Adrian, Roxane Edjlali, February 6, 2012. The Magic Quadrant is copyrighted 2012 by Gartner, Inc. and is reused with permission. The Magic Quadrant is a graphical representation of a marketplace at and for a specific time period. It depicts Gartner's analysis of how certain vendors measure against criteria for that marketplace, as defined by Gartner. Gartner does not endorse any vendor, product or service depicted in the Magic Quadrant, and does not advise technology users to select only those vendors placed in the "Leaders" quadrant. The Magic Quadrant is intended solely as a research tool, and is not meant to be a specific guide to action. Gartner disclaims all warranties, express or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.

Challengers

Leaders

Niche players Visionaries

Completeness of Vision

Abili

ty t

o

Exe

cute

Data Warehousing Business Intelligence

As of February 2012 As of February 2012

Page 10: Microsoft Data Warehousing

MEETING THE CHALLENGES OF TODAY AND TOMORROWBenefit from a roadmap that enables you to tackle today’s issues and be prepared for the challenges of the future

Data explosion – Harness ever increasing volumes of data to gain insights and drive solutions

Multiple sources of data – Include all of the data, from unstructured ‘big data’ to cloud-based data, and obtain new and different types of insightsDevelopment and Implementation – Experience a fast time to solution and low TCO by using tested reference architectures and pre-built appliances

Pervasive business intelligence – Liberate your data and empower workers by opening up BI to everyone

Vendor lock-in – Choose the hardware that suits you best and avoid the risks of being locked into a specific hardware vendor

Manageability – Reduce management effort and increase productivity with integrated tools

Page 11: Microsoft Data Warehousing

DATA WAREHOUSING WITH MICROSOFT

11

Extend BI to all users

Insights For Everyone

Enterprise Ready

Breakthrough Performance with Mission Critical

Availability and Scale

Lowest Total Cost of Ownership

Fastest Time To Solution At Lowest

Cost

Page 12: Microsoft Data Warehousing

Breakthrough Performance with

Mission Critical Availability and Scale

Enterprise Ready

Page 13: Microsoft Data Warehousing

BREAKTHROUGH PERFORMANCE AT MASSIVE SCALE

Next-Generation Performance

Key Features at a Glance

Enterprise Scale

” – Wolfgang Kutschera, bwin.party

Page 14: Microsoft Data Warehousing

Enterprise Ready

ENTERPRISE CLASS AVAILABILITY

” - Paul Gleason, VP SQL Administration

Team

Key Features at a Glance

Page 15: Microsoft Data Warehousing

COMPLEX QUERIES AT HIGH CONCURRENCY

“Parallel Data Warehouse runs complex queries about 160 times faster, providing a data load over 1 Tb/Hour

and fully integrates into a complete BI Solution”

Benefits

• Incredible performance for highly complex queries

• High-concurrency environments

responsiveness and agility

maximum availability

Page 16: Microsoft Data Warehousing

Insights for EveryoneExtend BI to All Users

Page 17: Microsoft Data Warehousing

ANALYSIS AND REPORTING AT NO EXTRA COSTProven reporting and analysis tools

Multidimensional data models for ‘traditional’ data analysis

”- Tim Lum, Head of BI, Kelkoo

Intuitive report authoring

SQL Server Analysis Services

SQL Server Reporting Services

Tabular data models make it fast and easy to analytics get up and running

Comprehensive report management and delivery

Interactive, visual reporting with Power View

Benefits

Page 18: Microsoft Data Warehousing

Benefits

SELF-SERVICE BUSINESS INTELLIGENCEUse the tools that you already own

Excel-based, in-memory data aggregationSlice and dice data modelsShare data models in SharePoint

SharePoint-based interactive visual reportingCreate visualizations from tabular data models

Power View

PowerPivot

”- Dong-Soo Woo, Head of IT Planning,

- Heungkuk

Page 19: Microsoft Data Warehousing

CREDIBLE, CONSISTENT DATA A complete enterprise information management suite

Integration Services

Data Quality Services

Master Data Services

Data cleansing and de-duplication

Accuracy, trustworthy data

Extract, transform, and load data from any industry source

”- Dalila Kerkouba, IT Manager,

- Areva

Page 20: Microsoft Data Warehousing

BIG DATA AND COULD INTEGRATIONImprove insights by including all of the data

Harness unstructured data such as Word documents, PDF files, pictures, videos, RFID data, and sensor data

Hadoop solutions for Windows Server and Windows Azure

Connectors move data between SQL Server data warehouse and Hadoop

Big Data

Integrate on-premises data with data stored in the could to deliver the whole picture

Combine internal and external data and services with SQL Azure

Use familiar tools such as Excel and PowerPivot to gain insights

Cloud Data

Page 21: Microsoft Data Warehousing

Fastest Time to Solution at Lowest Cost

Lowest TCO

Page 22: Microsoft Data Warehousing

LOWEST TOTAL COST OF OWNERSHIPSave hundreds of thousands on new licence and maintenance costs by migrating to SQL Server

Fastest time to solution with Appliances or RAs

Save hundreds of thousands of dollars on new license and maintenance costs

Monitor HW and SW with single tool

Key components of Business Intelligence and Enterprise Information Management at no extra cost

Open industry hardware your staff already knows

” -Dale Danilewitz, CIO, AmerisourceBergen

Save Hundreds of Thousands of Dollars

Page 23: Microsoft Data Warehousing

FASTER DEPLOYMENT TIME

A major component of TCO for a data warehouse is the cost of planning and deployment …

DBMS Installation

Configuration

Security

Integration

Total

SQL Server

22 34 18 14 88 minutes

Oracle 48 165 38 106 357 minutes

SQL Server and Oracle Database deployment times in minutes *

* Installation – Initial installation of the database software on the server Configuration – Creation of database schema and specification of database instance settings Security – Definition of security settings for the database Integration – Integration of the database with the infrastructure, including backup processes

” -Staffan Zackrisson, President and CEO, Volvo Aero

… SQL Server has a faster deployment time than major vendors

Page 24: Microsoft Data Warehousing

REFERENCE ARCHITECTURES AND APPLIANCESChoice of Form Factors: Eliminate planning and deployment times

Pre-tested and tuned reference architectures based on commodity hardware from major partners

Certified with 7 open industry standard HW partners

.”- Jordan Zommick, Executive Director of Enterprise Architecture and Development, Las

Vegas Sands

Fast Track Data Warehouse

High-performance, high-concurrency data warehouse appliances

Co-engineered with open industry standard hardware

Parallel Data Warehouse

Page 25: Microsoft Data Warehousing

Monitor Data Warehouse hardware and software through single tool: System Center

TAKE CONTROLBetter manageability, greater productivity, lower TCO

Integrated tools enable management of all aspects of your data warehouse with minimal trainingIncrease backup speeds and reduce backup storage with backup compressionUp to 15,000 partitions, enabling you to better manage the data lifecycle

“By migrating data from Teradata to our existing Microsoft platform, we increased processing speeds by about 15 per cent and reduced IT administrative and maintenance costs by more than $600,000 over the first two years.”

- Mark Underwood, Second Vice President, Protective Life Corporation

Page 26: Microsoft Data Warehousing

Summary

Breakthrough Performance with Mission Critical Availability and Scale Insights for everyone The fastest time to solution at the lowest cost

Page 27: Microsoft Data Warehousing

APPENDIX (DETAILED SLIDES)

Page 28: Microsoft Data Warehousing

DATA WAREHOUSING AT ANY SCALE

A choice of form factors and hardwareStart small and grow

Self Build

Business Data

Warehouse

Fast Track Reference Architectur

es

Parallel Data

Warehouse Half Rack

Parallel Data

Warehouse Full Rack

Effort to Build

Variable Very low Moderate Very low Very low

Capacity Variable 5TB 14TB – 95TB 80TB 500TB +

Concurrency

Variable Light Light – high Very high Very high

Query Complexity

Variable Medium Medium – high

Very high Very high

Architecture

SMP SMP SMP MPP MPP

Form factor

Software only

Appliance Reference Architecture

Appliance Appliance

Page 29: Microsoft Data Warehousing

SQL SERVER DATA WAREHOUSE OPTIONSFlexibility and Choice

29

Customers acquire and tune the software to their own hardware without guidance.

Offerings• SQL Server 2012• SQL Server 2008 R2

Effort to build

Tuning

Flexibility in configuration

Initial Price Investment

Variable to High

Mid

High

Low

Deliver hardware and software separately containing pre-tested, pre-tuned configuration best practices

Offerings• Fast Track for SQL

Server 2012• Fast Track for SQL

Server 2008 R2

Effort to build

Tuning

Flexibility in configuration

Initial Price Investment

Low

SW

Low - Mid

Mid

HW

Appliances deliver a solution with hardware and software already integrated, tested, tuned, configured

Offerings• Parallel Data

Warehouse• BDW, SDW• HP Factory Express

Effort to build

Tuning

Flexibility in configuration

Initial Price Investment

Mid - High

Low

Low

Low

SOFTWARE

REFERENCE ARCHITECTURES

APPLIANCES

Page 30: Microsoft Data Warehousing

Tuning & Optimization

Procure or Use Existing HW& Support

Installation

Procure Software & Support

ConfigurationTuning & Optimization

Installation

Configuration

Tim

e t

o

Solu

tion

Installation

SQL SERVER DATA WAREHOUSE OPTIONSFlexibility and Choice

Offerings• SQL Server 2012• SQL Server 2008

R2

Offerings• Fast Track for Server

2012• Fast Track for SQL 2008

R2

Offerings• Parallel Data Warehouse

• BDW, SDW• HP Factory Express

Tuning & Optimization

Procure or Use Existing HW& Support

Procure Software & Support Procure Appliance & Support

High

Pri

ce

High

Optional if have HW already

SOFTWARE

REFERENCE ARCHITECTURES

APPLIANCES

Page 31: Microsoft Data Warehousing

Benefits

SOFTWARESelf-build Data Warehouse with SQL Server 2012

” - Bruce Kenny, Executive Vice President

Key Features

Page 32: Microsoft Data Warehousing

Benefits

REFERENCE ARCHITECTURESGuided-Build Data Warehouse with Fast Track

” Hasan Rahmi Atılganer, Data Process

ManagerKey Features

” Tom Grina, CFO

Page 33: Microsoft Data Warehousing

Benefits

APPLIANCESPre-Built Data Warehouse with Parallel Data Warehouse

Key Features

” Peter van Manen, Managing Director

Page 34: Microsoft Data Warehousing

Benefits

APPLIANCESPre-Built Small Data Warehouse with BDW, SDW

Key Features

Page 35: Microsoft Data Warehousing

Required 9’s of availability

Optimized on the latest industry standard hardware

SSD optimized

WHAT’S NEW IN FAST TRACK FOR SQL SERVER 2012

10-100x faster

“We anticipate huge data growth across all of our properties, and SQL Server Fast Track Data Warehouse gives us confidence that we can meet any scalability needs that arise.”

- Jordan Zommick, Las Vegas Sands

Page 36: Microsoft Data Warehousing

Half-rack appliances now available

Best in class manageability

Scale your applications from SQL Server to Parallel Data Warehouse

WHAT’S NEW IN SQL SERVER PARALLEL DATA WAREHOUSE AU3

10x performance improvement

Page 37: Microsoft Data Warehousing

Data Warehousing Customer Momentum

Don Wood, Manager of Database Administration

Jordan Zommick, Executive Director of Enterprise Architecture

Fariba Anderson Vice President of Lottery IT

- David Smith, Director, Software Architecture

- Rajesh Babu, Sr Director Global BI

-Matt Cunningham, ICT

-Dale Danilewitz, Chief Information Officer

-Mark Underwood, Second Vice President

-Staffan Zackrisson, President and CEO

Page 38: Microsoft Data Warehousing

CASE STUDY- McLaren Electronic Systems

McLaren Electronics Systems is part of the McLaren Group, a private group of companies that includes McLaren Racing.

A platform to capture, store, and access large volumes of data for Formula One racing circuit

A Parallel Data Warehouse solution that can scale out on commodity servers to hundreds of terabytes

Store and analyze hundreds of billions of rows of dataAnalyze real-time racing conditions

Requirement:

Solution:

Results:

” Peter van Manen, Managing Director

Page 39: Microsoft Data Warehousing

CASE STUDY- DirectEdge

DirectEdge is the fourth largest US based exchange after NYSE, NADAQ, and BATs. It handles 10% of US trading.

A platform that could grow with the data, with up to 2 TB of new data per month

A Parallel Data Warehouse solution that can scale out on commodity servers to hundreds of terabytes

Test results met or exceeded projected needs for scalePower users can explore PDW directlyFinance analysts can compare customer trading activities themselves

Requirement:

Solution:

Results:

Page 40: Microsoft Data Warehousing

CASE STUDY- Volvo Aero

Volvo Aero, a subsidiary of AB Volvo, develops and manufactures high-technology components for aircraft, rocket, and gas turbine engines.

Need to store, access, and share data must on a secure, scalable, and reliable infrastructure.

SQL Server Data WarehousingSharePoint ServerBiztalk Server

Rely on identical data across all stages of product design, development, and production.Easily and quickly disseminate order and product changes and updates.Increase user satisfaction.

Requirement:

Solution:

Results:

” -Staffan Zackrisson, President and CEO, Volvo

Aero

Page 41: Microsoft Data Warehousing

CASE STUDY- Protective

The Protective Life Corporation offers insurance and investment products throughout the United States and Canada.

Reducing IT costs of existing DW platform

SQL Server Data WarehousingSharePointOffice

Migrate from Teradata system End users perform own analysis without ITIncreased processing speed by 15%Reduced IT administrative and maintenance costs of $600,000 over two years

Requirement:

Solution:

Results:

“By migrating data from Teradata to our existing Microsoft platform, we increased processing speeds by about 15 per cent and reduced IT administrative and maintenance costs by more than $600,000 over the first two years.”

- Mark Underwood, Second Vice President, Protective Life

Corporation

Page 42: Microsoft Data Warehousing

CASE STUDY- Universal Music Group

Universal Music Group is the world’s leading recording company. A subsidiary of Vivendi, UMG earned €4.4 billion (U.S.$6.1 billion) in revenue in 2010.

Existing DW too expensive to maintainNeeded flexible, affordable DW with mission critical performance and reliability

Fast Track Data Warehouse

Cuts cost by more than 97% and increase flexibilityRenders reports 92% fasterDelivers 100% uptime

Requirement:

Solution:

Results:

“Our IBM DB2 solution was very expensive in terms of hardware and software licensing costs. We just added 13 terabytes of capacity to our SQL Server Fast Track Data Warehouse at a minimal cost and we can also add memory for much less money than we could with our previous solution.”

- Rajesh Babu, Sr Director Global BI

“In the last 18 months, our SQL Server Fast Track Data Warehouse has delivered 100 percent uptime. We have not even had one serious memory alert.”

- Rajesh Babu, Sr Director Global BI

Page 43: Microsoft Data Warehousing

CASE STUDY- Stein Mart

Stein Mart is a growing department store chain that offers discounted fashion merchandise for men and women

A platform for up-to date data analysisExisting DW had performance and cost issues

Fast Track Data WarehouseSharePointOffice

Save $600,000 a year in technology costsImprove Analysis and ForecastingSpeed Reporting Process

Requirement:

Solution:

Results:

“With SQL Server Fast Track Data Warehouse, we can look at our entire transaction history and do market analysis and business forecasting, which we could not do previously. Now, for example, we will be able to study the correlation between promotions and sales.”

Ilan Wajsman, Data Systems Manager

“We will be able to eliminate 95 percent of the monthly costs related to the previous system,” says Wajsman.”

Ilan Wajsman, Data Systems Manager

Page 44: Microsoft Data Warehousing

© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market

conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation.

MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.