sqlday 2017sqlday.pl/materials2017/hubert kobierzewski/20170516...sqlday 2017 build your data...

SQLDay 2017

SQLDay 2017

Build Your Data Warehouse in the Cloud

Hubert K. Kobierzewski

Codec Systems

hubert.kobierzewski@plssug.org.pl

• BI Consultant in Codec-dss (nearly 10 years)

• Specialized in: Data Warehousing, ETL processes and Business Intelligence

• Ex-Developer

• MS SQL Server certified (MCDBA, MCTS, MCITP, MCSE –BI, ex-MCT)

• Member of Azure Advisors (internal MS group)

• Leader of Warsaw PLSSUG Chapter

• Azure Data Factory

• Toolset for ADF

• ADF Demo

• Azure AS Demo

• PBI Demo

• Summary

Cortana Intelligence combines the services you already know

Transform data into intelligent action

Intelligence

Dashboards &

Visualizations

Information

Management

Big Data Stores Machine Learning

and Analytics

CortanaEvent HubsHDInsight

(Hadoop and

Spark)

Stream

Analytics

Data Intelligence Action

People

Automated Systems

Apps

Web

Mobile

Bots

Bot

FrameworkSQL Data

WarehouseData Catalog

Data Lake

Analytics

Data Factory Machine

LearningData Lake Store

Cognitive

Services

Power BI

Data

Sources

Apps

Sensors

and

devices

Data

Information Management

Data

Sources

Apps

Sensors

and devices

Data

Information

Management

Event Hubs

Data Catalog

Data Factory

Compose and orchestrate data services at scale

INGEST

SQL

<>

SQL

DATA SOURCES

{ }

SQL

• Create, schedule, orchestrate, and manage data pipelines

• Visualize data lineage

• Connect to on-premises and cloud data sources

• Monitor data pipeline health

• Automate cloud resource management

• Move relational data for Hadoop processing

• Transform with Hive, Pig, or custom code

Information

Management

Event Hubs

Data Catalog

Data Factory

Creates, orchestrates & automates

the movement, transformation

through the cloud

and/or analysis data

Example of Cortana Intelligence Suite in action

Data Sources Ingest Prepare Analyze Publish Consume

Sensors

and devices

Stream

Analytics Machine

LearningCortana

Business

apps

SQL Data

Warehouse

Diagnostic

Streaming

Power BI

Enterprise

data sources

Azure Blob storage

Data Factory: Move data, orchestrate, schedule and monitor

Data Catalog: Register, annotate, understand, discover data sets

HDInsight

Event

Hubs

HDInsight

Machine

Learning

Stream

Analytics

hubert.kobierzewski@plssug.org.pl

SQLDay 2017