azure unleashed
DESCRIPTION
Go beyond the basics and learn about real life experiences, practical production use cases and best practices. Agenda includes: • Implementing Azure as a recovery site —why companies are doing it and how • Machine learning and service bus will change the way you look at the future of IT • Identity for multi-factor authentication, external users, and on-premise password reset • Storage experiences, backup and recovery and blob storage for virtual machines • Building custom applications within the Azure cloud, lessons learned • Automating datacenter processes with Azure Automation and SMA. Learn about companies that are building "automation as a service" • Using HDInsight for Hadoop based big dataTRANSCRIPT
ALL RIGHTS RESERVED © 2014
Microsoft Azure UnleashedMore than just Virtual Machines in the cloud
ALL RIGHTS RESERVED © 2014
Concurrency Introduction
#cncyEvent #ws2012R2 #SysCtr #SCSM #Orchestrator
ALL RIGHTS RESERVED © 2014
Business Productivity Infrastructure
Azure & O365
Exchange & Lync +
Voice
Private & Public Cloud
Windows Server & Virtual
Identity, AD,
DirectAccess
System Center
2012 ITSM / ITIL
Migrations &
Integrations
Desktop Imaging &
Win upgrade
Portals, Intranets, Business Critical, Doc Imaging,
Workflow…(SharePoint)
Sales, Marketing, Dashboards, Account
Management, Etc. (Dynamics CRM)
Business Apps
Application Development
Messaging, Conference, Presence,
Video, Voice (Lync)
Office
Real Microsoft expertise. Real business value.
ALL RIGHTS RESERVED © 2014
Technical Awards and RecognitionsMicrosoft Partner of the Year• 2014 Management & Virtualization Finalist• 2012 Midwest• 2012 Central Regional• 2012 Content Management Global• 2011 Midwest• 2001 Marketing
Microsoft Gold Certification• Collaboration & Content• Communications• Management & Virtualization• Dynamics CRM
ALL RIGHTS RESERVED © 2014
Business Awards and Recognition
Aug 21 Named to Inc. Magazine’s List of America’s Fastest-Growing Private Companies—the Inc. 5000
Aug 19 Receives 2014 Redmond Channel Partner RCP/Rocket Award
Aug 18 #1 Winner in Milwaukee Business Journal’s “Fastest Growing Firms” Awards for 2014
ALL RIGHTS RESERVED © 2014
@ConcurrencyIncblog.concurrency.com
Speakers
Nate Lasnoski Annur Sumar
Shannon Fritz Steve Buchanan
ALL RIGHTS RESERVED © 2014
Microsoft Azure UnleashedMore than just Virtual Machines in the cloud
ALL RIGHTS RESERVED © 2014
• Extending your Corporate Network with Azure IaaS• Disaster Recovery with Azure SRM• Workflows with Azure Automation and PowerShell• Device Applications with Azure Mobile Services• Identity and Access Management with Azure AD-P• Azure HDInsight and Understanding Big Data • The Power of Predictive Machine Learning• Off-site Backup without Tapes!
Today’s highlights
ALL RIGHTS RESERVED © 2014
Cloud ComputingOn-Prem
Storage
Server HW
Networking
O/S
Database
Virtualization
Application
Data / Users
Runtime
You
man
ag
ePaaS
Storage
Server HW
Networking
O/S
Database
Virtualization
Data / Users
Runtime
Application
SaaSM
an
ag
ed
by v
en
dorStorage
Server HW
Networking
O/S
Database
Virtualization
Data / Users
Runtime
Application
IaaS
Storage
Server HW
Networking
Database
Virtualization
Application
Data / Users
Runtime
O/S
ALL RIGHTS RESERVED © 2014
Azure Networking
ALL RIGHTS RESERVED © 2014
Azure VM without a Network• Only connected to the Internet
azure
internet
ALL RIGHTS RESERVED © 2014
Azure VMs in a Network• Connected to each other, but not the
Internet
azure
internet
virtual network
ALL RIGHTS RESERVED © 2014
Azure VM Network with a Gateway• Connected to each other and the Internet
azure
internet
virtual network
gateway
ALL RIGHTS RESERVED © 2014
• Each network is independent and isolated
Multiple Azure Networks
azure
internet
ALL RIGHTS RESERVED © 2014
• Site-to-Site VPN from CorpNet to AzureNet
Connecting Networks with VPN
corpnet
ALL RIGHTS RESERVED © 2014
• From CorpNet to Multiple AzureNets
Connecting Networks with VPN
corpnet
ALL RIGHTS RESERVED © 2014
• Site-to-Site between AzureNets too!
Connecting Networks with VPN
corpnet
ALL RIGHTS RESERVED © 2014
• Multi-site-to-site VPN via PowerShell
Connecting Networks with VPN
corpnet
branch
ALL RIGHTS RESERVED © 2014
• Multi-Site-to-Site ExpressRoute
Connecting Networks with MPLS
corpnet
branch
mpls
ALL RIGHTS RESERVED © 2014
Azure Site Recovery
ALL RIGHTS RESERVED © 2014
• Azure as your recovery site• Uses Hyper-V replica to replicate VMs into
the Azure site, where they can be turned on
Pricing• $27/month per VM protected
Recover Virtual Machines into Azure
ALL RIGHTS RESERVED © 2014
Azure Automation
ALL RIGHTS RESERVED © 2014
• PowerShell-centric Automation Engine• Entirely hosted in Azure (similar to SMA)• Uses PowerShell workflow
Pricing• Free up to 500 minutes• $20 / month for 10,000 minuteshttp://azure.microsoft.com/en-us/pricing/details/automation/
Azure Automation
ALL RIGHTS RESERVED © 2014
Azure Mobile Services
ALL RIGHTS RESERVED © 2014
• Build apps for iOS, Android and Windows• Provide backend services without
infrastructure• Authentication, SSO and Push notification
services
Pricing• 1.5Million API Calls, $25/mo*• 15 Million API Calls, $199/mo*http://azure.microsoft.com/en-us/pricing/details/mobile-services/
Azure Mobile Services
* Plus SQL Database services
$5 for up to 2GB, $15 for up to 250GB
ALL RIGHTS RESERVED © 2014
Identity and Access Management
ALL RIGHTS RESERVED © 2014
• User Identity Store in the Cloud• Single Sign-On for SaaS Applications• Integrate with Windows Active Directory
• Standards-Based Authentication(SAML, OAuth 2.0, WS-Fed, OpenID Connect, etc)
Pricing• Three Tiers: Free, Basic and Premium. Paid editions are for EA
subscribershttp://www.microsoft.com/en-us/server-cloud/products/enterprise-mobility-suite/
Azure Active Directory
ALL RIGHTS RESERVED © 2014
User
Windows AD
Windows Active Directory
ALL RIGHTS RESERVED © 2014
SaaS
User
Azure AD
Azure Active Directory
ALL RIGHTS RESERVED © 2014
SaaS
User
Azure AD
Azure Active Directory
ALL RIGHTS RESERVED © 2014
SaaS
User
Azure AD
Windows AD DirSync
Azure Active Directory
ALL RIGHTS RESERVED © 2014
SaaS
User
Azure AD
Windows AD DirSync
ADFS
Azure Active Directory
ALL RIGHTS RESERVED © 2014
• Azure AD Premium and Multi-Factor Authentication
• Password Reset and Single Sign-On for SaaS apps
• Manage mobile devices with Intune• Protect Content with Rights Management Services
Pricing• Current reduced cost is $4.00 per user http://www.microsoft.com/en-us/server-cloud/products/enterprise-mobility-suite/
Enterprise Mobility Suite
ALL RIGHTS RESERVED © 2014
Azure RemoteApp
ALL RIGHTS RESERVED © 2014
Azure Websites
ALL RIGHTS RESERVED © 2014
• Any hosted website or custom development• Auto-scaled to allow for capacity• Connected to other services, such as caching
Azure Websites
Languages such as .Net, PHP, Node.js, and Python.
Integrate with other Azure services, such as SQL Database, Service Bus and Storage
Application development & deployment methodologies such as Visual Studio, Git, WebMatrix, WebDeploy, TFS, and FTP
Azure Websites gallery contains many third-party applications, such as Drupal and WordPress as well as development frameworks such as Django and CakePHP
ALL RIGHTS RESERVED © 2014
Azure SQL Databases
ALL RIGHTS RESERVED © 2014
• Hosted SQL database• Data protection via auditing, restore & geo-replication• Can be a replica for SQL on-premise• Charged as a database directly, vs. server + l.
Azure SQL Databases
ALL RIGHTS RESERVED © 2014
HDInsight
ALL RIGHTS RESERVED © 2014
What is Big Data?
“Big data is a collection of data sets so large and complex that it becomes awkward to
work with using on-hand database management tools. Difficulties include
capture, storage, search, sharing, analysis, and visualization.”
– Wikipedia
ALL RIGHTS RESERVED © 2014
What’s driving it?
Cheap Storage
$100 gets you 3million times
more storage in 30 years)
Inexpensive Computing
1980 10 MIPS/$ 2005 10M MIPS/$
Device Explosion
>5.5 billion (70+% of global population)
Social Networks
>2 Billionusers
Ubiquitous Connection
Web traffic2010 130 Exabyte (10 E18)
2015 1.6 ZettaByte (10 E21)
Sensor Networks
>10 Billion
ALL RIGHTS RESERVED © 2014
What is it comprised of?
Big data solutions deal with complexities of:
VOLUME (Size)
VARIETY (Structure)
VELOCITY (Speed)
ALL RIGHTS RESERVED © 2014
Big Data In Our World
Internet of things Audio /
VideoLog Files
Text/Image
Social Sentiment
Data Market FeedseGov Feeds
Weather
Wikis / Blogs
Click Stream
Sensors / RFID / Devices
Spatial & GPS Coordinates
WEB 2.0Mobile
Advertising
Collaboration
eCommerce
Digital Marketing
Search Marketing
Web Logs
Recommendations
ERP / CRM
Sales Pipeline
PayablesPayroll
Inventory
Contacts
Deal Tracking
Terabytes(10E12)
Gigabytes(10E9)
Exabytes(10E18)
Petabytes(10E15)
Velocity - Variety
Volu
me
1980190,000$
20100.07$
19909,000$
200015$Storage/GB
ERP / CRM WEB 2.0
Internet of things
ALL RIGHTS RESERVED © 2014
Introducing HadoopTRADITIONAL RDBMS HADOOP
Data Size
Access
Updates
Structure
Integrity
Scaling
DBA Ratio
Reference: Tom White’s Hadoop: The Definitive Guide
ALL RIGHTS RESERVED © 2014
Common Scenarios
Clickstream Analysis Sensor/Machine
Time and Place Server Logs
Sentiment
Text
ALL RIGHTS RESERVED © 2014
Ability to respond to new questions
Advanced Analytics
Live Data Feed
Social Analytics
How do I optimize my services based on patterns of weather, traffic, etc.?
What’s the social sentiment of my product?
How do I better predict future outcomes?
ALL RIGHTS RESERVED © 2014
How it WorksFIRST, STORE THE DATA
Server
Files
Server Server
Server
ALL RIGHTS RESERVED © 2014
How it WorksSECOND, TAKE THE PROCESSING TO THE DATA
// Map Reduce function in JavaScript
var map = function (key, value, context) {var words = value.split(/[^a-zA-Z]/);for (var i = 0; i < words.length; i++) {
if (words[i] !== "")context.write(words[i].toLowerCase(),1);}}};
var reduce = function (key, values, context) {var sum = 0;while (values.hasNext()) {sum += parseInt(values.next());
}context.write(key, sum);};
ServerServer
ServerServer
RUNTIME
Code
ALL RIGHTS RESERVED © 2014
Demo: Build Out of HDInsight Hadoop Environment
ALL RIGHTS RESERVED © 2014
Summary
Data Knowledge Action
ALL RIGHTS RESERVED © 2014
SummaryContinued
It is likely that you have big data – you’re definitely capturing outcome data, and likely capturing ambient dataAll data – outcome or ambient – has valueToday’s challenge is about unleashing insights from any dataMicrosoft Azure HDInsight can address these challenges by storing and processing big dataPower BI includes authoring add-ins to query, analyze and visualize data sourced from Windows Azure HDInsightSQL Server can connect to, query, and consume big data results – big data is just another data source!
ALL RIGHTS RESERVED © 2014
Azure Machine Learning
ALL RIGHTS RESERVED © 2014
What is Machine Learning (ML)?
Azure Machine Learning is a suite of offerings designed to give you the ability to
easily create, test, operationalize and manage predictive analytics solutions all
from the cloud.Azure Machine Learning = Predictive Analytics
ALL RIGHTS RESERVED © 2014
Machine Learning Key FeaturesMachine learning traditionally requires complex software, high-end computers, and seasoned data scientists who understand it all.
Possible for people without deep data science backgrounds to start mining data for predictions.
Drag-and-drop gestures and simple data flow graphs to set up experiments.
Also designed for seasoned data scientists. It supports R, the popular open-source programming environment for statistics and data mining.
Connected to HDInsight for to use Big Data with Azure Machine Learning.
ALL RIGHTS RESERVED © 2014
Examples of Machine Learning
Search engines Online recommendations
Ad targeting Virtual assistants
Demand forecasting Fraud detection
Spam filters Credit risk
Modern servicesPowered By ML
ALL RIGHTS RESERVED © 2014
Covering the Analytics SpectrumDescriptive Diagnostic PrescriptivePredictive
IT Professionals
Data Modeling, ETL, Data Warehousing, Data Marts and Cubes
Information Worker
Self-Service & Exploration with Power BI
Data Scientists
Advanced Analytics from Microsoft and 3rd parties
BI Enablement Advanced Analytics
Enterprise Data Management
What happened? Why did it happen? What will happen? What should I do?
ALL RIGHTS RESERVED © 2014
How can you build a predictive model?
Define Business Problem
Prepare Data
Develop Model
Through Iterations
Deploy Model
Monitor Model’s
Performance Business
Insights
1
2
34
5
ALL RIGHTS RESERVED © 2014
Customer Targeting With Machine LearningProblem: • To leverage the history of a person’s
behavior on Microsoft.com to identify their interests and predict future actions
• Predict which customers are likely to buy Surface or Windows Phone
Methodology:
• Big Data Platform – HDP for Windows/Azure HDInsight and Advanced Analytics support
• Develop statistical models to determine the probability of users buying a Surface Device
ALL RIGHTS RESERVED © 2014
• Targeting Models Delivered• Windows Phone• Provided list of cookies that are more likely to land on a Windows Phone page• Monthly scoring during 3 months
• Surface• Provided list of cookies that are more likely to buy a surface• Monthly scoring since April 20, 2013
New Targeting Models Developed for Surface and Windows Phone
Cat: Surface Store
KW: Surface
KW: Surface Pro
KW: Microsoft Store
MAC OS
Cat: Home Page
KW: Microsoft
Bing
Windows
Total Days
0% 5% 10% 15% 20% 25% 30% 35%
Variable Importance
ALL RIGHTS RESERVED © 2014
Results – Better Targeting increased Revenue
Better customer targeting• Targeting coverage improved by 5%
due to predictive models and other measures!
Increased revenue from display AdsTargeted Ads generated up to 19% of revenueRevenue per 1000 impressions grew by over 8XRevenue per click grew by 6X!
ALL RIGHTS RESERVED © 2014
Demo of Azure ML Workspace and Experiment Build Out
ALL RIGHTS RESERVED © 2014
Azure Backup
ALL RIGHTS RESERVED © 2014
• Backup from DPM 2012 R2 to Azure• Long term storage reported• $0.24 per GB/month. 10 TB = $2,400
Azure Backup and How It Works
ALL RIGHTS RESERVED © 2014
Azure Backup Scenarios
1. You can back up files from a standalone server.
2. You can back up members of Microsoft System Center Data Protection Manager (DPM) protection groups. DPM 2012 SP1 and DPM 2012 R2 are supported.
Windows Azure Backup lets you back up files in one of two scenarios:
NEW! Maximum retention of backup data for up to 9 years!
ALL RIGHTS RESERVED © 2014
Azure Backup Demo
ALL RIGHTS RESERVED © 2014
• Extending your CorpNet with Azure IaaS• Disaster Recovery with Azure SRM• Workflows with Azure Automation and PowerShell• Device Applications with Azure Mobile Services• Windows App Publishing with Azure RemoteApp• Identity and Access Management with Azure AD-P• Azure HDInsight and Understanding Big Data • The Power of Predictive Machine Learning• Off-site Backup without Tapes!
Quick recap of our discussions today
ALL RIGHTS RESERVED © 2014
Next Steps
Microsoft Experience CenterA hands-on, interactive lab helping you and your team drive the latest Microsoft products.
Modern Datacenter RoadmapTake a strategic, technology agnostic approach to your infrastructure operations. Get a vision, a budget, and a plan to optimize your IT infrastructure through a structured and systematic process.
Azure Platform AssessmentGet expert guidance and a clear understanding of what the future of your business could look like running on Azure.
ALL RIGHTS RESERVED © 2014
Upcoming events
• Lync & O365 | October
• Business Intelligence | November
• Dynamics CRM | December
Visit www.concurrency.com/events for details
• Lync & O365 | October
• Business Intelligence |
November
• Dynamics CRM | December