gis into to cloud microsoft azure
TRANSCRIPT
Usama Wahab Khan MVP Office Server and Services Chief technology officer @ Evolution Technologies
Desktop Web Device
Server Online Content
and Services
portal
Apps
portal
GIS Servers
Port
al
•GIS service
•
services
…
Map LocatorGeodata Geoprocessing ImageNetworkFeature Schematics
1
Author Share/Use
3
A
Publish
2
• Share As Service
Author
Service definition file
GIS service
Analyze
2
A
• Cached Dynamic
Common ArcGIS for Server concepts
A
0. map tile creation when service is
published (preprocessing operation)
ArcGIS Server
2. pre-created image tile sent
cache
1. client request
Client App
ArcGIS Server
3. data sent
to client
2. data generated
dynamically
1. client request
Client App
A
1. GIS Service
2. Service Definition file
• All GIS resources are published with the same workflowAuthor Analyze
GIS service
Service definition file
A
2
•
••
•
•
Map
service
Locator
service
Geodata
service
Geoprocessing
service
(printing)
Image
service
Network
service
Feature
service
Schematics
service
• Basemaps
• Operational Layers
Conceptual terms
Basemaps
Operational
layers
+
A
Web Map
GIS Server
ArcMap
Web Application
Templates
10.3.x: Web App
Builder for ArcGIS
Explorer for
ArcGISCollector for
ArcGIS
Operations Dashboard for ArcGIS
Esri Maps for … Apps
ArcGIS Online
Portal for ArcGIS
Web Apps
Mobile
Apps
Business Apps
Web Map
ArcGIS Pro
Desktop Apps
ArcGIS Online
Portal for ArcGIS
GIS Server 1 GIS Server 2 GIS Server 3
Fu
ncti
on
ali
ty
Capacity
· Read only feature services
· Portal for ArcGIS
Multi-user geodatabase
, Portal for ArcGIS
· Enterprise geodatabase
The next strategic opportunity is here
How do you use technology innovation…
Mobile Big dataCloud Social
Customer
growth
Embrace
new models
Increased
productivity
Real-time
insights
to architect business innovation?
?
“Cloud is a given. CIOs no longer ask whether they should use cloud, but rather how.”*
“55% of CIOs indicated they
would source all their critical
apps in the cloud by 2020.”***
Reduce
costs and
inefficiencies
Increase revenue
with existing assets
Create
new business
models
*”Cloud Evolves From Point Solution To Strategic Enabler Of The New Connected Economy,” Forrester, Liz Herbert, January 2015
**Forrester, 2014
***Smith, David Mitchell et al. Predicts 2014: Cloud Computing Affects All Aspects of IT. Gartner, Inc. December 4, 2013.
****IDC, CIO webinar, 2014
Business is powered by the cloud
“Traditional on-premises data
storage is four times the cost
of cloud storage.”**
“Seventy percent of CIOs
will embrace a cloud-first
strategy by 2016.”****
Improve efficiency Enable innovation Transform your business
Cloud & IT Strategy
SaaS(Software as a Service)
Public Cloud Platforms
Physical
Virtual
?
The Azure Platform Strategy
Public, Global, Shared DatacentersMicrosoft Azure Stack & Cloud Platform System
Secu
rity
&
Man
ag
em
en
t
SaaS(Software as a Service)O365, CRM, VSO etc…
+3rd Party SaaS Solutions
Public Cloud
Platform
Hyb
ridO
pera
tion
sSecu
rity
&
Man
ag
em
en
t
Hyb
ridO
pera
tion
s
Microsoft leads in core technologies, IaaS, PaaS, Private and Public Clouds
"Microsoft’s comprehensive hybrid
story, which spans applications and
platforms as well as infrastructure, is
highly attractive to many companies,
drawing them towards the cloud in
general.”
LYDIA LEONG,
GARTNER
What aboutMicrosoft..?
Public Cloud IaaS (May 2015) Cloud Storage (June 2015) Enterprise App PaaS (Jan 2014) Operational DBMS Systems (Oct 2015)X86 Server Virt (July 2015)
*Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest
ratings. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties,
expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.
Hyper scale Infrastructure is the enabler28 Regions Worldwide, 22 ONLINE…huge capacity around the world…growing every year
100+ datacenters
Top 3 networks in the world
2x AWS, 7x Google DC Regions
G Series – Largest VM in World, 32 cores, 448GB Ram, SSD…
Operational
Announced/Not Operational
Central US
Iowa
West US
California
East US
Virginia
US Gov
Virginia
North Central US
Illinois
US Gov
Iowa
South Central US
Texas
Brazil South
Sao Paulo State
West Europe
Netherlands
China North *
Beijing
China South *
Shanghai
Japan East
Tokyo, Saitama
Japan West
Osaka
India South
Chennai
East Asia
Hong Kong
SE Asia
Singapore
Australia South East
Victoria
Australia East
New South Wales
* Operated by 21Vianet ** Data Stewardship by Deutsche Telekom
India Central
Pune
Canada East
Quebec City
Canada Central
Toronto
India West
Mumbai
Germany North East **
Magdeburg
Germany Central **
FrankfurtNorth Europe
Ireland
East US 2
Virginia
United Kingdom
RegionsUnited Kingdom
Regions
Azure Site Recovery: Protect VMWare and Physical Servers
in Public Preview
Azure Backup Generally Available
Azure API Management Premium simplifies high availability and
massive scale for APIs
ExpressRoute for Office 365
Azure Active Directory Dynamic Membership For Groups
Automatic Password Change for Social Media Shared Accounts
Compute-Intensive A10 and A11 Virtual Machine Instances
Remote Desktop app for Windows Phone support for Gateway
and Remote Resources
Informatica Cloud Agent availability in Linux and Windows Virtual
Machines
Azure DocumentDB Hadoop Connector
Azure HDInsight support for more VM sizes
Enterprise-Grade Array-Based Replication and Disaster Recovery
with ASR and System Center GA
Platform Services
Infrastructure Services
Web Apps
MobileApps
APIManagement
API Apps
Logic Apps
Notification Hubs
Content DeliveryNetwork (CDN)
Media Services
BizTalkServices
HybridConnections
Service Bus
StorageQueues
HybridOperations
Backup
StorSimple
Azure SiteRecovery
Import/Export
SQL Database
DocumentDB
RedisCache
AzureSearch
StorageTables
DataWarehouse
Azure AD Health Monitoring
AD PrivilegedIdentity Management
OperationalAnalytics
Cloud Services
BatchRemoteApp
ServiceFabric
Visual Studio
AppInsights
Azure SDK
VS Online
Domain Services
HDInsight MachineLearning
StreamAnalytics
Data Factory
EventHubs
MobileEngagement
Data Lake
IoT Hub
Data Catalog
Security & Management
Azure ActiveDirectory
Multi-FactorAuthentication
Automation
Portal
Key Vault
Store/Marketplace
VM Image Gallery& VM Depot
Azure ADB2C
Scheduler
Platform Services
Infrastructure Services
Web Apps
MobileApps
APIManagement
API Apps
Logic Apps
Notification Hubs
Content DeliveryNetwork (CDN)
Media Services
BizTalkServices
HybridConnections
Service Bus
StorageQueues
HybridOperations
Backup
StorSimple
Azure SiteRecovery
Import/Export
SQL Database
DocumentDB
RedisCache
AzureSearch
StorageTables
DataWarehouse
Azure AD Health Monitoring
AD PrivilegedIdentity Management
OperationalAnalytics
Cloud Services
BatchRemoteApp
ServiceFabric
Visual Studio
AppInsights
Azure SDK
VS Online
Domain Services
HDInsight MachineLearning
StreamAnalytics
Data Factory
EventHubs
MobileEngagement
Data Lake
IoT Hub
Data Catalog
Security & Management
Azure ActiveDirectory
Multi-FactorAuthentication
Automation
Portal
Key Vault
Store/Marketplace
VM Image Gallery& VM Depot
Azure ADB2C
Scheduler
Azure ComplianceThe largest compliance portfolio in the industry
HIPAA / HITECH
FedRAMP JAB P-ATO
FIPS 140-2 FERPA DISA Level 2 ITAR-readyCJIS21 CFRPart 11
IRS 1075 Section 508 VPAT
ISO 27001 PCI DSS Level 1SOC 1 Type 2 SOC 2 Type 2 ISO 27018Cloud Controls
Matrix
Content Delivery and
Security Association
Shared
Assessments
European Union
Model Clauses
United Kingdom
G-Cloud
Singapore
MTCS Level 3
Australian
Signals
Directorate
Japan
Financial Services
China Multi
Layer Protection
Scheme
China
CCCPPF
New
Zealand
GCIO
China
GB 18030
EU Safe
HarborENISA
IAF
1 TrillionMessages delivered every month with Event Hubs
100,000 New Azure customer subscriptions/month
20MillionSQL database hours
used every day
>5TrillionStorage transactions
every month
60BillionHits to Websites run on Azure Web App Service
425MillionAzure Active
Directory Users
Azure Momentum
57%Of Fortune 500 Companies
use Microsoft Azure
>50TrillionStorage objects
in Azure
1.4 MillionSQL Databases Deployed
In Azure
“Microsoft is
growing its cloud
revenue faster than
Amazon” – Business
Insider 2016
AWS revenue grew about
69% but Microsoft Azure
revenue grew by 127%
Applications
Clients
Infrastructure
Management
Databases &
Middleware
App Frameworks
& Tools
DevOps
PaaS &
DevOps
Non-Production Production
Your IT Portfolio ($$, Resources, Effort)
Getting started with Azure
50%App Operations
25%Existing
Custom apps
10%New business
apps
15%Packaged apps
1. Application Operations• You have A LOT of this… 50-70% or more ???
• It’s used 5-10% of the time
• Projects here are Low Risk, can have big ROI
4. Existing Production Apps you Built
• Leave 80% of existing custom apps alone
• MOVE SMALL and high burst workloads
3. Apps you would LIKE to build
• Use the Azure PaaS building blocks
• More Productive, Less Infrastructure Work
2. Apps you Bought
• What can you STOP doing… use the SaaS model
• Microsoft (O365/Exchange/SharePoint, CRM,
Visual Studio Online etc.)
Ford
AppOperations
50%App operations
25%Custom apps
15%Packaged
apps
10%New business
apps
STORAGE BLOBS / FILES (Virtual Disks)
AZURE VIRTUAL MACHINES
VIRTUAL
NETWORK
YOUR
DATA CENTER
App 1
App 2
Your Image
Library
NON-PRODUCTION VIRTUALIZEDAPP ENVIRONMENTS
WAYS TO CONNECT YOUR DATA CENTER TO AZURE
…
Windows
Linux
SQL
Gallery
Visual Studio Online
Express Route Partners
Business Continuity & Disaster Recovery
Hyper-V FailoverClustering for VM Resilience
}
Simplified protection with Windows Server Backup
Microsoft Azure Backup
Orchestrated VMReplication & Recoveryusing Azure Site Recovery(Including VMware & Physical)
Orchestrated Hyper-V VM Replication & Recovery intoMicrosoft Azure with Azure Site Recovery
StorSimple ApplianceiSCSI Disk shuffles/de-dups/encrypts stale data to Azure
Hyper-V Guest Clustering for app-level HA, i.e. SQL Server AlwaysOn FCI
SQLServer HA/AlwaysOnReplication to Azure and Database Backup
SQL SQLCentralized backup with Data Protection Manager
PackagedApps
50%App operations
25%Custom apps
15%Packaged
apps
10%New business
apps
Cloud
SaaSAzure
Office 365Publiccloud
Self-service Singlesign on
•••••••••••
Username
Simple connection
Other Directories
Windows ServerActive Directory
Your Data Center
Microsoft Azure Active Directory
New BusinessApplications
50%App operations
25%Custom apps
10%New business
apps
15%Packaged
apps
Move up the stack – to PaaS – as much a cultural shift as a technology shift
Azure handles resilience, servicing, management
Shift to Optimization from deployment/ops
Custom apps
50%App operations
25%Custom
apps
10%New business
apps
15%Packaged
apps
In General – LEAVE THESE ALONE (for now)
Exceptions:
1. High Burst/HPC – Expensive, Capacity Constrained Easily Virtualized Apps… HPC Pack, Azure Batch, HPC Hardware
2. Low Usage Apps – move and optimize cost
3. EOL Hardware – Reduce DC footprint -> Azure Virtual Machines
Cloud-enable appsRun the applications you use on workstations and clusters today
Run at scaleBatch takes care of starting a pool of compute VMs for you when you’re ready to run a job
Manage deliveryManage who can access it, how many resources they can use, and ensure requirements such as encryption are met
We want you to be at the center of application innovation
The Microsoft Platform Strategy
Public, Global, Shared DatacentersMicrosoft Azure Stack & Cloud Platform System
Secu
rity
&
Man
ag
em
en
t
Hyb
ridO
pera
tion
sSecu
rity
&
Man
ag
em
en
t
Hyb
ridO
pera
tion
s
Software As a Service• Office 365, CRM, AX,
VS Online, etc• Global SaaS Market
The Amazon Platform Strategy
Public, Global, Shared Datacenters
Secu
rity
&
Man
ag
em
en
t Op
era
tion
s
Security
Microsoft creates and
implements industry-leading
secure software development,
operational management, and
threat mitigation practices. This
includes Trustworthy computing
initiative, security center of
excellence, compliance
framework.
Microsoft is the only company
actively targeting cyber criminals
and working with law
enforcement to take down their
ability to infect devices and
systems with harmful, criminal
malware.
Azure Security center is truly a
differentiated offering
Compliance
Azure adhere to a broad set of
compliance requirements and
provide tools to help our
customers meet their cloud
security & compliance
requirements.
We commit to yearly audit and
provide full audit report
Azure offers Financial Services
Compliance Program built for
large financial institutes.
Privacy
Azure offers cloud specific
privacy policy.
Microsoft does not use
customer data for advertising
Microsoft makes contractual
commitment to safeguard
customer data and privacy.
Microsoft cannot change its
core privacy terms during the
course of a customer’s
subscription.
Azure complies with rigorous
EU privacy laws. Azure is the
first major cloud provider to
adopt ISO 27018 – world’s first
international standard for cloud
privacy.
Transparency
We publish details in the
Microsoft Law Enforcement
Requests Report about legal
demands for customer data.
Microsoft makes a contractual
commitment to ensure any
requests for data must follow
due legal process.
Customer owns their data, they
can delete and leave anytime.
Microsoft Customer Agreement
does not contain any IP
infringement protection
language
Leadership in
Transparency
Independently
verified
Relentless on
Security
Your Privacy
Matter
Service
Continuity
You know ‘where’ data
resides, ‘who’ can access it
and ‘what’ we do
with it
DC Transparency
Compliance with World
Class Industry standards
verified by 3rd parties
Excellence in cutting edge
security practices
Encryption at Rest across
various services
Network Security Groups,
Key Vault
Privacy policy specific to
Azure.
ISO 27018 privacy
standards
No Data is used for
Advertisement
Contractual commitments
Law enforcement request
Financially backed SLAs
across all GA Services
Azure
You know ‘where’ data
resides, ‘who’ can access it
and ‘what’ we do with it
Don’t disclose DCs
architecture details
Compliance with World
Class Industry standards
verified by 3rd parties
Excellence in cutting edge
security practices
Encryption at Rest & HSM
Firewalls/Network ACLs
Amazon.com Privacy policy
Data can be used for
Advertisement
Limited contractual
commitment
Ask customers to absorb
cost for Law enforcement
requests notificatoons
SLA is only available with
EC2, EBS ,S3,CloudFront &
RDS
AWS
HYBRID STORAGE StorSimple + Azure Storage
HYBRID DATABASE SQL Server 2016 StretchDB + Azure SQL DB
HYBRID CONSISTENCY Azure Stack + Cloud Platform System
HYBRID APP INTEGRATION Azure ServiceBus + BizTalk Services
HYBRID IDENTITY Azure Active Directory
HYBRID CLOUD MANAGEMENT Operations Management Suite + System Center
HYBRID BACKUP + DR Azure Backup + Azure Site Recovery
HYBRID CONNECTIVITY VPN + ExpressRoute
What is Microsoft Azure Government?
Fabric
Cloud services
Storage
NoSQL
Database
Blob storage
SQL
Database
Compute
Networking
Dedicated
connections
Virtual
network
Traffic Manager
Virtual machines
Comprehensive cloud services
Infrastructure
CONUS physical infrastructureservers/network/datacenters/operations
U.S. Gov. Virginia and U.S. Gov. Iowa
NOC in Redmond and Washington DC
Automated
Managed resources
Elastic
Usage based1 2 3
Services
Tasks
Caching
Identitybob
Service Bus
Notification
Hubs
Media
Recovery
Frameworks
Microsoft Confidential - INTERNAL
ONLY
49
U.S. Public Sector requirements and needs
Needs Requirements
Increase own agility Specific security controls
Minimize datacenter investments Specific compliance requirements
Maximize existing investments by
adopting hybrid cloud approach
Specific government oversight
requirements
Microsoft Confidential - INTERNAL
ONLY
50
Introducing Microsoft Azure GovernmentA government-community cloud that extends world-class security and control for dedicated U.S.
Public Sector workloads.
Delivers integrated, familiar experiences with Office 365 for Government in the cloud.
Stores data within the United States.
Offers roadmap for meeting rigorous compliance demands (i.e. FedRAMP, CJIS, and HIPAA) of a
government-only cloud.
Provides rich infrastructure, storage, and identity management capabilities delivered through
cloud, on-premises, and hybrid solutions.
Provides a physical and network-isolated instance of Microsoft Azure.
Provides screened U.S. citizens and policies to help protect customer data and applications.
Microsoft Confidential - INTERNAL
ONLY
51
Perimeter
• 24x7 security staff
• Facility setback requirements
• Barriers
• Fencing
Buildings
• Alarms
• Security operations center
• Seismic bracing
• East/Central locations: U.S. Gov.
Iowa & U.S. Gov. Virginia
Computer room
• Two-factor access control:
Biometric & card readers
• Camera
• Days of backup power
Azure Government: powerful datacenter security
Customer data, applications, and hardware reside in the continental United States (CONUS) in
specially constructed datacenters. The datacenters are physically isolated from Azure commercial
services and geographically distributed more than 500 miles apart to support business
continuity scenarios.
Microsoft Confidential - INTERNAL
ONLY
52
Delivers a Cloud Infrastructure Appliance for self-service IaaS and PaaS workloadsCloud OS on-prem: Azure Pack, Windows Server & System Center
Microsoft-validated hardware and software
Optimized for hosting Microsoft applications
OEM HARDWARE INFRASTRUCTURE
SOFS / SMB 3.0 & STORAGE SPACES
HYPER-VHOSTS
HYPER-VNETWORKING
WEBSITES
SERVICEBUS
SQLSERVER
VIRTUALMACHINES
SERVICE MANAGEMENT API
PROVIDERPORTAL
TENANTPORTAL
• Pre-Deployed Infrastructure
• Switches, Load Balancer, Storage, Compute, Network Edge
• N + 2 fault tolerance (N +1 for networking)
• Pre-configured as per best practices
• Integrated Management
• Configure, deploy, patching
• Monitoring
• Backup and DR
• IaaS provider
• Automation
• Tenant Portal
• 8000 VM’s, 0.7 PB of usable workload storage
• First party validation for workloads
Networking 4 x Force 10 – S4810P
1 x Force 10 – S55
Compute Scale Unit (32 x Hyper-V hosts) Dell PowerEdge C6220ii – 4 Nodes per 2U
Dual socket Intel IvyBridge (E5-2650v2 @ 2.6GHz)
128 GB memory
2 x 10 GbE Mellanox NIC’s (LBFO Team, NVGRE offload)
2 x 10 GbE Chelsio (iWARP/RDMA)
1 local SSD 200 GB(boot/paging)
Storage Scale Unit (4 x File servers, 4 x JBODS) Dell PowerEdge R620v2 Servers (4 Server for Scale Out File Server
Dual socket Intel IvyBridge (E5-2650v2 @ 2.6GHz)
2 x LSI 9207-8E SAS Controllers (shared storage)
2 x 10 GbE Chelsio (iWARP/RDMA)
PowerVault MD3060e JBODs (48 HDD, 12 SSD)
4 TB HDDs and 800 GB SSDs
High-density, industry-standard hardware Rack 1 Per Rack Max per Stamp
Compute Nodes 24 32 128
Sockets 48 64 256
Cores 384 512 2048
Memory 3TB 4TB 16TB
File Servers 4 4 16
HDD 192 192 768
HDD Raw Storage Capacity 768TB 768TB 3072TB
SSD (for Tiering) 48 48 192
SSD Raw Storage Capacity 38.4TB 38.4TB 153.6TB
Storage Used for Backup 126TB 126TB 504TB
Storage Available for Workloads 136TB 156TB 605TB
Getting EvidenceThe best place for evidence:
https://microsoft.sharepoint.com/teams/cloudosevidence/Pages/evidence-generator.aspx