cloud computing: sql data services
DESCRIPTION
Cloud Computing: SQL Data Services. Urs Meier Principal Consultant. Christophe Codourey Consultant BI. Business Intelligence. Managed Services. Business Communication. Application Development. Training. Integration – Application Performance Mgmt. – Security. Corporate data . - PowerPoint PPT PresentationTRANSCRIPT
Cloud Computing: SQL Data Services
Christophe Codourey Consultant BI
Urs MeierPrincipal Consultant
Technology competence Oracle, Microsoft, IBM, Open Source
BusinessIntelligence
Business
Communication
Appl
icatio
n
Develo
pmen
tManagedServices
Existing IT customer
infrastructure
Training
Trivadis Facts & FiguresCurrently 13 locations with over 540 employees
Baden, Basel, Bern, Brugg, Lausanne, Zurich Düsseldorf, Frankfurt, Freiburg, Hamburg, Munich, Stuttgart Vienna
Since January 2008, the Trivadis Group has a qualified majority of shares in MIK AG, based in Brugg
Financially independent and sustainably profitable
Key figures in 2008Consolidated incomeCHF 108 million / EUR 68 millionServices for more than 650 clients in over 1‘600 projectsOver 150 Service Level AgreementsMore than 5'000 training participants per year Research budget: CHF 6.0 million / EUR 3.6 million
Agenda
Azure OverviewSQL Data Services (SDS)SQL Server ↔ SDS CompatibilitySDS Client Applications
Visual Studio & .NET
Microsoft Cloud Services
Azure™ Services Platform
ComputeStorage
Management
• Designed to be: “File System in the cloud” • lowest cost efficient solution for simple
data storage and retrieval in the cloud • can store
• Queues• Blobs• ISAM style, simple Tables
(non-relational)
Microsoft Cloud Services
Azure™ Services Platform
ComputeStorage
Management
Database Data Sync Reference Data
ETL Data Mining Reporting
SDS for the past year
Storage
SQL, Tablesand Rows
T/SQL via TDS
Authority, Container,
Entity
SOAP/REST
Simple Tables, Blobs,
Queues
SOAP/RESTMassive
ArchitecuralChange Key-Value DB
• Existing KnowHow and Applications
• New Web 2.0 and Silverlight Applications• Other Vendors like Amazon
The New SQL Data Services
Familiar SQL Server relational modelUses existing APIs & toolsBuilt for the Cloud with availability and scaleAccessible to all from PHP, Ruby, and Java
Clear Feedback: “I want a database in the Cloud”
Your Apps
Tabular Data Stream(TDS)
SQL Data ServicesTDS Endpoint
ADO.NET
Entity Framework
SQL Server Drivers
Authority, Container,
Entity
SOAP/REST
From CTP 1 to now
Storage
SQL, Tablesand Rows
SQL, Tablesand Rows
Simple Tables, Blobs,
Queues
SOAP/REST
• Existing KnowHow and Applications
• New Web 2.0 and Silverlight Applications• Other Vendors like Amazon
SOAP/REST
Data Services
T/SQL via TDS T/SQL via TDS
Database Choices
Low-cost and zero friction addresses web/dept workloads
Target is 3 to 10 GB DatabasesHigh compatibility with existing SQL Server offering
Reso
urce
s
Dedicated
Shared
Low High“Friction”/Control
SDS (RDBMS)
Value Props:Auto HA, Fault-ToleranceFriction-free scaleSelf-provisioningHigh compatibility
Virtual DB server Logical user database
(LDB) Resource governance @
LDB Security @ LDB
Value Props:XSPs, Server OpsSQL CLR100% compatibility
Roll-your-own HA/DR/scale
Hosted Hosted SQL Server or
other Resource governance @
VM Security @ DB Server/OS
On-premise SQL Server or other s/w on-
premise Resource governance @ machine Security @ DB Server/OS
Value Props:Full h/w control –
size/scale100% compatibilityRoll-your-own
HA/DR/scale
Database
Server
Service Provisioning ModelEach account has
a billing relationship with Microsoftowns one or more virtual servers
Each server has one or more databases including virtual mastereach database limited in size one or more logins
Each database has one or more SQL users
Account
Server
Database Server=server1.data.database.windows.netDatabase=testDBLogin=JeanDupont[@server1] (maps to
testuser)
SQL Server vs. SQL Data Services • Master
• AdventureWorks• Northwind• Pubs
• Master
• Pubs• Northwind
• Adventureworks
SQL Server(on premises)
• Master• AdventureWorks• Northwind• Pubs
SQL Data Services
Instances and DatabasesOne SQL Server instance per physical machineMultiple databases per instance
Randomly distributed by infrastructureRessource sharing
Scalable HA technologyAutomatic replication and failover
Provisioning, metering and billing infrastructure
Machine 5SQL Instance
SQL DBsDB5 DB1 DB3 DB2
Provisioning (databases, accounts, roles…), Metering, and Billing
Machine 6SQL Instance
SQL DBsDB1 DB6 DB2 DB3
Machine 4SQL Instance
SQL DBsDB3 DB4
Machine 7SQL Instance
SQL DBDB4 DB5
Scalability and Availability: Fabric, Failover, Replication, and Load Balancing
Reading DataSelect * from Customer
Primary(for Customer)
New Primary(for Customer)
Writing DataUpdate CustomerSet Priority = 1
Primary(for Customer)
TDS GatewayFront-end Node
Protocol Parser
Gateway Logic
TDSSession
1
Front-end NodeProtocol Parser
Gateway LogicTDS
Session 2
Architecture
Master ClusterMaster Node
Data Node Components
Partition Manager
Master Node
Data Node Components
Partition Manager
1
2
4
5
6
7
8
Utility LayerAccount
DatabaseBilling/Usage
Database
Service PlatformMonitori
ngLoad
BalancingNode
Provisioning
Roles
3
Machine 5SQL Instance
SQL DBDB5 DB1 DB3 DB2
Scalability and Availability: Fabric, Failover, Replication, and Load balancing
Machine 6SQL Instance
SQL DBDB1 DB6 DB2 DB3
Machine 4SQL Instance
SQL DBDB3 DB4
Machine 7SQL Instance
SQL DBDB4 DB5
Scalability and Availability: Fabric, Failover, Replication, and Load balancing
Authority, Container,
Entity
SOAP/REST
SDS from now on
Storage
SQL, Tablesand Rows
SQL, Tablesand Rows
Simple Tables, Blobs,
Queues
SOAP/REST
• Existing KnowHow and Applications
• New Web 2.0 and Silverlight Applications• Other Vendors like Amazon
T/SQL via TDS T/SQL via TDSidentical?
Example of SQL CompatibilityIn Scope for v1 (likely)
Tables, indexes and viewsStored ProceduresTriggersConstraintsTable variables, session temp tables (#t)…
Out of Scope for v1 (likely)
Distributed Trans/QueryCLRService BrokerSpatialPhysical server or catalog DDL and viewsGlobal tables(##t)?Traditional Backup / Restore
Management ToolsAPI for provisioning
WebSQL Server Management Studio (SSMS)
Basically available, but will have obviously some restrictions
e.g. no sp_configure Standard Query Tools
Security ModelUses regular SQL security model
Authenticate logins, map to users and rolesAuthorize users and roles to SQL objects
Limited to standard SQL Auth loginsUsername + password
EncryptionTDS supports SSLNo database encryption at all in V1
TDE Encryption Functions
How Scalable is SDS?Scalability comes at cost of consistency
ACID (Atomicity, Consistency, Isolation, Durability)Write n nodes on Commit, read from max. n nodes
BASE (Basically available, soft state, eventually consistent)
Write n nodes on Commit synchronize more nodes laterRead on more than n nodes
SDS V1 Implements (a very) ACID model
Write 3 nodesRead 1 node
ScalabilityScale Performance
Leader electionSDS fabric can switch the primary node for a database to a less busy node
SDS may throttle your session if it takes too much resourcesBYOP (bring your own partitioning)
Scale Size of DatabaseCurrent offering is targeted at departmental databasesBYOP (bring your own partitioning)
SDS Client ApplicationsClients connect directly to a database
Cannot hop across DBsAny database client library for SQL Server can be also used for SDS
ODBC, OLE DB, ADO.NET Provider for SQL Server
ADO.NET Entity FrameworkADO.NET Data Services (Astoria)
LINQ to SQL PHP native SQL Client…
Cloud
SDS Client Apps
SDS DatabaseTDS + TSQL Model
Windows Azure ComputeREST
(Astoria)ADO.Net* +
EF
Browser
HTT
P
Application
SQL Client*TD
S
* Client access enabled using TDS for ODBC, ADO.Net, OLEDB, PHP-SQL, Ruby, …
Data
Cen
ter Web Srv
SQL Client*
HTT
P+RE
ST
Application
REST Client*
Web AppSQL Client*
HTT
P+SO
AP
Application
SOAP Client*
Tabular Data Stream (TDS)“Code far” scenario
TDS is not designed for high latency networks
Recommendation Batch SQL statements Use Functions/Stored Procedures
Table valuein parametersare very handy
Microsoft Cloud Services
Azure™ Services Platform
ComputeStorage
Management
Database Data Sync Reference Data
ETL Data Mining Reporting
Extending SQL Data Platform to Cloud
SQL Data Services (SDS)Database-as-a-Service
Data SyncReference Data
Reporting
Business Intelligenc
e
Symmetric Programming Model Data Hub Aggregation
Initial services – core RDBMS capabilities as a service (SDS), Data Sync and Data HubFuture Offerings
Additional data platform capabilities as a service: BI/DSS, DWNew services: Reference Data, Secure Data Hub
Data Hub / Sync Services
On Premises Assets and Data
Mobile Users
SQL Services (Opportunities and Futures)
ScalabilityPartitioned databasesGeo-location and geo-redundancy
FlexibilityDistributed querySupport for multiple levels of hardware and software isolation
SecurityFuture AD FederationWLID, etc as alternate authentication protocolsEncryption
Release Plan
Invitation CTP – On-board invitation-only customers + some current
Public CTP – On-board all early adoptersCommercial Availability with Windows Azure in 2009
MIX ‘09
TechEd
InvitationCTP
Public CTP
Commercial Availability
Migration
Mar 09
May 09 Jul 09 Nov 09
Sep 09
Apr 09
Jun 09 Aug 09
Oct 09
PDC
InternalAdoption
Quick Wins with SDSHigh Availability
Including Data Hub ScenarioFast and easy Deployment
Ideally “Code near” scenario with Web apps
Well known programming modelLow learning curve
ReliabilityConfidence that data will not be lostReplication, back-up
Defined SLA, at which Cost (?)
Want to Know More?Team Blog
http://blogs.msdn.com/ssds
MSDN Development Centerhttp://msdn.microsoft.com/en-us/sqlserver/dataservices
Register @ the Azure start portalhttp://www.azure.com
Visitez notre stand et
participez au concours
Prix
Save the date for tech·days next year!14 – 15 avril 2010, CICG
Classic Sponsoring Partners
Premium Sponsoring Partners