azure track -06- cloud integration patterns for it-pros - itproceed
DESCRIPTION
by Sam Vanhoutte In the new scenarios where cloud is getting used, integration becomes very important. Luckily, the Windows Azure platform provides a lot of different capabilities and services to make a secure link between your local systems and the Windows Azure services or machines. In this session, an overview will be give of the different technologies and the scenarios to which these technologies are best applicable. The following technologies will be demonstrated and discussed: •Messaging: Service Bus Messaging, BizTalk Services •Services: Service Bus Relay •Mobile: Service Bus Notification Hubs, SignalR •Data: SQL Data Sync •Networking: Windows Azure Virtual Networking •Security: Active Directory integrationTRANSCRIPT
![Page 1: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/1.jpg)
Azure Integration PatternsSam Vanhoutte - Codit
![Page 2: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/2.jpg)
Nice to meet youSam VANHOUTTECTO Codit
6 year - BizTalk V-TSP1st year - Integration MVP
[email protected]+32 474 849 993@SamVanhoutte
be.linkedin.com/in/
samvanhoutte/
> 60 Active integration customers
International Focus - HQ in BEFocused on integration solutions
2000 Belgium2004 France2013 Portugal
60 employees > 50 consultants BizTalk certifiede-news + SoMe
2012 & 2013
Partner of the Year
Award FinalistApplication Integration
![Page 3: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/3.jpg)
And take home the Lumia 1320
Present your feedback form when you exit the last session & go for the drink
Give Me Feedback
![Page 4: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/4.jpg)
Bring the cloud to your enterprise: Integration
serversmainframe databasesapps
Your Data Center
Integration
PartnersSaaSApps
![Page 5: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/5.jpg)
Same problemsdifferent solutions, new challenges
Network latency
Identity Management
Different SLAs
Data SecurityMonitoring
Management
Mobile AccessInterop
Changing schemasServices not Servers
ConnectivityREST-first
![Page 6: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/6.jpg)
Architectural challenges
Operational challenges
Security LatencyStandards & Interop
Hybrid connectivity …
“DevOps”Enterprise procedures SLA’s Monitoring …
Same problemsdifferent solutions, new challenges
![Page 7: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/7.jpg)
Cloud Integration Patterns
Network Integration
Data Integration
Application Integration
Connect and synchronize data between on-prem and cloud
Connect on protocol – network level
Synchronous or asynchronous message communication on application level
![Page 8: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/8.jpg)
NETWORK INTEGRATION
![Page 9: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/9.jpg)
Network integration: Technology overview
• Virtual Networking– Point to Site– Site to Site
• ExpressRoute
• Hybrid connections– (app. integration)
![Page 10: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/10.jpg)
Virtual networking options
Cloud Customer Segment and workloads
Secure point-to-site connectivity
Virtual Network (Point-to-Site)
• Developers• POC Efforts• Small scale deployments• Connect from anywhere
Secure site-to-site VPN connectivityVirtual Network (Site-to-Site)
• SMB, Enterprises• Connect to Azure Compute• IaaS and PaaS workloads
Private site-to-site connectivity
ExpressRoute
• SMB & Enterprises• Mission critical workloads• Backup/DR, Media, HPC• Connect to all hardware
![Page 11: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/11.jpg)
ExpressRoute connectivityMicrosoft AzurePublic services
Microsoft Azure Compute
Azure Edge
Connectivity Provider
Infrastructure
Customer’s network
Customer’s dedicated connection
Traffic to public IP addresses in Azure
Traffic to Virtual Networks in Azure
![Page 12: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/12.jpg)
ExpressRoute connectivity
High throughput
Security
Lower cost
Predictable performanceExpressRoute provides organizations a private, dedicated, high-throughput network connection between Windows Azure datacenters and their on-premises IT environment.
![Page 13: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/13.jpg)
DATA INTEGRATION
![Page 14: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/14.jpg)
Data integration: Technology overview
• Azure Storage– Azure File Service– Table & Blob
storage
• Azure SQL Database– Data Sync– SQL Connectivity
![Page 15: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/15.jpg)
Connect to Azure SQL Database• Through SQL Azure TDS• Local firewall settings
– Outbound connections– TCP port 1433
• SQL database firewall– Provide allowed IP ranges to connect to server– Use sp_set_database_firewall_rule on
database level
![Page 16: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/16.jpg)
SQL Azure Data Sync• Warning! Still in preview… For years
• Powers movement of data– Cloud cloud– On-premises cloud
• Getting data where you need it– Sync SQL Azure instances– Sync SQL Server to SQL Azure– Sync offline apps to SQL Azure– Enable geo-replication of data
Sync
SQL Azur
e
![Page 17: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/17.jpg)
APPLICATION INTEGRATION
![Page 18: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/18.jpg)
Application integration:Technology overview
• Service Bus– Relay Service– Messaging – Notification Hubs
• BizTalk Services– Hybrid Connections– Adapter service– EDI Trading
partners
![Page 19: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/19.jpg)
Service Bus Brokered MessagingPort 9354 outboundPort 5672 for AMQPPort 443 for HTTPS
• Asynchronous / queued processing • Distributed processing• Load leveling / Temporal decoupling• Interoperability through AMQP / REST• Routing of messages
Topic SubSubSub
![Page 20: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/20.jpg)
Service Bus Relay - how it works• Outbound firewall only• Bi-directional
communication patterns• Load-balancing in the
cloud• HTTP or TCP
connectivity• Different security
options
solution. a b
NLB
outbound socket rendezvous
HTTP/SocketForwarder
outbound socket
connect
Ctrl
Ctrl
TCP/SSL or HTTP
BackendNamingRouting
Fabric
FrontendNodes
![Page 21: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/21.jpg)
Firewall friendly? Yes, but…• Only outbound firewall rules needed
– TCP: Ports 9350-9353– HTTP: Ports 80 & 443
• IP range of cloud services change constantly– Don’t block outbound IP addresses– http://bit.ly/15lXMB0
![Page 22: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/22.jpg)
Port configuration #fyi• Outbound TCP (Ports 9350-9353)
– 9350 Unsecured TCP One-way (client)– 9351 Secured TCP One-way (all listeners, secured clients)– 9352 Secured TCP Rendezvous (all listeners except one-way)– 9353 Direct Connect Probing Protocol (TCP listeners with direct
connect)
• Outbound HTTP (Port 80, Listeners)– TCP equivalent tunnel with overlaid TLS/SSL formed over pair of
HTTP requests– Alternate connectivity path if outbound TCP is blocked
• Outbound HTTPS (Port 443, Senders)
![Page 23: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/23.jpg)
Service Bus Relay
Demo – connect to on prem SQL
![Page 24: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/24.jpg)
Hybrid Connections
Web Sites
Mobile Services
Corporate Network
Microsoft SQL Server
Hybrid ConnectionOther published resourcesHybrid Connection
Manager
![Page 25: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/25.jpg)
Hybrid connectionsAccess to on-premises resourcesConnect to SQL Server, Web Services or most other that use TCP or HTTP connectivity
No need to alter the network perimeterDoesn’t require a VPN gateway or Firewall changes to allow incoming trafficApplications have access only to the resource that they requireOutbound connection needed on port 5671
IT maintains control over resourcesSupport for Group Policy and Event/Audit Logging providing Admins control and visibility
Event and Audit loggingIT has insight into resources being accessedIT can use existing infrastructure investments for monitoring and control
Dashboard on Azure portalAccess to connection health, statusWill provide insights on usage and metrics
![Page 26: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/26.jpg)
Hybrid Connections
Demo – migrate web site
![Page 27: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/27.jpg)
BizTalk Services
Database ERPBizTalk Adapter Service
Server Explorer(Visual Studio)
PowerShell CmdLets
Management Service REST API
Lob Relay (Service Host)Lob TargetLob Target
Bridge
Pipeline
V E T E
Messages
Sources
FTP/S
HTTP
SFTP
Destinations
Service Bus
Web Service
FTP/S
HTTP
Blob
![Page 28: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/28.jpg)
BizTalk Services
Demo – connect to SAP or SQL on prem
![Page 29: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/29.jpg)
Hybrid connectivity options
Cloud On-prem Segment and workloads
Quick shift & lift connectivityHybrid Connections
• Migration projects• Mobile & Web sites• TCP/HTTP• Quick & easy set up
Web Service (SOAP/REST) communication
Service Bus Relay
• Custom dev – green field• Web service communication• Loose coupling of components• Load-balancing in the cloud
EAI & B2B connectivityRich messaging
BizTalk Services
• Enterprise customers• Legacy file support (flat file, edi)• Transformation & validation in cloud• Message tracking & archiving
![Page 30: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/30.jpg)
Scenarios
When to use what ?
![Page 31: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/31.jpg)
Local, shielded network
Virtual Networking
VPN device
Site to Site VPN
SOAP
Site to Site VPN, connecting local services and file shares
FTP
IPSec tunnel
Codit Integration Cloud
![Page 32: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/32.jpg)
Local, shielded network
Virtual Networking
VPN device
Site to Site VPN
SOAP
Site to Site VPN, connecting local services and file shares
FTP
IPSec tunnel
Advantages• Connections managed from the cloud• On-premises footprint extremely small• No DMZ deployment needed• Extensible connection service
Reasoning• Minimize network / application impact• Fully outsource solution
Codit Integration Cloud
![Page 33: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/33.jpg)
Belgium
SQL Data Sync
Worker Rolereference data lookup
SQL Data Sync
Feed Azure Database with local SQL reference data for lookups
On prem SQL
SQL Azure Database
![Page 34: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/34.jpg)
" changing the way integration is done "
Belgium
SQL Data Sync
BizTalk Services (bridge enrichment : look up)
SQL Data Sync
Feed Azure Database with local SQL reference data for lookups
On prem SQL
SQL Azure Database
Advantages• Quick to set up• Low latency for data access (same data center)• No changes need to local application
Reasoning• Warning – in preview for years !• Good for caching data in the cloud
![Page 35: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/35.jpg)
Netherlands
Service Bus Relay
BizTalk Adapter Service
Service Bus Relay
REST FILE
Cloud Integration environment, using Service Bus Relay to on-prem
SQL
Cyprus
Cloud Connector
Codit Integration Cloud
![Page 36: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/36.jpg)
Service Bus RelayCloud Integration environment, using Service Bus Relay to on-prem
Advantages• Connections managed from the cloud• On-premises footprint extremely small• No DMZ deployment needed• Extensible connection service
Reasoning• Minimize network / application impact• Fully outsource solution
![Page 37: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/37.jpg)
BizTalk Services
Azure BizTalk Services
On prem ESB
Service Bus Relay
SAP WMS Oracle
FTP, AS2…
Customer moving all B2B to the cloud, relaying to on prem BizTalk
![Page 38: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/38.jpg)
BizTalk Services
Windows Azure BizTalk Services
BizTalk ESB
Service Bus Relay
SAP WMS Oracle
FTP, AS2…
Advantages• Faster set-up of partner connections• One-time firewall set-up• Support for existing mappings & schemas in WABS• No specific DMZ deployment needed
Reasoning• Latency less important for B2B than EAI
Customer moving all B2B to the cloud, relaying to on prem BizTalk
![Page 39: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/39.jpg)
THANK YOU
AND NOW, QUESTIONS?OR DRINKS?
![Page 40: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/40.jpg)
Follow Technet Belgium@technetbelux
Subscribe to the TechNet newsletteraka.ms/benews
Be the first to know
![Page 41: azure track -06- cloud integration patterns for it-pros - itproceed](https://reader036.vdocument.in/reader036/viewer/2022062418/556425c1d8b42a69298b51a4/html5/thumbnails/41.jpg)
Belgiums’ biggest IT PRO Conference