awssummit berlin day1 froehner bridging-message-brokers...summit © 2019, amazon web services, inc....
TRANSCRIPT
![Page 1: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/1.jpg)
S U MM I TBe r l i n
![Page 2: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/2.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.SUMM IT
Bridging Message Brokers to Cloud-Native Messaging Services
Dirk FröhnerSr. Solutions ArchitectAmazon Web Services
S e s s i o n I D
Christian MüllerSr. Solutions ArchitectAmazon Web Services
![Page 3: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/3.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.SUMM ITSUMM IT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
“If your application is cloud-native, or large-scale, or distributed, and doesn’t include a messaging component, that’s probably a bug.”
Tim BraySenior Principal Engineer, AWS
Messaging, Eventing & Orchestration
![Page 4: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/4.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.SUMM ITSUMM IT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Synchronous systems are very tightly coupled
A problem in a synchronous downstream dependency has immediate impact on the upstream callers
Retries from upstream callers can all-too-easily fan-out and amplify problems.
![Page 5: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/5.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.SUMM IT
Agenda
Integration patterns
Integration scenarios
Whiteboarding
Photo by Camylla Battani on Unsplash
![Page 6: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/6.jpg)
SUMM IT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
![Page 7: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/7.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Message exchangeOne-way Request-response
Sender Amazon MQqueue
Receiver Requester Responder
No response expected
Synchronous vs. fire-and-forget
Response expected
Return address
Correlation ID
Amazon MQqueue
Amazon MQqueue
![Page 8: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/8.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Message channelsPoint-to-point (queue) Publish-subscribe (topic)
Consumed by one receiver
Easy to scale
Flatten peak loads
Consumed by all subscribers
Durable subscriber
Sender Amazon MQqueue
Receivers
PublisherAmazon MQ
topic
Subscribers
![Page 9: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/9.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Message channelsVirtual topics
Amazon MQtopic
Amazon MQqueue
Sender
Receivers
Scale receivers per receiving application
![Page 10: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/10.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Message channelsDead letter queue (DLQ)
Transient failure mitigation
Poison pill handling
Amazon MQDLQ
XSender Amazon MQ
queueReceiver
![Page 11: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/11.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Additional patterns & conceptsFIFO
Sender ReceiverAmazon MQqueue
Guaranteed ordering
Message groups
Amazon MQqueue
Receivers
Sender
Message belongs to a group
Processed by one receiver at a time
![Page 12: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/12.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Additional patterns & conceptsMessage delivery QoS
Sender ReceiverAmazon MQqueue
At least once
At most once
Exactly once
![Page 13: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/13.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.SUMM IT
Exactly once? Really? Well…
“Tunable/configurable” messaging systems – choose between at least once or at most once
Offers deduplication capabilities to detect and eliminate messages which are sent more than once
to the messaging system
But how to deal with a situation, where the message was consumed but never acknowledged?
Your system has to handle duplicate messages!
![Page 14: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/14.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Additional patterns & concepts
Time
visibility timeout
receive message
receive message
receive message
receive message
Time
receive message
receive message
delete / acknowledge message
Inflight messages
![Page 15: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/15.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.SUMM IT
Additional patterns & conceptsProxy
Initiator PartnerProxy Initiator Partner
Proxy
Proxy
![Page 16: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/16.jpg)
SUMM IT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
![Page 17: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/17.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.SUMM IT
Why does it matter?
• Recommended for born-in-the-cloud apps
• Simple APIs• Unlimited throughput• Pay per-request
• Recommended for application migration
• Standard APIs• Feature-rich• Low latency• Pay per-hour and per-GB
![Page 18: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/18.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.SUMM IT
Wait, there are more choices!
• Customer engagement platform
• Targeted email, SMS, push notifications, and voice messages.
• Pub/sub broker in AWS IoT Core
• Send messages to/fromdevices and AWS IoT appsin a secure fashion
• MQTT, HTTP, WebSockets
![Page 19: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/19.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.SUMM IT
… and even more!
• NRT data stream• Core entity: stream,
not events• Messages not automatically
deleted, consumer keepscursor on stream
• Not really a messagingservices, but caching solution (non persistent)
• Offers queue semantics
![Page 20: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/20.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Cloud-native to traditional / one-way
Cloud-nativeapplication
Traditionalapplication
Amazon MQqueue
ProxyAmazon SQSqueue
Cloud-nativeapplication
Traditionalapplications
Amazon MQtopic
ProxyAmazon SNStopic
Point-to-point Publish-subscribe
![Page 21: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/21.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Cloud-native to traditional / request-response
Cloud-nativeapplication
Traditionalapplication
ProxyAmazon
MQqueue
Amazon SQS
queue
Cloud-nativeapplication
Proxy
Amazon MQTopic
Amazon MQqueue
Amazon SNSTopic
Amazon SQSqueue
Traditionalapplications
Point-to-point Publish-subscribe
![Page 22: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/22.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Traditional to cloud-native / one-way
Point-to-point Publish-subscribe
Traditionalapplication
Cloud-nativeapplication
Amazon SQSqueueProxy
Amazon MQqueue Traditional
applicationCloud-nativeapplications
Amazon SNStopicProxy
Amazon MQtopic
![Page 23: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/23.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Traditional to cloud-native / request-response
Point-to-point Publish-subscribe
Traditionalapplication
Cloud-nativeapplication
Amazon SQSqueue
ProxyAmazon MQqueue
Amazon MQTopic
Amazon MQqueue
Traditionalapplication
Amazon SNSTopic
Amazon SQSqueue
Proxy
Cloud-nativeapplications
![Page 24: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/24.jpg)
SUMM IT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
![Page 25: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/25.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.SUMM IT
Thank you!
SUMM IT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Dirk Frö[email protected]
Christian Mü[email protected]
![Page 26: AWSSummit Berlin Day1 froehner bridging-message-brokers...SUMMIT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bridging Message Brokers to Cloud-Native](https://reader034.vdocument.in/reader034/viewer/2022042221/5ec7e9262473686afb62ce6e/html5/thumbnails/26.jpg)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.SUMM ITSUMM IT © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.