moving to the cloud - o'reillyvelocity.oreilly.com.cn/2015/ppts/movingtothecloud.pdf ·...
TRANSCRIPT
![Page 1: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/1.jpg)
Moving to the CloudGeorge Schlossnagle, Message Systems
![Page 2: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/2.jpg)
About Message Systems§ World’s largest provider of email messaging infrastructure§ Traditionally delivered as on-premise software, moved into the cloud
recently- ~ 30B message per day on-premise, ~250M messages per day in the cloud
§ Platform fully accessible through multiple developer-focused APIsSome of our Customers
![Page 3: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/3.jpg)
Moving to the cloud is easy, right?
![Page 4: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/4.jpg)
itWhat it takes to run email in the cloud• People- Operations- SRE- Deliverability and Compliance
• Process- Deployments- SLAs
• Technology- Rock-solid software- Automation- Monitoring
![Page 5: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/5.jpg)
Running any cloud service
![Page 6: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/6.jpg)
What our customer sees• The front door of a cloud service- APIs- And documentation
- Reporting UI- Customer support- TAM
![Page 7: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/7.jpg)
What our customer shouldn’t see§ Variable performance§ Downtime§ Unexpected responses§ Anything other than what’s expected or
documented
![Page 8: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/8.jpg)
Behind the curtain
• Our software is a complex system• Running a production service takes a bunch of other scaffolding- Network- Servers- Management and Automation- Deployments- Monitoring- Compliance/Deliverability
![Page 9: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/9.jpg)
Our Infrastructure Stack§ AWS- EC2- Route53
§ Configuration Management- Ansible
§ Automation- Puppet, Terraform
§ Monitoring- Circonus, OpsGenie
§ Reporting- SumoLogic
![Page 10: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/10.jpg)
The Problems We Expected
![Page 11: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/11.jpg)
Expected Challenge: Overcoming risk aversion.
![Page 12: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/12.jpg)
![Page 13: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/13.jpg)
SparkPost.com
SparkPost Elite
Momentum
weekly
monthly
quarterly
![Page 14: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/14.jpg)
Outcome: Faster deployments, less bugs.
![Page 15: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/15.jpg)
Expected Challenge: You can’t run email in AWS
![Page 16: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/16.jpg)
![Page 17: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/17.jpg)
Combating Poor Reputation§ People- Compliance and Deliverability Teams
§ Standards- Most stringent best practices in the industry
§ Process- Aggressive enforcement of standards- Proactive support from deliverability
§ Technology- Heavy automation
![Page 18: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/18.jpg)
Data provided by eDatasource
![Page 19: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/19.jpg)
OutcomeBest Deliverability in Market
![Page 20: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/20.jpg)
The Problems We Didn’t Expect
![Page 21: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/21.jpg)
Unexpected Challenge: Our Networking Challenges Were Unexpectedly Unique
![Page 22: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/22.jpg)
Networking in the Cloud• Cloud networking is different from traditional datacenter networking• Cloud services are generally used by traditional ‘pull’ web services• Email turns that model on its head- The need to source large volumes of connections from arbitrary
addresses is something AWS specifically doesn’t do well- Furthermore, our model requires SNAT
• Some very challenging configuration scenarios
![Page 23: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/23.jpg)
Solution:Write our own SOCKS-ish Proxy
![Page 24: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/24.jpg)
Unexpected Challenge: AWS billing is … very challenging
![Page 25: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/25.jpg)
“like a teenager with his first credit card”
![Page 26: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/26.jpg)
Outcome:Way more time invested in building our own internal
consumption monitoring tools than planned.
![Page 27: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/27.jpg)
Unexpected Challenge: The state of automation tools isn’t where we expected
![Page 28: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/28.jpg)
Automation Challenges
The higher level automation tools (puppet, ansible, etc) still have little awareness of cloud computing, so you need a parallel stack for spinning up/spinning down
instances. Those tools are very powerful but demand quite a bit of investment to make a fully functioning
environment that suits your needs.
![Page 29: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/29.jpg)
Outcome:Still lots of room for improvement here
![Page 30: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/30.jpg)
In Summary§ This has been a really interesting journey for us so far§ We have learned a lot about our own business and our products§ The journey to the cloud has actually improved our traditional on-premise
product tremendously, both in terms of quality but also usability§ The journey is ongoing
![Page 31: Moving to the Cloud - O'Reillyvelocity.oreilly.com.cn/2015/ppts/MovingToTheCloud.pdf · Networking in the Cloud • Cloud networking is different from traditional datacenter networking](https://reader035.vdocument.in/reader035/viewer/2022063012/5fc79ad1ceed2231ae0de121/html5/thumbnails/31.jpg)
In Summary
Thanks!
Questions?