here there be turtles: platform ops in public cloud
DESCRIPTION
When I joined a startup already in progress as their first ops hire, I got a crash course in cloud operations. Running databases in EC2 without being on bare metal presents its own challenges; we also began using Hadoop and HBase on EMR, with tragicomic results. What monitoring existed was a twisty maze of half-measures, so improving our Mean Time To Lost Sleep required trying new tools and alerting strategies. And scaling performance meant relying on best practices and gut-feeling hunches. This talk will have appeal for those curious about AWS, about using MapReduce in the cloud, and about whether MongoDB is really “web scale”. (Spoiler alert: lolol.) Come for the EC2 trivia; stay for the table-flipping.TRANSCRIPT
![Page 1: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/1.jpg)
Here There Be TurtlesPlatform Ops in Public Cloud
Bridget Kromhout
@bridgetkromhout
![Page 2: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/2.jpg)
@bridgetkromhout
![Page 3: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/3.jpg)
We are the largest online video distributor of international televised content streaming the world's best movies, documentaries and TV shows on demand with professional subtitles.
@bridgetkromhout
![Page 4: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/4.jpg)
@bridgetkromhout
![Page 5: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/5.jpg)
Platform ops in public cloud?Do you mean Platform as a Service?
How is this different from Infrastructure as a Service?
@bridgetkromhout
![Page 6: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/6.jpg)
@bridgetkromhout
![Page 7: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/7.jpg)
(previous gig) SaaS Life
normal traffic
decision to turn off
decision to turnback on
accidental removal
@bridgetkromhout
![Page 8: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/8.jpg)
Platform?
@bridgetkromhout
![Page 9: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/9.jpg)
@bridgetkromhout
![Page 10: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/10.jpg)
@bridgetkromhout
![Page 11: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/11.jpg)
AWS Regions*(containing availability zones)
* for some values of regions: Beijing & Sydney too
@bridgetkromhout
![Page 12: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/12.jpg)
@bridgetkromhout
![Page 13: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/13.jpg)
StorageNo procurement delays!All the IOPS!No waiting!
Yes, cloud storage better than the bad old days in some ways, but with caveats.
@bridgetkromhout
![Page 14: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/14.jpg)
Alphabet Soup: EBS, SSDs, pIOPSGo with SSDs for your Elastic Block Store.
EBS-optimized instances = faster network
Provisioned IOPS: guaranteed, but prevent bursting
@bridgetkromhout
![Page 15: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/15.jpg)
@bridgetkromhout
![Page 16: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/16.jpg)
Story Time!
Data stores and sadness (as a service)
@bridgetkromhout
![Page 17: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/17.jpg)
wow. such nosql. very webscale.
@bridgetkromhout
![Page 18: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/18.jpg)
@bridgetkromhout
![Page 19: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/19.jpg)
“a single write operation holds the lock exclusively, and no other read or write operations may share the lock.”
@bridgetkromhout
![Page 20: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/20.jpg)
It’s 4am. Do you know what your EMR cluster is doing?
@bridgetkromhout
![Page 21: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/21.jpg)
StatsD
monitoring != alerting
@bridgetkromhout
![Page 22: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/22.jpg)
@bridgetkromhout
![Page 23: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/23.jpg)
If it moves, we track it. Sometimes we’ll draw a graph of something that isn’t moving yet, just in case it decides to make a run for it. -- Ian Malpass, Etsy
measure all the things
@bridgetkromhout
![Page 24: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/24.jpg)
So, back to this platform stuff...
...how exactly do you build and deploy it?
@bridgetkromhout
![Page 25: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/25.jpg)
@bridgetkromhout
![Page 26: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/26.jpg)
@bridgetkromhout
![Page 27: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/27.jpg)
orchestration & config management
Current: Future possibilities:
@bridgetkromhout
![Page 28: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/28.jpg)
kitten, not unicorn
@bridgetkromhout
![Page 29: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/29.jpg)
“The single strongest signal that you have something to learn...
...is that a difference exists.” -- Aneel Lakhani
@bridgetkromhout
![Page 30: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/30.jpg)
“The game has changed.”--Andrew
Clay Shafer
@bridgetkromhout
![Page 31: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/31.jpg)
@bridgetkromhout
![Page 32: Here There Be Turtles: Platform Ops in Public Cloud](https://reader033.vdocument.in/reader033/viewer/2022060111/556258d3d8b42a1b4b8b5459/html5/thumbnails/32.jpg)
@bridgetkromhout