google cloud - scale with a smile (dec 2014)
TRANSCRIPT
![Page 1: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/1.jpg)
PerformanceScale (with a smile)Value
Google Cloud Platform
#CodeMotion TLV 2014
![Page 2: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/2.jpg)
+Ido Green
@greenido
ido-green.appspot.com
#CodeMotion TLV 2014
![Page 3: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/3.jpg)
For the past 15 years, Google has been building out the world’s fastest, most powerful, highest quality cloud infrastructure on the planet.
Images by Connie Zhou
![Page 4: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/4.jpg)
Cloud Platform is built on the same infrastructure that powers Google.
Images by Connie Zhou
![Page 5: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/5.jpg)
Images by Connie Zhou
Google’s Platform“[Google's] ability to build, organize, and operate a huge network of servers and fiber-optic cables with an efficiency and speed that rocks physics on its heels.
This is what makes Google Google: its physical network, its thousands of fiber miles, and those many thousands of servers that, in aggregate, add up to the mother of all clouds.”
- Wired
![Page 6: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/6.jpg)
Google's Network Spans the Globe
![Page 7: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/7.jpg)
The Pace of Software Innovation
Spanner/F1DremelMapReduce
Big Table Colossus
2012 20132002 2004 2006 2008 2010
GFS Omega
Cloud Storage
BigQuery
Cloud Datastore
![Page 8: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/8.jpg)
#CodeMotion TLV 2014
Yes, We Can Power that
Mobile Gaming Storage
Big Data Highly Scalable Apps Digital Marketing
![Page 9: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/9.jpg)
#CodeMotion TLV 2014
BigQuery
Compute Storage
Cloud Storage
App Services
Compute Engine
App Engine
Queues
Caching
Cloud Endpoints
Persistent Disk
Cloud Datastore
Cloud SQL
Google Cloud Platform
![Page 10: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/10.jpg)
CodeMotion TLV 2014
BigQuery
Compute Storage
Cloud Storage
App Services
Compute Engine
App Engine
Queues
Caching
Cloud Endpoints
Persistent Disk
Cloud Datastore
Cloud SQL
Google Cloud Platform
![Page 11: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/11.jpg)
#CodeMotion TLV 2014
Exploring the Cloud
IaaSInfrastructure-as-a-Service
PaaSPlatform-as-a-Service
SaaSSoftware-as-a-Service
Google Cloud Platform
![Page 12: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/12.jpg)
build and deploy vm images
● Curated runtimes● Rich services● Auto-everything● … just add code
● Managed collections● Declarative + Dynamic
Compute as a Continuum
PlatformClusterVM
More Agility
More flexibility
build and deploy clusters build and deploy apps
● Basic atom● Run anything
![Page 13: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/13.jpg)
Virtual Machines On GCEBuild and Deploy VMs
![Page 14: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/14.jpg)
● Beta! Local SSD
● Ubuntu VM Image
● Regions
○ Asia
○ Additional zones in US, Europe
● Transparent maintenance
● 16-core VMs
● Lower prices (again)
Recent Updates Google Compute Engine
![Page 15: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/15.jpg)
New! Bitnami Images
google.bitnami.com
Deploy your favorite open source server software
More than 90 apps or infrastructure stacks
![Page 16: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/16.jpg)
Cloud Platform
MapRBreaks MinuteSort Record
• 1.5TB in 60 seconds
• 8,412 cores
• Google Compute Engine
● MapR broke the MinuteSort world record using
Compute Engine for only $1200.
● The previous record was set using custom
hardware costing hundreds of thousands of
dollars.
![Page 17: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/17.jpg)
● GCE In Action
● Demo Code: github.com/GoogleCloudPlatform/compute-appengine-demo-suite-python
● NodeJS & Docker○ github.
com/GoogleCloudPlatform/runtime-nodejs-docker-image
● developers.google.com/compute/docs/samples-and-videos
Google Compute Engine Demo
![Page 18: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/18.jpg)
Google App Engine
Python, Java, PHP, Go
![Page 19: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/19.jpg)
Simple to Scale- AutoScale
Trivial to manage- Fully managed- No patches- 24x7 operation by Google SREs
Easy to develop- Free to start- Local dev environment- Service abstractions
App Engine
![Page 20: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/20.jpg)
Cloud Platform
App Engine
• Fully Managed Platform
• Popular Programming Language Support
• Flexible and Scalable Application Storage
• Auto-scaling
• Versioning and Traffic Splitting
• Local Developer Tools
• Third-party Frameworks and Extensions:
webapp2, Django, Flask, Tornado, Sprint etc’
![Page 21: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/21.jpg)
Cloud Platform
- Chris Chew, Udacity
"I'd rather be democratizing education than scaling memcached."
![Page 22: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/22.jpg)
App Engine Managed VMsBuild and Deploy VMs
![Page 23: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/23.jpg)
Managed VMsApp Engine
![Page 24: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/24.jpg)
● App Engine productivity - on VMs
○ More flexible, powerful
● Bring your own
○ Dependencies○ Runtime (Docker container)
● What’s new?
○ Load Balancing○ Autoscaling○ Cloud SDK Integration
Beta! App Engine Managed VMs
module: sudoku
runtime: python27
api_version: 1
vm: true
vm_settings:
machine_type: n1-standard-1
apt_get_install: python-opencv
automatic_scaling:
min_num_instances: 2
max_num_instances: 20
...
app.yaml
![Page 25: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/25.jpg)
Custom Runtimes and Autoscaling
● Define your own Runtime environments on Managed VMs
● You provide:○ A Dockerfile that defines a
Base Docker Image○ An app.yaml config file
● Optionally○ Respond to LifeCycle events
and Health Checks
module: webrtc
runtime: custom
api_version: 1
vm: true
...
app.yaml
FROM mycompany/custom-nodejs-runtime
Dockerfile
![Page 26: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/26.jpg)
docker build
using google/docker-registry
container
GoogleCompute Engine
VM
your laptop
docker run
gcloud app deploystartupdate
using google/docker-registry
container
privateGoogle Cloud
Storagebucket
Google App Engine
Your Docker image
Your Docker image
docker pushdocker pull
Managed VMs Runtime Environment
container
$ gcloud app deploy
![Page 27: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/27.jpg)
Cloud Platform
Storage
Cloud Storage
Cloud SQL
Cloud Datastore
App Services
BigQuery
Cloud Endpoints
Caching
Queues
Compute
Compute Engine
App Engine
Storing what you want, however you want
![Page 28: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/28.jpg)
• Versioning
• Static Sites
• Resumable Transfers
• Object Change Notifications
Cloud Datastore
![Page 29: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/29.jpg)
Cloud Datastore• Auto-scale
• Schemaless Access
• SQL-like Capabilities
• Authentication That Just Works
• Fast and Easy Provisioning
• RESTful Endpoints
• ACID Transactions
• Local Development Tools
• Built-in Redundancy
![Page 30: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/30.jpg)
Cloud SQL
• Fully managed
• Ease of Use
• Highly Reliable
• Flexible Charging
• Security, Availability, Durability
• EU and US Data Centers
• Easy Migration & Data Portability
• Control
![Page 31: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/31.jpg)
Cloud Platform
Storage
Cloud Storage
Cloud SQL
Cloud Datastore
App Services
BigQuery
Cloud Endpoints
Caching
Queues
Compute
Compute Engine
App Engine
Building robust, intelligent systems
![Page 32: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/32.jpg)
BigQuery
• Fully Managed Big Data Analytics Service
• Fast
• Scalable
• Flexible and Familiar
• Security and Reliability
The basics and BigQuery with Apps Script
![Page 33: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/33.jpg)
Cloud Platform
DEMO: Insights On Github
![Page 34: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/34.jpg)
Who’s making amazing things withGoogle Cloud Platform?
![Page 35: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/35.jpg)
Cloud Platform
Snapchat
Delivering 350+ million snaps a day
![Page 36: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/36.jpg)
Cloud Platform
Serving 18TB a day with 80 million
users from Google Cloud Storage,
Cloud Datastore, and App Engine
SongPop
![Page 37: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/37.jpg)
Cloud Platform
Eurovison
● Handled 50,000 requests/second
with 90% served in <24ms
● With Scalr and Compute Engine
![Page 38: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/38.jpg)
Powering the futurewith unprecedented features
![Page 39: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/39.jpg)
● cloud.google.com
● googlecloudplatform.blogspot.com
● plus.google.com/+GoogleCloudPlatform
● twitter.com/GoogleCloud
Get questions answered on StackOverflow !
![Page 40: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/40.jpg)
cloud.google.com
Images by Connie Zhou
![Page 41: Google Cloud - Scale With A Smile (Dec 2014)](https://reader033.vdocument.in/reader033/viewer/2022060206/55a2550b1a28abef378b460e/html5/thumbnails/41.jpg)
Thank you!
● ido-green.appspot.com
● +GreenIdo
● @greenido
#CodeMotion TLV 2014