a fresh look at google’s cloud by mandy waite

41
Mandy Waite A Fresh Look at Google's Cloud [email protected] (@tekgrrl)

Upload: codemotion

Post on 27-Jan-2015

106 views

Category:

Technology


1 download

DESCRIPTION

Google, one of the early PaaS (Platform as a Service) pionneers, has recently substantially improved AppEngine, expanded its Cloud Platform to include CloudStorage, BigQuery and soon Google Compute Engine (still in early access as of this writing).

TRANSCRIPT

Page 1: A fresh look at Google’s Cloud by Mandy Waite

Mandy Waite

A Fresh Look at Google's Cloud

[email protected] (@tekgrrl)

Page 2: A fresh look at Google’s Cloud by Mandy Waite

Building Apps and Services in the Cloud

Page 3: A fresh look at Google’s Cloud by Mandy Waite

Google App Engine Google BigQuery

Scalable application development and

execution environment

NoSQL DatastoreAuto-scaling FrontendsLong-lived Backends

Task Queues

Google Compute Engine

Virtual machines

Run arbitrary workloads at scale(e.g. Hadoop, scientific computing)

Google Cloud Platform

Google Cloud Storage

Google Cloud SQL

Interactive analysis of massive datasets at speed

Performant and scalable service for storing and accessing data

MySQL-based, fully managed service

Page 4: A fresh look at Google’s Cloud by Mandy Waite

Google App Engine

Page 5: A fresh look at Google’s Cloud by Mandy Waite

Easy to buildEasy to scaleEasy to maintain

Opinionated framework and deployment platform

Page 6: A fresh look at Google’s Cloud by Mandy Waite

Get up and running quickly - NO Servers

SDKPython, Java, Go runtimesLocal development server, Eclipse

Google InfrastructureAuto-scales

Admin ConsoleEasy managementLogs

Page 7: A fresh look at Google’s Cloud by Mandy Waite

Python Runtime Java Runtime Task Queues High Replication Datastore

Google Storage

Announce

BigQueryAnnounce

Backends, Pull Queues

Out of Preview

SLASupport

Google Storage GA

Cloud SQLAnnounce

2012

Cloud SQLGA

BigQuery GA

And growing: by the numbers

Google App Engine passed 7.5B+ daily hits

Page 8: A fresh look at Google’s Cloud by Mandy Waite

1,000,000 active applications2 Trillion datastore operations

half of active world IP addresses touch GAE

A month in the life of Google App Engine:

Page 9: A fresh look at Google’s Cloud by Mandy Waite

App Engine Updates and Pricing

Java 7 Support:InvokeDynamic, try-with-resources, Flexible type creation (diamond operator)

New features and updates:Cloud Endpoints (experimental), larger memory options for instances, task queue async methods, new multithreaded Python Dev Server, Python 2.5 deprecation, Django 1.4.2

Flexible pricing: free to get started, SLA from $9/moRange of support packages: https://cloud.google.com/support/packages

Page 10: A fresh look at Google’s Cloud by Mandy Waite

Application Hosting in EU

Data replicated within EU

Google App Engine European Data CentersCompliance and Locality

Page 11: A fresh look at Google’s Cloud by Mandy Waite

“ With Google App Engine, we don't need a system administrator or anyone dedicated to deploying our app, so 99% of our time is working on our application.. ”

Ben Kamens, Lead Engineer Khan Academy

Page 12: A fresh look at Google’s Cloud by Mandy Waite
Page 13: A fresh look at Google’s Cloud by Mandy Waite

FrontendsBackendsTask QueuesCron

Compute Network

URL FetchXMPPChannel APIMail API

Storage

DatastoreMemcacheNamespacesBlobstoreCloud SQLStatic content

Services

Images APIApp IdentityUsers APIMapReduce APIPipeline APIProspective Search API

App Engine Services and APIs

Page 14: A fresh look at Google’s Cloud by Mandy Waite

Google Cloud Endpoints

Business Logic

APIs for Mobile and Web Backends Made Easy(Experimental)

Storage(Datastore, SQL, Drive, etc)

Web APIs

End

poin

ts

23 Marzo - {codemotion} Laboratorio Google (Alfredo Morresi) - Aula N12Creare RESTful API Con Google Cloud Endpoints e App Engine #labgoogle

Page 15: A fresh look at Google’s Cloud by Mandy Waite

Development Stack

Page 16: A fresh look at Google’s Cloud by Mandy Waite

Google Compute Engine

Page 17: A fresh look at Google’s Cloud by Mandy Waite

Introducing Google Compute Engine

Adding Virtual Machines to the Google Cloud Platform

Compute

Launch Linux Virtual Machines on demand

Network

Connect your VMs together to form powerful clusters

Storage

Store on persistent disk, local disk or Cloud Storage

Tooling

Control your VMs via REST API or command line

Page 18: A fresh look at Google’s Cloud by Mandy Waite

Architecture

Page 19: A fresh look at Google’s Cloud by Mandy Waite

Projects

[Google APIs Console] Project

● Created with APIs Console

● Collection of Compute Engine

Resources

● Team Members

○ Owner, Editor or Viewer

● Billing Information

Page 20: A fresh look at Google’s Cloud by Mandy Waite

What's in a VM

Linux VMs

● Root access

● Debian-based Linux or

CentOS

● Many hardware configurations

○ 1, 2, 4, or 8 CPUs

○ Up to 52GB of RAM

Page 21: A fresh look at Google’s Cloud by Mandy Waite

API Basics

● JSON over HTTP

● Main Resources (Nouns):

○ Projects

○ Instances

○ Networks and Firewalls

○ Disks and Snapshots

○ Zones

● Actions (Verbs):

○ GET, POST (create) and DELETE

○ Custom ‘verbs’ for updates (PUT/POST)

○ Auth via OAuth2

Page 22: A fresh look at Google’s Cloud by Mandy Waite

Clients and Libraries

● gcutil: command line utility

● Web UI: Built on GAE

● Libraries

● Partners and ecosystem

Page 23: A fresh look at Google’s Cloud by Mandy Waite

Flexible Storage Options

Persistent DiskFast, consistent performanceNetwork Connected, ReplicatedSnapshots for backup and restoreShareableEncrypted at Rest

Google Cloud StorageSeamless AuthenticationSecure AccessEU datacenter option

Ephemeral DiskUsed to boot VMLives and dies with VMEncrypted at Rest

Page 24: A fresh look at Google’s Cloud by Mandy Waite

Right now:

● Limited preview

● Focused on compute intensive and batch

workloads

● SLA and support available to commercial

customers

● Apply: http://cloud.google.com

● Talk to us! We're happy to discuss your

use case

CC Image courtesy of London looks

i can haz Compute Engine?

Page 25: A fresh look at Google’s Cloud by Mandy Waite

Storing Data

Page 26: A fresh look at Google’s Cloud by Mandy Waite

Storage Systems at Google

Page 27: A fresh look at Google’s Cloud by Mandy Waite

Structured Data: NoSQL + SQL

Schemaless

Queries, Atomic Transactions

Best for Internet Scale, denormalizable DataSets

Think Differently ... No Joins

Familiar MySQL

Fully Managed

Best for Bounded Scale, highly structured DataSets

Experimental

Page 28: A fresh look at Google’s Cloud by Mandy Waite

Unstructured: Google Cloud Storage

Page 29: A fresh look at Google’s Cloud by Mandy Waite

Google BigQuery

Page 30: A fresh look at Google’s Cloud by Mandy Waite

Big Data at Google

72 hours100 million gigabytes425 million users

Page 31: A fresh look at Google’s Cloud by Mandy Waite

BigQuery gives you this power

Store data with reliability, redundancy and consistency

Go from data to meaning

Quickly!

At scale ...

Page 32: A fresh look at Google’s Cloud by Mandy Waite

How are developers using it?

Game and social media analytics

Advertising campaign optimization

Sensor data analysis

Infrastructure monitoring

Page 33: A fresh look at Google’s Cloud by Mandy Waite

Regular expressions on 15.7 billion rows...

Page 34: A fresh look at Google’s Cloud by Mandy Waite

Google Cloud Storage

Upload your Data

BigQuery

Page 35: A fresh look at Google’s Cloud by Mandy Waite

Google Spreadsheets via Apps Script

Page 36: A fresh look at Google’s Cloud by Mandy Waite

Google Spreadsheets via Apps Script

Page 37: A fresh look at Google’s Cloud by Mandy Waite

● Java● Python● .NET● PHP● JavaScript● Apps Script● ... more ...

Libraries

Page 38: A fresh look at Google’s Cloud by Mandy Waite

It's a RESTful API

Page 39: A fresh look at Google’s Cloud by Mandy Waite

Wrap Up

Page 40: A fresh look at Google’s Cloud by Mandy Waite

Questions?

cloud.google.com

Page 41: A fresh look at Google’s Cloud by Mandy Waite

Thank you!

http://developers.google.com/cloud