a fresh look at google’s cloud by mandy waite

Mandy Waite

A Fresh Look at Google's Cloud

mandywaite@google.com (@tekgrrl)

Building Apps and Services in the Cloud

Google App Engine Google BigQuery

Scalable application development and

execution environment

NoSQL DatastoreAuto-scaling FrontendsLong-lived Backends

Task Queues

Google Compute Engine

Virtual machines

Run arbitrary workloads at scale(e.g. Hadoop, scientific computing)

Google Cloud Platform

Google Cloud Storage

Google Cloud SQL

Interactive analysis of massive datasets at speed

Performant and scalable service for storing and accessing data

MySQL-based, fully managed service

Google App Engine

Easy to buildEasy to scaleEasy to maintain

Opinionated framework and deployment platform

Get up and running quickly - NO Servers

SDKPython, Java, Go runtimesLocal development server, Eclipse

Google InfrastructureAuto-scales

Admin ConsoleEasy managementLogs

Python Runtime Java Runtime Task Queues High Replication Datastore

Google Storage

Announce

BigQueryAnnounce

Backends, Pull Queues

Out of Preview

SLASupport

Google Storage GA

Cloud SQLAnnounce

2012

Cloud SQLGA

BigQuery GA

And growing: by the numbers

Google App Engine passed 7.5B+ daily hits

1,000,000 active applications2 Trillion datastore operations

half of active world IP addresses touch GAE

A month in the life of Google App Engine:

App Engine Updates and Pricing

Java 7 Support:InvokeDynamic, try-with-resources, Flexible type creation (diamond operator)

New features and updates:Cloud Endpoints (experimental), larger memory options for instances, task queue async methods, new multithreaded Python Dev Server, Python 2.5 deprecation, Django 1.4.2

Flexible pricing: free to get started, SLA from $9/moRange of support packages: https://cloud.google.com/support/packages

Application Hosting in EU

Data replicated within EU

Google App Engine European Data CentersCompliance and Locality

“ With Google App Engine, we don't need a system administrator or anyone dedicated to deploying our app, so 99% of our time is working on our application.. ”

Ben Kamens, Lead Engineer Khan Academy

FrontendsBackendsTask QueuesCron

Compute Network

URL FetchXMPPChannel APIMail API

Storage

DatastoreMemcacheNamespacesBlobstoreCloud SQLStatic content

Services

Images APIApp IdentityUsers APIMapReduce APIPipeline APIProspective Search API

App Engine Services and APIs

Google Cloud Endpoints

Business Logic

APIs for Mobile and Web Backends Made Easy(Experimental)

Storage(Datastore, SQL, Drive, etc)

Web APIs

End

poin

ts

23 Marzo - {codemotion} Laboratorio Google (Alfredo Morresi) - Aula N12Creare RESTful API Con Google Cloud Endpoints e App Engine #labgoogle

Development Stack

Google Compute Engine

Introducing Google Compute Engine

Adding Virtual Machines to the Google Cloud Platform

Compute

Launch Linux Virtual Machines on demand

Network

Connect your VMs together to form powerful clusters

Storage

Store on persistent disk, local disk or Cloud Storage

Tooling

Control your VMs via REST API or command line

Architecture

Projects

[Google APIs Console] Project

● Created with APIs Console

● Collection of Compute Engine

Resources

● Team Members

○ Owner, Editor or Viewer

● Billing Information

What's in a VM

Linux VMs

● Root access

● Debian-based Linux or

CentOS

● Many hardware configurations

○ 1, 2, 4, or 8 CPUs

○ Up to 52GB of RAM

API Basics

● JSON over HTTP

● Main Resources (Nouns):

○ Projects

○ Instances

○ Networks and Firewalls

○ Disks and Snapshots

○ Zones

● Actions (Verbs):

○ GET, POST (create) and DELETE

○ Custom ‘verbs’ for updates (PUT/POST)

○ Auth via OAuth2

Clients and Libraries

● gcutil: command line utility

● Web UI: Built on GAE

● Libraries

● Partners and ecosystem

Flexible Storage Options

Persistent DiskFast, consistent performanceNetwork Connected, ReplicatedSnapshots for backup and restoreShareableEncrypted at Rest

Google Cloud StorageSeamless AuthenticationSecure AccessEU datacenter option

Ephemeral DiskUsed to boot VMLives and dies with VMEncrypted at Rest

Right now:

● Limited preview

● Focused on compute intensive and batch

workloads

● SLA and support available to commercial

customers

● Apply: http://cloud.google.com

● Talk to us! We're happy to discuss your

use case

CC Image courtesy of London looks

i can haz Compute Engine?

Storing Data

Storage Systems at Google

Structured Data: NoSQL + SQL

Schemaless

Queries, Atomic Transactions

Best for Internet Scale, denormalizable DataSets

Think Differently ... No Joins

Familiar MySQL

Fully Managed

Best for Bounded Scale, highly structured DataSets

Experimental

Unstructured: Google Cloud Storage

Google BigQuery

Big Data at Google

72 hours100 million gigabytes425 million users

BigQuery gives you this power

Store data with reliability, redundancy and consistency

Go from data to meaning

Quickly!

At scale ...

How are developers using it?

Game and social media analytics

Advertising campaign optimization

Sensor data analysis

Infrastructure monitoring

Regular expressions on 15.7 billion rows...

Google Cloud Storage

Upload your Data

BigQuery

Google Spreadsheets via Apps Script

Google Spreadsheets via Apps Script

● Java● Python● .NET● PHP● JavaScript● Apps Script● ... more ...

Libraries

It's a RESTful API

Wrap Up

Questions?

cloud.google.com

Thank you!

http://developers.google.com/cloud