streak + google cloud platform
TRANSCRIPT
Data @ StreakHow we use the Google Cloud Platform
Aleem Mawani, [email protected], @aloo
What is Streak?
1. Serve our app and run business logic
2. Store and Analyze user data
3. Record and analyze every UI action
4. Record and analyze all server logs
5. Record and analyze all client logs
AppEngine + Prediction API + Search API
AppEngine Datastore + Memcache + Cloud Storage + BigQuery
BigQuery (Streaming + Bigquery Extension)
BigQuery (Streaming + Bigquery Extension)
BigQuery (Streaming + Bigquery Extension)
What do we use Google Cloud Platform for?
Streak on Google Cloud
App Engine. .
.
app data
Datastore + Memcache
Streak on Google Cloud
App Engine. .
.
app data
log da
ta
Logstore
Datastore + Memcache
BigQuery
log data
Streak on Google Cloud
App Engine. .
.
app data
log da
ta
Logstore
Datastore + Memcache Cloud
Storage
BigQuery
Prediction API
app data
log data
Streak on Google Cloud
App Engine. .
.
app data
log da
ta
Logstore
Datastore + Memcache Cloud
Storage
BigQuery
Prediction API
app data
App Engine Search API
app data
log data
Streak on Google Cloud
App Engine. .
.
app data
log da
ta
Logstore
Datastore + Memcache Cloud
Storage
BigQuery
Prediction API
app data
App Engine Search API
app data
Translation API & Human Translators
i18n
log data
Streak on Google Cloud
App Engine. .
.
app data
log da
ta
Logstore
Datastore + Memcache Cloud
Storage
BigQuery
Prediction API
app data
App Engine Search API
app data
Translation API & Human Translators
i18n
log data
event dataevent data
event data
BigQuery Demo
Summary
Benefits
● Move fast and build lean!● Google quality infrastructure for everyone● Ask critical business questions
Tradeoffs
● Need to move data incrementally ● Need to make your pipelines fault tolerant at scale
Tips
● Mirror your data in multiple systems, storage is cheap!● Build systems incrementally