@onehub

Using Big Data to Manage a Modern Web App

@onehub

Agenda

• What is a modern web app?

• What is Onehub?

• Big Data in a modern web app.

• Using Big Data to make smarter decisions.

3

@onehub

What is a Modern Web App?

• A distributed system; lots of networked parts.

• Always on, and constantly in chaos.

• Generates overwhelming amounts of data.

• Very malleable, can easily make changes at all levels.

4

@onehub

What is Onehub?

• Onehub is an online file sharing solution that helps businesses securely share and control files in the cloud.

• Standard stack: AWS, Linux, Ruby on Rails, SQL.

• Business challenge: what happened to my files?

5

Onehub 6

@onehub

Sources of Big Data

• 10s GBs of daily logs, the lowest value, most versatile.

• 100,000+ metrics/10 sec going into Graphite, nearly 1 billion daily.

• 65,000+ application events pushed as 550,000+ application notifications daily.

• 1 billion+ files in S3.

7

@onehub

Internal Tools

• Admin Tool

• Graphite

• Queue Dashboard

• Search Engine Dashboard

• Cache Dashboard

8

@onehub

Specialized External Tools

• New Relic - Application Performance

• Airbrake - Error Correlation

• Google Analytics - Pageviews

• Optimizely - A/B and Multivariate Testing

• Mixpanel - User Events and Funnel Analysis

9

@onehub

Improving Customer Support

• “Onehub is broken.”

• Is it broken for everyone, or just this person?

• Is it actually broken?

• Staying ahead of issues.

10

New Relic 11

Airbrake 12

Graphite 13

Papertrail 14

@onehub

Improving Customer Support

• “Onehub is broken.”

• Is it broken for everyone, or just this person?

• Is it actually broken?

• Staying ahead of issues.

15

@onehub

Better Product Decisions

• What do people use?

• How do they use it?

• What should we build next?

• Operational concerns.

16

Admin Tool 17

Google Analytics 18

@onehub

Better Product Decisions

• What do people use?

• How do they use it?

• What should we build next?

• Operational concerns.

19

@onehub

Customer Acquisition

• How did they find us?

• What did they do before they signed up?

• Are we the right fit?

20

Mixpanel 21

Optimizely 22

@onehub

Customer Acquisition

• How did they find us?

• What did they do before they signed up?

• Are we the right fit?

23

@onehub

Conclusion

• Big data is only useful if you do something with it to improve your business decisions — otherwise, it’s just taking up space.

24