software is eating the world data is digesting it df2013

10.20.2005

Software is Eating The WorldBut Data is Digesting It

Dreamforce 2013

2

Software is Eating the World

3

4

5

Source: PwC

6

All were founded before 1989

7

The average age of the Top 20 Software Companies is

47 years

8

Software sales growthis slowing

9

The Four Stages of Software Production

10

STAGE 1

“The money is in the hardware, not the software”

11

STAGE 2

“Actually, the money is in the software”

12

STAGE 3

“The money is not in the software,but it is differentiating”

13

STAGE 4

“Software is not even differentiating, the value is the data”

14

The Age of Software The Age of Data

15

Pressure is Growing

16

The Shock of The New

17

The CIO is the Last To Know

18

Systems of Record Systems of Engagement

19

Engagement with customers, partners, employees, and other stakeholders

generates data

20

• Location, location, location• Influence patterns• Customer service feedback• Sentiment• Geographical trends.• Search Findings• Predicting retail and property sales

21

Software is a means

22

“The lumber industry sells what used to be waste — sawdust, chips, and shredded wood — for a pretty profit. Today you’ll find these by-products in synthetic fireplace logs, concrete, mulch, particle board, fuel, livestock and pet bedding, winter road traction, weed killing and more.”

Jason Fried, 37signals

23

24

“In contrast to most traditional survey methods, search data are collected as a by-product of normal activity”

- the Bank of England

25

26

27

28

What you Share Changes What You Drink

29

When Web Companies Grow Up

30

The Role

31

The 2013 Language Scape

32

The Trends

33

34

Source: John C. McCallum

35

Many Tools – the Rise of Polyglot

36

Database Types

Key Value Stores: RIAK, Redis, Voldemort,

Document databases: CouchDB, MongoDB

Column store – SAP HANA, Hbase, Vertica

Graph databases – Neo4J, Infinite Graph, Giraph

Column/Key Value Store Hybrid- Cassandra

Schemaless != Structureless

“Eventual Consistency” and CAP.

37

Analysis Modes

38

The Players

39

Hadoop is Eating the World

40

Data Viz

D3.js Processing.org

41

GitHub Growth and the RedMonk Experience

See Story of Data post here.

42

Source: Google Trends

43

Source: Google Trends

44

Source: Hacker News

45

Source: Hacker News

46

Source: Stack Overflow

47

Source: Stack Overflow

48

49

50

51

Social Coding

52

Social Data

53

Hadoop at Facebookhttp://hadoopblog.blogspot.com/2010/05/facebook-has-worlds-largest-hadoop.html

54