software is eating the world data is digesting it df2013
TRANSCRIPT
10.20.2005
Software is Eating The WorldBut Data is Digesting It
Dreamforce 2013
2
Software is Eating the World
3
4
5
Source: PwC
6
All were founded before 1989
7
The average age of the Top 20 Software Companies is
47 years
8
Software sales growthis slowing
9
The Four Stages of Software Production
10
STAGE 1
“The money is in the hardware, not the software”
11
STAGE 2
“Actually, the money is in the software”
12
STAGE 3
“The money is not in the software,but it is differentiating”
13
STAGE 4
“Software is not even differentiating, the value is the data”
14
The Age of Software The Age of Data
15
Pressure is Growing
16
The Shock of The New
17
The CIO is the Last To Know
18
Systems of Record Systems of Engagement
19
Engagement with customers, partners, employees, and other stakeholders
generates data
20
• Location, location, location• Influence patterns• Customer service feedback• Sentiment• Geographical trends.• Search Findings• Predicting retail and property sales
21
Software is a means
22
“The lumber industry sells what used to be waste — sawdust, chips, and shredded wood — for a pretty profit. Today you’ll find these by-products in synthetic fireplace logs, concrete, mulch, particle board, fuel, livestock and pet bedding, winter road traction, weed killing and more.”
Jason Fried, 37signals
23
24
“In contrast to most traditional survey methods, search data are collected as a by-product of normal activity”
- the Bank of England
25
26
27
28
What you Share Changes What You Drink
29
When Web Companies Grow Up
30
The Role
31
The 2013 Language Scape
32
The Trends
33
34
Source: John C. McCallum
35
Many Tools – the Rise of Polyglot
36
Database Types
Key Value Stores: RIAK, Redis, Voldemort,
Document databases: CouchDB, MongoDB
Column store – SAP HANA, Hbase, Vertica
Graph databases – Neo4J, Infinite Graph, Giraph
Column/Key Value Store Hybrid- Cassandra
Schemaless != Structureless
“Eventual Consistency” and CAP.
37
Analysis Modes
38
The Players
39
Hadoop is Eating the World
40
Data Viz
D3.js Processing.org
41
GitHub Growth and the RedMonk Experience
See Story of Data post here.
42
Source: Google Trends
43
Source: Google Trends
44
Source: Hacker News
45
Source: Hacker News
46
Source: Stack Overflow
47
Source: Stack Overflow
48
49
50
51
Social Coding
52
Social Data
53
Hadoop at Facebookhttp://hadoopblog.blogspot.com/2010/05/facebook-has-worlds-largest-hadoop.html
54