ean’s world of data: prototyping apps using real data

38
Prototyping apps using real data Matt Biddulph @mattb | [email protected]

Upload: matt-biddulph

Post on 24-May-2015

616 views

Category:

Technology


0 download

TRANSCRIPT

Page 2: EAN’s World of Data: Prototyping apps using real data
Page 3: EAN’s World of Data: Prototyping apps using real data

no morelorem ipsum

Page 4: EAN’s World of Data: Prototyping apps using real data
Page 5: EAN’s World of Data: Prototyping apps using real data

no morechartjunk

Page 6: EAN’s World of Data: Prototyping apps using real data

prototypes areboundary objects

Page 7: EAN’s World of Data: Prototyping apps using real data
Page 8: EAN’s World of Data: Prototyping apps using real data
Page 9: EAN’s World of Data: Prototyping apps using real data
Page 10: EAN’s World of Data: Prototyping apps using real data
Page 11: EAN’s World of Data: Prototyping apps using real data
Page 12: EAN’s World of Data: Prototyping apps using real data

LA attention heatmap

Page 13: EAN’s World of Data: Prototyping apps using real data

LA driving heatmap

Page 14: EAN’s World of Data: Prototyping apps using real data

Realistic cities

generating a dataset of people moving around town

Page 15: EAN’s World of Data: Prototyping apps using real data
Page 16: EAN’s World of Data: Prototyping apps using real data
Page 17: EAN’s World of Data: Prototyping apps using real data
Page 18: EAN’s World of Data: Prototyping apps using real data
Page 19: EAN’s World of Data: Prototyping apps using real data
Page 20: EAN’s World of Data: Prototyping apps using real data

Realistic ranking

generating a dataset of places ordered by importance

Page 21: EAN’s World of Data: Prototyping apps using real data
Page 22: EAN’s World of Data: Prototyping apps using real data
Page 23: EAN’s World of Data: Prototyping apps using real data
Page 24: EAN’s World of Data: Prototyping apps using real data

Successfully read 442,775 records from: "s3://wikipedia-stats/features.txt"Successfully read 975,017,055 records from: "s3://wikipedia-stats/pagecounts-2012012*.gz"

in 4 hours, 19 minutes and 32 secondsusing 4 m1.small instances.

Page 25: EAN’s World of Data: Prototyping apps using real data

Hackney

Camden

Tower Hamlets

Newham

Enfield

Croydon

Islington

Southwark

Lambeth

Greenwich

Hammersmith and Fulham

Haringey

Harrow

Brent0 1000 2000 3000 4000

1140

1183

1263

1268

1316

1354

1603

1624

1796

1830

1850

2378

2498

3428

Londonneighbourhoods

Page 26: EAN’s World of Data: Prototyping apps using real data

Realistic social networks

generating a dataset of social connections between people

Page 27: EAN’s World of Data: Prototyping apps using real data
Page 28: EAN’s World of Data: Prototyping apps using real data
Page 29: EAN’s World of Data: Prototyping apps using real data
Page 30: EAN’s World of Data: Prototyping apps using real data
Page 31: EAN’s World of Data: Prototyping apps using real data

Politicians

Royalty

Page 32: EAN’s World of Data: Prototyping apps using real data

Politicians

Tennis

Royalty

Page 33: EAN’s World of Data: Prototyping apps using real data

Politicians

Tennis

Royalty

Professionalwrestling

Page 34: EAN’s World of Data: Prototyping apps using real data

Politicians

Tennis

Royalty

Comicbookcharacters

Professionalwrestling

Page 35: EAN’s World of Data: Prototyping apps using real data
Page 36: EAN’s World of Data: Prototyping apps using real data
Page 38: EAN’s World of Data: Prototyping apps using real data

Matt Biddulph@mattb | [email protected]

Thanks!