the geospatial revolution anz 2010

The Geospatial Revolution

Peter Batty

December 2010

1

2

The Revolution3

4

changing natureof geospatial data

The

5

Crowdsourcing6

The Cloud

flic.kr/p/7Bzn5E7

The Revolution

8

GIS has been a specialized backroom technology for many years

9

Smallworld

Intergraph

ESRI

Net

wor

k m

odel

ing

Scal

abili

ty

Cus

tom

izab

ility

Util

ity fo

cus

Non

-net

wor

k ap

ps

“Mai

nstr

eam

” co

re

New

tec

hnol

ogie

sUtility GIS Players

10

11

flic.kr/p/7A6vVg12

flic.kr/p/7rnNAD

flic.kr/p/7NEJzF

Location is now

Pervasive and Simplein consumer applications

13

Disruptive technology

Functionality /performance

Time

Established technology

Disruptive technology

MainstreamMarketrequirements

14

Consumer driven innovation

15

“But these new systems are just

simple web mapping, they’re not GIS”

16

DemoOffline

17

Mobile too!Runs on smart phones

including iPhone…… and tablets including iPad

18

19

flic.kr/p/7UjM5T20

The changing nature of geospatial data

21

September 12, 201022

23

24

25

26

27

28

Microsoft Photosynth29

Google Streetview30

Microsoft “Street Slide”

http://bit.ly/streetside31

layar32

Something on layar

http://www.ted.com/talks/blaise_aguera.html

Blaise Aguera y Arcas at TED 2010

33

Manhattan

maps

34

C3 Technologies

Las Vegas

35

prototypegame.org

Manhattan

36

The Sensor Web

Need a spatial context to make sense of all this

37

Location sensing

Cell towersWi-Fi

GPSRFID

UWB

38

New TomTom traffic speed datasetderived from

600 billionspeed readings from users

flickr.com/photos/rutlo/3164449930/

real time data within

3 minutes

39

40

41

location based servicesare real at last!

42

Will have the ability to know where everything is - and what is happening - all the time

43

Crowdsourcing

44

Web

publishing participation

2.0Web1.0

45

Wikipedia

46

Hurricane KatrinaNew Orleans

47

Community generated data

scipionus.com48

OpenStreetMap

49

December 3, 2007

July 7, 2009

Google OpenStreetMap

50

300,000+

momentum!!

200,000+users

OSM stats from May 2009

24mkm of highways

34mkm of ways

NAVTEQ had 18m km of highways in Dec 2007

crazy

flickr.com/photos/pimpmasterjazz/2601898276/51

What about quality?

“OSM quality is beyond good enough, it is a product that can be used for a wide range of activities”

Dr Muki Haklay of UCL

Based on a detailed analysishttp://tinyurl.com/mukiosm

52

Something on MapQuest / Microsoft OSM

53

2007 dataDatabase

69 countries11m miles (18m km) of roads18m points of interest

PeopleField force 700Central production 270Technology 500Total 3349

Financial Revenue $853m (~€604m) Data creation & distribution costs $396m (~€280m)

“Creating, maintaining and delivering a comprehensive, high quality map database is a

multi-step, labor-intensive process. We currently employ over 270 employees in our centralized production facility and a global

workforce of over 700 geographic analysts in 32 countries”

54

Crowdsourcing is a paradigm shift for data creationflickr.com/photos/jamescridland/613445810/

55

Running in the

flic.kr/p/7Bzn5E

Cloud

56

57

This is an old Google data center (2005)

Each container holdsservers1,160

This facility holds an estimated

150,000servers

58

Google has an estimated 40…holding an estimated

data centers…

1 millionservers

59

3 billionsearches per day

35,000searches per second

60

2 billion videos per day

61

100 millionmonthly users

62

one zillion times more computer science

PhDs than your company or mine has

63

AmazonGoogle

Your IT department

HUGEeconomies of scale

64

Save

BIG!!

flic.kr/p/64kFKH65

EC2 Pricing

September 5, 2010

66

My daily quotas (max $5 per day)

46.5 CPU hours6.5 CPU hours free

43.2m web requests!

67

My total server costs for development of myWorld so far

13c

68

but is it SECURE???

flic.kr/p/4iCux7

69

There is a strong case that

your data

more secureis

in the cloud

70

Agility

flic.kr/p/7BM8zr

Google Maps had 400 releases in its first 4 years

71

Ultra scalableSecureMajor cost savings

Hardware, admin, upgradesMuch faster enhancements & fixes

flic.kr/p/7Bzn5E

Cloud benefits

72

Summary

73

Fast train?

flic.kr/p/7b5sKd74

changing natureof geospatial data

The

75

flic.kr/p/4vLS2o76

77

Cloud

flic.kr/p/6aJDqo78

79

?peter.batty@ubisense.netgeothought.blogspot.com

twitter.com/pmbatty

80

BackupDemo screen shots

81

Matches Smallworld styles

82

Google basemap gives context

83

Google satellite map

84

Display attribute data

85

Street View gives extra info

86

Street View gives extra info

87

Street View gives extra info

88

Something on “Google style search”

Google style one box search

89

Autocomplete search

90

Autocomplete search

91

Reports in search too

92

Reports from search

93

Google geocoding very flexible

94

Google local search

95

“Enterprise mashups”

OutagesTrucksWMSCIS

Smart Grid

96

Ability to link to maps

97

Click link, no software needed!

Demo

98

flic.kr/p/pWMRk

Different Approachesto integration

99

Sparse data

TrucksOutages

Jobs

Often don’t need detailed “GIS” maps

KML and GeoRSS are good formats

Sparse data

100

<?xml version="1.0" encoding="UTF-8"?><kml xmlns="http://www.opengis.net/kml/2.2"> <Placemark> <name>Simple placemark</name> <description>Attached to the ground. Intelligently places itself at the height of the underlying terrain.</description> <Point> <coordinates>-122.0822035425683,37.42228990140251,0</coordinates> </Point> </Placemark></kml>

KML is child’s play!

101

So is

<entry> <title>M 3.2, Mona Passage</title> <link href="http://example.org/2005/09/09/atom01"/> <id>urn:uuid:1225c695-cfb8-4ebb-aaaa-80da344efa6a</id> <updated>2005-08-17T07:02:32Z</updated> <summary>We just had a big one.</summary> <georss:point>45.256 -71.92</georss:point> </entry>

geoRSS

102

You can use KML in lots of placesKML uploaded to GeoCommons and used for thematic mapping

103

SimpleGood for sparse and dynamic dataWorks with multiple platforms / products

KML The Good

flic.kr/p/8eZBZk

104

Hard to match GIS styles

Hard to scale to large data volumes

KML The Bad

flic.kr/p/6hwSwn105

Dense Data

106

Raster map tiles

Pre-render maps into image filesApproach used by Google, Microsoft, etcVery high performance and scalabilityEasy to integrate with Google Maps etc

107

“If a dataset available on the web is in a format that can't be indexed by Google, does it make a sound?”

Kevin WiebeSafe Software

108

109

110

111

112

113

…/a2e/data/datasources/Pole/90974

REST APIs114

…/a2e/data/datasources/Pole/90974?f=gjson

REST APIs: simple and powerful115

…/a2e/data/datasources/Pole/search?f=gjson&lat=42.600&lon=-76.1780&d=4

116

<Picture of Jason> Jason BirchCity of Nanaimo

REST is good!!

117

“Neo GIS” examples

118

Cartography

Andy Allan, Cloudmade

119

120

Data creation and maintenance

Upcoming Mapzen editorCloudmade

121

Here’s a print of Chinatown, San Francisco.

Instead of gargoyles, we’re using more appropriate bits of icon and text to recognize the corners.

Here you can see that someone has walked around Green Street and noted address information and a few businesses.

This is not information that you’d be able to get from a satellite image.

It’s also information that don’t really need a GPS for: the roads are already in place, but they need extra eye-level information.

Data creation and maintenance

“Walking Papers” for OpenStreetMap Stamen Design122

Geospatial analysis

Stamen Design

123

Geospatial analysisFortiusOne / GeoCommons

124

Usability

flic.kr/p/kjwKm125

flic.kr/p/kjwKm

Usability

126

I highly recommend this book

127

My top 3 rules for good usability

Do usability testing1

Do usability testing2

Do usability testing3

128

flic.kr/p/72M6Lflic.kr/p/53WUkg

Doing a usability test

Put application in front of user

Shut up Watch

flic.kr/p/7UqPo1129

130

131

Don’t make me think

flic.kr/p/28o3czKrug’s first law of usability132

133

134

135

136

137

138

139