1 @urbanmapping metadata matters ian white september 5, 2013

1@urbanmapping

Metadata MattersIan WhiteSeptember 5, 2013

2@urbanmapping

Achtung!NoSQL is no panacea

Big Data isn’t about dataBig Data isn’t newBig Data doesn’t present a Boolean

quandaryWith power comes responsibility- AWS bills- Lady Gaga tweets- Innumeracy (correlation v causation)

3@urbanmapping

One Person’s Metadata is Another Person’s Data

4@urbanmapping

Big v Important

BigHeterogeneousRawDistributedStreaming/real

timeSearch for

meaningTime-sensitivePhilosophical

ImportantWell-defined schemaHigh value (not free)Test-drivenRelationalHistoricalEnterprise-focused

5@urbanmapping

Data Exhaust

Analytics Probes

Social Media Gov2.0

6@urbanmapping

Platforms

Commoditization of compute and storage

7@urbanmapping

A Brief History of Metadata

Callimachus Library of Alexandria, Egypt

8@urbanmapping

A Brief History of Metadata

“Pinakes” (lists)TitleCategoryAuthorAuthor birthplaceFatherWord count

Callimachus

9@urbanmapping

A Brief History of Metadata

Johan van der Does Johan van der Does

Leiden University, 1595Leiden University, 1595

10

@urbanmapping

A Brief History of Metadata

Melville DeweyMelville Dewey

11

@urbanmapping

A Brief History of Metadata

Card catalog room, Library of Congress c. 1920

12

@urbanmapping

A Brief History of Metadata

Dewey Decimal System goes electronic in 1967

13

@urbanmapping

Out with the Old, in with the New

Archiving card catalogs after digitization

14

@urbanmapping

Why Can’t We Be Together?

Metadata Data

15

@urbanmapping

Exponential Growth in Data

Unprecedented rate of data creation, 1995-today

1876

TaxonomyPinakes

300 BC

Database

1970

Catalog

1595 AD

Vo

lum

e o

f D

ata

Ge

ne

rate

d

16

@urbanmapping

Oh, How I’ve Missed You!The reunification of metadata with data

17

@urbanmapping

Together At Last!

18

@urbanmapping

GIS Remains Unevolved

+ =Melville DeweyMelville Dewey

19

@urbanmapping

Enter the Data CuratorPart social scientist, part librarian, part statistician, part RDBMS wiz

20

@urbanmapping

DIKW ModelData

Fact, Signal, Symbol

InformationStructural v FunctionalSymbolic v Subjective

KnowledgeProcessedProcedural

Propositional

21

@urbanmapping

Popularity Contest

Metadata

Big Data

Data ScienceCuration

22

@urbanmapping

c.2013

23

@urbanmapping

One Person’s Metadata is Another’s Data