Who Actually Uses this Stuff?A Quantitative Analysis of Global Map

and Other Global Data Set Users

GSDI 6: From Global to LocalBudapest, Hungary

18 September 2002

Karen D. KlineInternational Steering Committee for Global Mapping

Department of Geography

University of California, Santa Barbara

GSDI 6 2

Implications

Enormous expenditures on data collection and developmentAre these products really useful? For what purposes?

Data distribution policies are currently being written for various productsCommercial use argument

Distribution of data via internet allows user information to be collected

GSDI 6 3

User Model Definition

“User modeling involves inferring unobservable information about a user from observable information about him/her, e.g., his/her actions or utterances.”

Zukerman and Albrecht, (2001), “Predictive Statistical Models for User Modeling”, User Modeling and User-Adapted Interaction, 11: 5-18.

GSDI 6 4

Types of User Models

1. The cognitive processes that underlie a user’s actions;

2. The differences between the user’s skills and expert skills;

3. The user’s behavioral patterns; or4. The user’s characteristics.

Webb, Pazzani and Billsus, (2001), “Machine Learning for User Modeling”, User Modeling and User-Adapted Interaction, 11: 19-29.

GSDI 6 5

Previous User Model Studies

1. EOSDIS User Model Effort

2. European and Asian Satellite Remote

Sensing Applications

3. Global Land Cover Characteristics

GSDI 6 6

EOSDIS User Model

GroupsMembers represent

the respective community

Results from discussion

June 1995

Butler, D., J. E. Estes, et al., Eds. (1998). Proceedings of the EOSDIS Potential User Group Development Effort. Washington, DC, NASA.

12 Groups: Retrospective Research Field Campaigns and Individual

Data Providers Persistent Information

Production for Research Scientific Environmental

Assessment Commercial Users Operational Users Resource Managers and

Planners Policy Formulation and

Decision Making Legal Community K-14 Educators and Students Collegiate and Professional

Education Libraries, Press, and Public

GSDI 6 7

EOSDIS User Model ResultsUser Group User Population1 Use Intensity2 User Resources3 User Activities4 Desired EOSDIS

Functionality and Capabilities5

Retrospective Research  Broad  (1-5)  Medium (>100)  High/High  General  Some changes desired

Field Campaigns and Individual Data Providers 

General  (1-5)  Low (>100)  High/High  General  Some changes desired

Persistent Information Production for Research 

Specialized (<50)  High  (1-5)  High/High  Focused  Some changes desired

Scientific Environmental Assessment 

Specialized (1-5)  High  (1-5)  High/High  Broad  Some changes required

Commercial Users  General (1-5)  High  (>100)  High/High  Broad  No change required

Operational Users  Widespread (>100)  High  (>100)  High/High  Broad  Some changes desired

Resource Managers and Planners 

Broad  (5-50)  High  (5-20)  Medium/Medium  General  Some changes desired

Policy Formulation and Decision Making 

General  (50-100)  Medium  (5-20)  Medium/ High  Focused  Some changes desired

Legal Community  General  (1-5)  Low  (5-20)  Low/Low  Narrow  Some changes desired

K-14 Educators and Students 

Widespread  (5-20)  Low  (20-100)  Low/Low  Focused  Some changes required

Collegiate and Professional Education 

Widespread  (5)  High  (>100)  High/High  Broad  Some changes desired

Libraries, Press, and the Public 

Broad (5-100) [Libraries/Press] Widespread [Public] 

Low (5-20)  Low/Low  Broad  Some changes required

GSDI 6 8

European/Asian RS Applications

Personal interviews and literature reviewBased upon categories used in the

Potential Commercial Applications of EOSDIS Data (Lawless, 1996)

GSDI 6 9

Results of Survey & Literature Review: Europe and Asia

Category Rank Category Rank

Economic Development

Low/Medium Weather & Climate Medium

Urban & Regional Planning

Medium Air Quality Low

Mapping, Charting, & Geodesy

Low/Medium Water Quality Low/Medium

Land Use & Land Cover

High Water Resources High

Agriculture Medium Fisheries Low

Forestry Medium/High Marine High

Rangeland Low Recreation & Tourism Low

Emergency Management

Medium Information & Intelligence

Low/Medium

Transportation Low Public Health Low

Geology Medium Media, Press, Education

Low

Hadley, B. C., J. E. Estes, et al. (2000). European and Asian Satellite Remote Sensing Applications: A Literature Review and Analysis. Santa Barbara, University of California: 172.

GSDI 6 10

GLCC Survey

Methods for Gathering User Input Informal communicationOn-line registration formUser feedback survey

Brown, J. F., T. R. Loveland, et al. (1999). "The Global Land-Cover Characteristics Database: The Users' Perspective." Photogrammetric Engineering & Remote Sensing 65(9): 1069-1074.

GSDI 6 11

GLCC Survey

User On-line RegistrationStarted user registration with prototype versions of

North America, South America, and Africa (early 1996)

Format has remained the sameBasic information about user

Contact informationGeographic of interestApplication

Brown, J. F., T. R. Loveland, et al. (1999). "The Global Land-Cover Characteristics Database: The Users' Perspective." Photogrammetric Engineering & Remote Sensing 65(9): 1069-1074.

GSDI 6 12

Why these data sets?

User information collected via the internet when data set downloaded

Organizations released user information to UCSB/RSRU

All are based on different continentsAll created for different purposes

UNEP/GRID | Global Map | GLCC

GSDI 6 13

Information to be UsedLocation of the user

At the country and continent levelDomain of the user (ie, education, government)

Application For what purpose will the data set be used?

Scale of the applicationLocal, regional, global

Information either clearly decipherable or must be inferred by looking at email addresses, physical addresses, other provided information

GSDI 6 14

Application Categories

1. Agriculture2. Air Quality3. Economic development and

conservation4. Emergency management5. Fisheries6. Forestry7. Geology8. Information and intelligence9. Land use and land cover10. Mapping, charting and

geodesy

11. Marine

12. Media, press and education

13. Public health

14. Rangeland

15. Recreation and tourism

16. Transportation

17. Urban and regional planning

18. Water quality

19. Water resources

20. Weather and climate

GSDI 6 15

Application Categories(New Additions)

1. GPS applications2. Reference3. Wetlands4. Elevation and topography5. Soil6. Modeling (carbon cycle, global change)7. Software development, testing, and demonstration8. Research (no other details given)9. Law and policy10. Archaeology

GSDI 6 16

Global Land Cover Characteristics

User information form filled out prior to downloading, information sent via email to USGS/EDC staff, registration information entered into excel file

Dates:February 10, 1999December 17, 2001

1108 entries examined to date (complete)

GSDI 6 17

UNEP/GRID Arendal:

Tracks requests using Microsoft Access; information not necessarily submitted via web form

Geneva: Tracked information until recently; log information received

WebTrends software used to monitor website activity at Arendal and Tbilisi sites

Arendal Users: Dates:

January 5, 2000June 18, 2001

671 entries examined to date (Arendal completed) Geneva data not examined yet

UNEP/GRID Arendal:Number of Users by Country

0

20

40

60

80

100

120

140

(bla

nk)

Arg

entin

aA

ustr

alia

Bra

zil

Can

ada

Chi

leC

hina

Den

mar

kF

ranc

eG

erm

any

Hun

gary

Indi

aIn

done

sia

Italy

Japa

nK

azak

hsta

nK

enya

Kor

eaM

exic

oN

ethe

rland

sN

ew Z

eala

ndN

orw

ayP

hilip

pine

sR

oman

iaR

ussi

aS

inga

pore

Sou

th A

fric

aS

pain

Sri

Lank

aS

wed

enS

witz

erla

ndT

haila

ndU

nite

d K

ingd

omU

nite

d S

tate

sA

fgha

nist

anA

rmen

iaA

ustr

iaA

zerb

aija

nB

angl

ades

hB

elar

usB

elgi

umB

osni

a an

dB

ulga

riaC

roat

iaC

zech

Rep

ublic

Fin

land

Geo

rgia

Gre

ece

Icel

and

Iran

Irel

and

Isra

elK

yrgy

zsta

nLa

tvia

Lith

uani

aM

oldo

vaM

ozam

biqu

eN

epal

Nig

eria

Pak

ista

nP

eru

Pol

and

Por

tuga

lS

amoa

Sau

di A

rabi

aS

lova

kia

Slo

veni

aS

urin

ame

Taj

ikis

tan

Tur

key

Tur

kmen

ista

nU

krai

neU

zbek

ista

nY

ugos

lavi

a

Country

Nu

mb

er o

f U

sers

UNEP/GRID-Arendal

0

2

4

6

8

10

12

14

16

18

2000

0104

2000

0306

2000

0316

2000

0329

2000

0502

2000

0509

2000

0523

2000

0606

2000

0629

2000

0707

2000

0713

2000

0723

2000

0803

2000

0814

2000

0822

2000

0828

2000

0904

2000

0913

2000

1002

2000

1023

2000

1107

2000

1114

2000

1126

2000

1204

2000

1212

2000

1221

2001

0109

2001

0116

2001

0124

2001

0131

2001

0207

2001

0214

2001

0221

2001

0228

2001

0308

2001

0316

2001

0326

2001

0404

2001

0423

2001

0502

2001

0510

2001

0521

2001

0605

2001

0618

Date (yyyymmdd)

Nu

mb

er o

f U

sers

4 January 2000 to 18 June 2001

UNEP/GRID Arendal: Applications

0

50

100

150

200

250

300A

GR

CLI

M

CO

M

EC

OL

ED

C

EM

ER

G

FO

RE

ST

GIS

LAW

LULC

MA

P

MA

RIN

E

MP

RE

D

PO

LL

PU

BH

LTH

RE

C

RE

F

SO

IL

TO

PO

TR

AN

SP

UR

BP

L

WA

TR

E

(bla

nk)

Applications

Nu

mb

er o

f U

sers

GSDI 6 21

Global MapData Sets Released To Date:

Registration process:1. Fill online form2. Receive account and

password3. Download data

Dates: November 28, 2000 August 31, 2002

1372 entries examined to dateData sets used:

Australia, Colombia, Japan, Laos, Nepal, Panama, Philippines, Sri Lanka, and Thailand

Australia AUS June 28, 2001

Bangladesh BGD July 22, 2001

Colombia COL May 18, 2001

Japan JPN November 28, 2000

Laos LAO November 28, 2000

Sri Lanka LKA November 28, 2000

Mongolia MNG December 4, 2001

Nepal NPL November 28, 2000

Panama PAN March 28, 2002

Philippines PHL December 25, 2000

Thailand THA November 28, 2000

Global Map: Australia

0

2

4

6

8

10

12

2001

0619

2001

0710

2001

0716

2001

0722

2001

0728

2001

0802

2001

0808

2001

0816

2001

0824

2001

0908

2001

0928

2001

1005

2001

1016

2001

1026

2001

1211

2002

0116

2002

0202

2002

0304

2002

0405

2002

0505

2002

0629

2002

0718

2002

0829

Date (yyyymmdd)

Nu

mb

er o

f U

sers

28 June 2001 - Australia Global Map data released

Global Map: Japan

0

2

4

6

8

10

12

14

16

2000

1128

2000

1206

2000

1211

2000

1217

2000

1222

2000

1227

2001

0107

2001

0112

2001

0117

2001

0122

2001

0127

2001

0201

2001

0206

2001

0211

2001

0216

2001

0221

2001

0226

2001

0303

2001

0308

2001

0313

2001

0319

2001

0324

2001

0329

2001

0403

2001

0409

2001

0414

2001

0419

2001

0424

2001

0429

2001

0504

2001

0509

2001

0514

2001

0519

2001

0525

2001

0531

2001

0605

2001

0610

Date (yyyymmdd)

Nu

mb

er o

f U

sers

28 November 2000 - Japan Global Map data released at Global Mapping Forum 2000 (Hiroshima, Japan)

All Global Map Users

0

2

4

6

8

10

12

14

16

18

20

2000

1128

2000

1211

2000

1221

2001

0106

2001

0116

2001

0126

2001

0205

2001

0215

2001

0225

2001

0307

2001

0318

2001

0328

2001

0407

2001

0417

2001

0427

2001

0507

2001

0517

2001

0529

2001

0608

2001

0711

2001

0723

2001

0804

2001

0820

2001

0918

2001

1004

2001

1024

2001

1123

2002

0116

2002

0218

2002

0402

2002

0505

2002

0629

2002

0727

2002

0901

Date (yyyymmdd)

Nu

mb

er o

f U

sers

Global Mapping Forum 2000Hiroshim a, Japan28 Novem ber 2000Data released: Japan Laos Sri Lanka Nepal Thailand28 Novem ber 2000

News article:Nippon Keizai Shinbun27 Augus t 2002

News article:Sanyo Chuo Shim po5 May 2002

Data released: Bangladesh 22 July 2001

GSDI 5Cartagena, Colom bia18 May 2001Data released: Colom bia18 May 2001

0%

20%

40%

60%

80%

100%

Africa Asia CentralAmerica

CIS Europe Middle East NorthAmerica

Oceania SouthAmerica

SoutheastAsia

Continent

Res

earc

h L

oca

tio

n (

by

%)

Africa Arctic Asia Central America Eurasia Europe Global Middle East

North America Oceania South America Tropics Antarctic CIS Southeast Asia

GSDI 6 27

Issues

English not the first language for all users

Same information not necessarily collected for the three data sets

Consistency in use of descriptive terms not guaranteed

GSDI 6 28

Next Steps…

Finish locating user dataExplore data

Pivot tables and chartsParallel coordinate plots

Statistical analysisχ2 calculationMeasure for dependence

GSDI 6 29

AcknowledgementsTom Loveland, Jess Brown, Stephen Howard (EROS Data Center)Tim Foresman, Mick Wilson, Lawrence Hislop, Ron Witt, Hy Dao (UNEP)Minoru Akiyama, Hiroshi Une, Hiroshi Masaharu, Eiji Murakami, Hidenori Fujimura (Global Map/GSI)

John Kelmelis, USGS; Peter Holland, AUSLIG; Claude Luzet, EuroGeographics; Santiago Borrero-Mutis, IGAC

Keith C. Clarke, Michael F. Goodchild, Leal A.K. Mertes, K. Eric Anderson

RSRU: Joseph Scepan, Greg Husak, Tamuka Magadzire, Kevin Knight, Martin Herold, Jeff Hemphill, Brian Hadley, and Jack EstesGeography Research: Nancy Ponce, Beilei Zhang, Connie Padilla, Kathleen Gordon

Support provided by:US DOI 00HQAG0018 Global Mapping ProjectNASA NAG5-10457 Remote Sensing Information Science Research