data quality control: crowd-sourcing geospatial information 4/… · data quality control for...
TRANSCRIPT
![Page 1: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/1.jpg)
Hangzhou Forum onUnited Nations Global Geospatial Information Management
Data Quality Control:Crowd-Sourcing Geospatial Information
Xizi Hotel, Hangzhou24-26 May, 2012
Presented : Prof. Dr. Woosug Cho, Senior Advisor, NGII, Republic of KoreaPrepared : Prof. Dr. Ki-Joune Lee, Senior Advisor, NGII, Republic of Korea
Mr. Jun-Sung Kim, Deputy Director, NGII, Republic of Korea
![Page 2: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/2.jpg)
Definition of Crowd-Sourcing
Crowd-sourcing is a process that involves outsourcing tasks to a distributed group of people. This process can occur both online and offline, and the difference between crowdsourcingand ordinary outsourcing is that a task or problem is outsourced to an undefined public rather than a specific body, such as paid employees.
Shortly, a distributed problem-solving and production model.
The term "crowdsourcing" is a portmanteau of "crowd" and "outsourcing," coined by Jeff Howe in 2006.
Data Quality Control of Crowd-Sourcing Geospatial Data 2
![Page 3: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/3.jpg)
Crowd-Sourcing Geospatial Information
VGI (Volunteered Geographic Information) :the harnessing of tools to create, assemble, and disseminate geographic data provided voluntarily by individuals (Goodchild, 2007)
Examples on Crowd-Sourcing Geospatial Information:1. OpenStreetMap (http://www.openstreetmap.org/)http://www.youtube.com/watch?v=lpXk5W6b298&feature=channel&list=UL2. Project Haiti: http://vimeo.com/91828693. Google Map Maker (http://www.google.com/mapmaker) http://www.ted.com/talks/lalitesh_katragadda_making_maps_to_fight_disaster_build_economies.html
Data Quality Control of Crowd-Sourcing Geospatial Data 3
![Page 4: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/4.jpg)
Project Haiti
Data Quality Control of Crowd-Sourcing Geospatial Data 4
![Page 5: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/5.jpg)
Google Map Maker: Myanmar Case
Data Quality Control of Crowd-Sourcing Geospatial Data 5
![Page 6: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/6.jpg)
Example in UK –Google Map & OSM
Data Quality Control of Crowd-Sourcing Geospatial Data 6
http://tools.geofabrik.de/mchttp://tools.geofabrik.de/mc
![Page 7: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/7.jpg)
Example in Korea – Google Map & OSM
Data Quality Control of Crowd-Sourcing Geospatial Data 7
http://tools.geofabrik.de/mchttp://tools.geofabrik.de/mc
![Page 8: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/8.jpg)
PotLatch JOSM(Java OSM editor)
Data Quality Control of Crowd-Sourcing Geospatial Data 8
![Page 9: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/9.jpg)
Merkaartor
Data Quality Control of Crowd-Sourcing Geospatial Data 9
![Page 10: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/10.jpg)
Vespucci
Data Quality Control of Crowd-Sourcing Geospatial Data 10
![Page 11: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/11.jpg)
Mapen POI COllector
Data Quality Control of Crowd-Sourcing Geospatial Data 11
![Page 12: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/12.jpg)
OSMTracker
Data Quality Control of Crowd-Sourcing Geospatial Data 12
![Page 13: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/13.jpg)
A Comparative Study of Crowd-Sourcing GI
OSM vs. OS datasets- M. Haklay, Environment and Planning B: Vol.37, 2010
Data Quality Control of Crowd-Sourcing Geospatial Data 13
Length comparison between OSM and OS Meridian 2
Length comparison with attributes between OSM and OS Meridian 2
![Page 14: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/14.jpg)
Data Quality Control of Crowd-Sourcing Geospatial Data 14
A Comparative Study of Crowd-Sourcing GI
OSM vs. Tele Atlas in Germany- D. Zielstra and A. Zipf, Agile Conf., 2010
Total Length Differences of all Street Network Data betweenOpenStreetMap and Tele Atlas per Km2
![Page 15: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/15.jpg)
Weakness of Crowd-Sourcing GI
NO Quality Control on GI and NO Metadata– Data quality depends on each individual volunteer– No metadata– Only some lineage data (change-sets) is provided
Data Quality Control of Crowd-Sourcing Geospatial Data 15
![Page 16: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/16.jpg)
Quality Principles(ISO 19113)
Metadata(ISO 19115)
Quality Evaluation(ISO 19114)
Quality Measures(ISO 19138)
Data Quality(ISO 19157)
Data Product Spec.(ISO 19131)
Data Quality Control in ISO 191xx
16Data Quality Control of Crowd-Sourcing Geospatial Data
![Page 17: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/17.jpg)
Data Quality Evaluation – ISO
17
For each QC item,- scope,- measure,- Evaluation method, Should be defined
Result of QC Metadata
Data Quality Control of Crowd-Sourcing Geospatial Data
ISO 19113
Metadata(ISO 19115)
![Page 18: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/18.jpg)
Quality Evaluation Method – ISO 19114
18
Evaluation from external data such
as lineage informationEvaluation of
geospatial data Comparison with
other data set
Data Quality Control of Crowd-Sourcing Geospatial Data
![Page 19: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/19.jpg)
Data Quality Control for Crowd-Sourcing GI
Impossible to enforce data quality control process to volunteer map makers
– Possibly by governmental or semi-governmental institutes
ISO Quality Control– As defined by ISO 19113, 19114, and 19138– Direct Evaluation
• Comparison with other map data such as national maps– Indirect Evaluation, such as
• Number of participants at given area, • Profile of each participant, and• Frequency of updates and last update date
19Data Quality Control of Crowd-Sourcing Geospatial Data
![Page 20: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/20.jpg)
GI Production by Volunteers
Quality Control
(-) May discourage volunteer map production
(-) Poor environment to implement quality control
(-) Limited use of data due to the lack of quality control and metadata
20
Data Quality Control for Crowd-Sourcing GI
Data Quality Control of Crowd-Sourcing Geospatial Data
![Page 21: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/21.jpg)
(+) Providing data quality information (metadata)
(+) Quality control by means of map
production environments
Improving VGI environment
of quality control
Monitoring quality
21
Data Quality Control for Crowd-Sourcing GI : How to break the vicious circle
(-) May discourage volunteer map production
(-) Poor environment to implement quality control
GI Production by Volunteers
Quality Control
(-) Limited use of data due to the lack of quality control and metadata
Data Quality Control of Crowd-Sourcing Geospatial Data
![Page 22: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/22.jpg)
Map Production Tools for VGI
22
Map Production byVolunteers
Raw Test DataAbout Internal Test
MetadataReport on Data
Quality by Internal Test
Data Quality Control for Crowd-Sourcing GI : Improving Map Production Environment
Data Quality Control of Crowd-Sourcing Geospatial Data
![Page 23: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/23.jpg)
Data Quality Control for Crowd-Sourcing GI : Monitoring Data Quality
23
Monitoring Tools
Crowd-SourcingGI
Quality Evaluation by
Comparison
Reference Map
Quality EvaluationFrom Lineage Data
Metadata
Data Quality Control of Crowd-Sourcing Geospatial Data
![Page 24: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/24.jpg)
Organization with Authority
Data Quality Control for Crowd-Sourcing GI : Proposed Flow
24
MonitoringData Quality
Quality Control from Map Production Tools
Consumers of Crowd-Sourcing GI
Volunteers of GI production
Data Quality Control of Crowd-Sourcing Geospatial Data
Crowd-SourcingGI
Metadata
![Page 25: Data Quality Control: Crowd-Sourcing Geospatial Information 4/… · Data Quality Control for Crowd-Sourcing GI Impossible to enforce data quality control process to volunteer map](https://reader033.vdocument.in/reader033/viewer/2022042910/5f3eca2bd0cc57386830ad02/html5/thumbnails/25.jpg)
Summary
Crowd-Sourcing GI– An Important Source of GI– Very helpful for developing countries
Difficult to enforce rigorous quality control
Quality Control of Crowd-Sourcing GI– Map Production Tool with QC functions– Monitoring QC of Crowd-Sourcing GI
25Data Quality Control of Crowd-Sourcing Geospatial Data