un big data for official statistics...un big data for official statistics sandra liliana moreno...

7
www.dane.gov.co 21st October, 2018 Dubai, UAE Advances in the project “Testing Satellite Imagery, geospatial data and administrative records for producing agricultural statistics” Open Day of the Global Working Group UN World Data Forum UN Big Data for official statistics Sandra Liliana Moreno [email protected]

Upload: others

Post on 12-Aug-2020

15 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: UN Big Data for official statistics...UN Big Data for official statistics Sandra Liliana Moreno slmorenom@dane.gov.co Big Data para estadísticas agropecuarias Objetive Estimate the

w w w . d a n e . g o v . c o

21st October, 2018Dubai, UAE

Advances in the project “Testing Satellite Imagery, geospatial data and administrative records for producing

agricultural statistics”

Open Day of the Global Working GroupUN World Data Forum

UN Big Data for official statistics

Sandra Liliana [email protected]

Page 2: UN Big Data for official statistics...UN Big Data for official statistics Sandra Liliana Moreno slmorenom@dane.gov.co Big Data para estadísticas agropecuarias Objetive Estimate the

Big Data para estadísticas agropecuarias

ObjetiveEstimate the yield of cereal crops, by applying a deterministic

model, which incorporates the results of satellite image processing and other data sources

ImpactInnovate in DANE statistical information production methods, through the use of remote sensing data and available administrative records, to optimize the resources required in the traditional survey method.

Page 3: UN Big Data for official statistics...UN Big Data for official statistics Sandra Liliana Moreno slmorenom@dane.gov.co Big Data para estadísticas agropecuarias Objetive Estimate the

► Satellite imagery and Geospatial Data:♦ LandSat 8 Satellite imagery (2013 – 2017)♦ Thematic maps: soil and weather variables produced by

Colombian organizations♦ Agricultural crop series of harvest area, production and yield

from Ministry of Agriculture and Rural Development

► Experts on satellite imagery processing, GIS and statistical data modelling for agriculturalsurveys

► Specialized software♦ For processing satellite imagery: Google Earth Engine ♦ For statistical processing: R

Resources and Technical Specialties Requested

Page 4: UN Big Data for official statistics...UN Big Data for official statistics Sandra Liliana Moreno slmorenom@dane.gov.co Big Data para estadísticas agropecuarias Objetive Estimate the

Proposed methodology

National Agricultural Census

Cereal crop landidentification

Cereal crop mask112 municipalities in 6.032

agricultural productive units

LandSat 8 satellite imagery21 path row scenes

1 scene every 16 days

Agriculture Stress Index(ASI) for global drought

monitoring

Thematic maps and historicalcrop series

VegetationCondition Index (VCI)

TemperatureCondition Index (TCI)

Yield cropestimation model

Page 5: UN Big Data for official statistics...UN Big Data for official statistics Sandra Liliana Moreno slmorenom@dane.gov.co Big Data para estadísticas agropecuarias Objetive Estimate the

Advances

► Identification of cereal crop lands

► Algorithm in Google Earh for selecting free cloud imagery (2013-

2018), and for appliyng a cloud mask,

► Algorithm in Google Earth for preprocessing and processing satellite

imagery to obtain de Vegetation Condition Index (VCI) and the

Temperature Condition Index (TCI).

► Consolidation of agricultural crop series (AGRONET) 2007-2017

► Download the thematic maps from IGAC, IDEAM and UPRA

Page 6: UN Big Data for official statistics...UN Big Data for official statistics Sandra Liliana Moreno slmorenom@dane.gov.co Big Data para estadísticas agropecuarias Objetive Estimate the

Learned lessons

There is a technical capacity at DANE as National Statistical Organization in Colombia to process satellite imagery and produce useful statistical information.

Google Earth Engine provides the free access to satellite imagery needed to develop innovation projects taking advantage of Earth Observation Data

An institutional policy that supports research allows the development of innovative projects that take advantage of non-traditional data for

the generation of statistics.

There is available information produced by local organizations for providing useful data

Page 7: UN Big Data for official statistics...UN Big Data for official statistics Sandra Liliana Moreno slmorenom@dane.gov.co Big Data para estadísticas agropecuarias Objetive Estimate the