joanna horabik-pyzel, nadia charkovska, olha danylo, zbigniew … · 2015. 12. 2. · joanna...

21
Conditionally autoregressive model for spatial disaggregation of activity data in GHG inventory: Application for agriculture sector in Poland Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International Workshop on Uncertainties in Atmospheric Emissions Kraków, 7-9 October 2015

Upload: others

Post on 03-Sep-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

Conditionally autoregressive model for spatial disaggregation of activity data in GHG inventory:

Application for agriculture sector in Poland

Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo,

Zbigniew Nahorski, Rostyslav Bun

4th International Workshop on Uncertainties in Atmospheric Emissions Kraków, 7-9 October 2015

Page 2: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

Classification of inventory sectors

Energy (fossil fuel burning) - power/heat production - residential - transport - industry and construction - others Industry (chemical processes) Agriculture

National

Regional

Municipal

Grid 2x2km

Disaggregation framework

Development of spatial GHG inventory crucially depends on availability of low resolution activity data. In Poland, relevant information needs to be acquired from national/regional totals. Goal

Application of statistical spatial scaling methods

to produce higher resolution activity data

2

Page 3: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

making use of detailed land cover map.

to be disaggregated into municipalities,

3

Task

Livestock data available in disticts

Page 4: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

CAR model for areal data

- Cell i

- Neighbours of cell i (wij=1) So, wi+=4

• Conditionally autoregressive (CAR) formulation of process

njiww

wGau

iji

j

i

ij

ijji ,...,1,,,~|2

,

wij - neighbour weights: 1 for neighbour, 0 otherwise

wi+= - number of neighbours of cell i

- variance parameter

4

j ijw2

Tn ,...,1θ

• Joint probability distribution of

D – a diagonal matrix with [D]ii=wi+

[W]ij= wij - a matrix with adjacency weights

- a variance parameter

Tn ,...,1θ

12 W-D,θ 0~ nGau

NWD 1

-2

2

Page 5: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

Disaggregation model → Specification in a fine grid

5

Yi - random variable associated with emissions in a fine grid

• Modelling

available covariates of cell i

spatial CAR structure

X – (design) matrix with covariates

(*)

→ Specification in a coarse grid

• The model for a coarse grid: multiplication of (*) with aggregation matrix CN n indicating which cells are aligned together

N - # of observations in a coarse grid n – # of observations in a fine grid

• - the mean process for random variables of the coarse grid Cμλ TNZZ ,...,1Z

1 2

1 3

2 4 6 8

75

T

NGau CNC0,~CθCθCXβCμ

NZNGau IλZ

2,~| λ

niGauY Yiii 1,...,,,~| 2

N0,~θθXβμ nGau,

Tn ,...,1μ

1 WDN -2

Page 6: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

6

Prediction in a fine grid

• The process μ underlying emission inventory is of our primary interest, with the optimal predictor given by E(μ|z).

• The joint distribution of (μ, Z)

which yield both the predictor and its error

• The joint distribution of (μ, Z) allows us to see the approach in analogy to block kriging.

T

T

NnGauCNCMCN

NCN

CXβ

Z

μ,~

zμμ |ˆ E zμσ2

μ |ˆ Var

Estimation

• The joint unconditional distribution of Z

where ,

• Maximum likelihood estimation based on the joint distribution of Z.

• Analytical solution for β, further maximisation performed numerically.

• Expected Fisher information matrix used to get standard errors of parameters.

T

NGau CNCMCXβZ ,~

NZ IM2 1

WDN -2

Page 7: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

7

Case study

• Livestock (cattle, pigs, horses etc.) data based on agricultural census 2010

• Disaggregation from 314 districts (powiaty) into 2171 municipalities (gminy) needed

• Only rural municipalities considered

→ For horses, data are available also in municipalities, which enabled verification of the method.

- Population

- Considered CORINE classes

• Pastures (231) • Complex cultivation patterns (242) • Principally agriculture, with natural

vegetation (243)

For each municipality, we calculate the area of these land use classes, that can be related to livestock farming.

Explanatory variables

Page 8: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

8

Fit model CAR Prediction in municipalities

VERIFICATION: Data on horses available in municipalities

Livestock data available in districts

Solely in proportion to population

Regression based on population & land use

No spatial effect

Fit model LM Prediction in municipalities

Fit model NAIVE Prediction in municipalities

Regression & spatial effect

Page 9: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

Results: Prediction for municipalities

9

Model CAR

NAIVE prediction – proportional to population

DATA

Page 10: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

Residuals from predicted values

di = yi – yi*

yi - data yi* - prediction

10

Model CAR NAIVE prediction

MSE Avg|di| Min(di) Max(di) r

CAR 3069.4 38.37 -275 469 0.784

Naive 3374.4 38.17 -475 403 0.766

LM 5641.2 51.28 -357 522 0.555

Page 11: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

Scatterplots of data vs. predictions

11

Model CAR NAIVE prediction

OB

SER

VA

TIO

NS

PREDICTIONS

OB

SER

VA

TIO

NS

PREDICTIONS

Page 12: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

12

l=1,…,L index regions, e.g. voivodships,

X* - block diagonal matrix of covariates Separate sets of regression coefficients and variance σ2

Y,l for each voivodship

NWD 1

-2

MSE Avg|di| Min(di) Max(di) r

CAR 3069.4 38.37 -275 469 0.784

CAR* 3124.9 38.99 -256 446 0.783

Naive 3374.4 38.17 -475 403 0.766

LM 5641.2 51.28 -357 522 0.555

Modification #1: Various regression models in regions

Page 13: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

Distributions of activity data (here: horses) are highly

right skewed → the assumption of normality should be

revised.

• log transformation

• truncated normal distribution

• trans-Gaussian kriging

• …

Potential approaches

However, none of the listed options support summation of random variables

→ this is required in the developed model of spatial scaling (aggregation matrix CN x n)

Modification #2: Accounting for data skeweness

13

Page 14: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

Closed skew normal (CSN) distribution

• Introducing skewness to the normal distribution, while the distribution is closed under

marginalisation and conditioning (Dominiguez-Molina et al. 2003)

• Density of multivariate CSN distribution:

where - standard normal pdf, - standard normal cdf

,;,;,,,,|, μyμyμy qpqp Kf

,,,,~ , μY qpCSN

,;01 T

q DDK p q

14

Page 15: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

Properties of closed skew normal distribution

• Closed under linear transformation (Gonzalez-Farias et al. 2004)

Let and An x p . Then

→ important for the disaggregation method

• Conditioning property → important for estimation (Gibbs sampler

within MCMC)

,,,,~ , μY qpCSN

AAAAqnCSNA ,,,,~ , μY

15

Page 16: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

We propose a novel approach for allocation of activity data to finer grids, conditional on

available covariate information.

Concluding remarks

16

Page 17: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

We propose a novel approach for allocation of activity data to finer grids, conditional on

available covariate information.

• Good results for livestock activity data of agricultural sector, but very limited e.g. in

residential sector (natural gas consumption in households)

The approach is applicable for AREA emission sources which are spatially correlated.

Concluding remarks

17

Page 18: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

We propose a novel approach for allocation of activity data to finer grids, conditional on

available covariate information.

• Good results for livestock activity data of agricultural sector, but very limited e.g. in

residential sector (natural gas consumption in households)

The approach is applicable for AREA emission sources which are spatially correlated.

• The method is feasible for disaggregation from districts to municipalities, but not

from voivodeships to municipalities.

Concluding remarks

18

Page 19: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

We propose a novel approach for allocation of activity data to finer grids, conditional on

available covariate information.

• Good results for livestock activity data of agricultural sector, but very limited e.g. in

residential sector (natural gas consumption in households)

The approach is applicable for AREA emission sources which are spatially correlated.

• The method is feasible for disaggregation from districts to municipalities, but not

from voivodeships to municipalities.

• Comparison with the naive (proportional) disaggregation:

In the case study, 9% improvement in terms of the mean squared error.

In general, it provides the assessment of the significance of regression coefficients

and uncertainty of calculated values.

Concluding remarks

19

Page 20: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

TAKE HOME MESSAGE:

A structure of dataset can give us an opportunity to develop an

improved / alternative modeling approach, and thus to provide a

better insight.

Page 21: Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew … · 2015. 12. 2. · Joanna Horabik-Pyzel, Nadia Charkovska, Olha Danylo, Zbigniew Nahorski, Rostyslav Bun 4th International

Thank you for your attention!

TAKE HOME MESSAGE:

A structure of dataset can give us an opportunity to develop an

improved / alternative modeling approach, and thus to provide a

better insight.