(ons) seasonal adjustment in official statistics claudia annoni office for national statistics
Post on 15-Jan-2016
222 views
TRANSCRIPT
![Page 1: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/1.jpg)
Seasonal Adjustment in
Official Statistics
Claudia Annoni
Office for National Statistics
![Page 2: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/2.jpg)
Seasonally Adjusted Outputs
• Approximately 50 subject areas across the GSS• Several thousand monthly and quarterly series
Includes:
- Economic (National Accounts, Prices, Business Statistics)
- Socio-economic (Labour Market, Tourism, Transport)
- Demographic (Births, Deaths, Marriages)
![Page 3: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/3.jpg)
Organisation
• Time Series Analysis Branch (MG, ONS)
• Statisticians responsible for datasets across the GSS
• Bank of England
![Page 4: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/4.jpg)
The International Scene
• Other NSIs
• Eurostat - would like to see greater harmonisation
• ECB
• Developers of Methods (e.g. US Bureau, Bank of Spain)
![Page 5: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/5.jpg)
Standard Method for ONS
• Cross-departmental GSS Task Force set up in 1995
• Report and recommendations accepted by GSS(M) in 1996
• X11ARIMA adopted as the standard method
![Page 6: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/6.jpg)
Definition of Seasonal Adjustment
Seasonal adjustment is the process of
removing the variations associated with
the time of year or the arrangement of the
calendar
![Page 7: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/7.jpg)
X11Seasonal Adjustment
Procedure
![Page 8: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/8.jpg)
History• 1954: X=0: first computerised seasonal adjustment program
(X=eXperimental)
• 1965: X-11 (US Bureau of Census)
Main Advantages:
- robust adjustment from extreme value treatment
- several seasonal and trend filters, also for ends of the time series, with filter selection method
- trading day regression
Main Criticisms:
- low quality of the asymmetric filters at the end of the time series
- limited filter choices
- many ad hoc criteria and diagnostics
- possibly too few filters
![Page 9: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/9.jpg)
Procedure Retail Sales in non-specialised stores -predominantly foods
• Original Series (Y = C x S x I )
• Moving average applied to Y gives preliminary estimate of C
• Divide Y by C to leave S x I
• Outliers are identified and replaced in the seasonal and irregular series ( S x I )
• Moving average applied to the modified S x I series gives S
• Dividing Y by S gives a preliminary seasonally adjusted series (SA1)
• Henderson moving average applied to SA1 gives a better trend estimate
REPEAT....................
![Page 10: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/10.jpg)
Orginal Series
60
70
80
90
100
110
120
130
140
150
Jan-91 Jan-92 Jan-93 Jan-94 Jan-95 Jan-96 Jan-97 Jan-98 Jan-99
![Page 11: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/11.jpg)
Trend Cycle
60
70
80
90
100
110
120
130
140
150
Jul-91 Jul-92 Jul-93 Jul-94 Jul-95 Jul-96 Jul-97 Jul-98
![Page 12: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/12.jpg)
Preliminary estimation of the unmodified SI Ratios
60
70
80
90
100
110
120
130
140
150
Jul-91 Jul-92 Jul-93 Jul-94 Jul-95 Jul-96 Jul-97 Jul-98
![Page 13: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/13.jpg)
January SI Graph
92
93
94
95
96
97
98
99
100
101
1992 1993 1994 1995 1996 1997 1998 1999
![Page 14: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/14.jpg)
January SI Graph with Replacement values
92
93
94
95
96
97
98
99
100
101
1992 1993 1994 1995 1996 1997 1998 1999
![Page 15: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/15.jpg)
January SI Graph with Outliers Replaced
92
93
94
95
96
97
98
99
100
101
1992 1993 1994 1995 1996 1997 1998 1999
![Page 16: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/16.jpg)
Seasonal Factors
60
70
80
90
100
110
120
130
140
150
Jan-91 Jan-92 Jan-93 Jan-94 Jan-95 Jan-96 Jan-97 Jan-98 Jan-99
![Page 17: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/17.jpg)
Estimation of the Seasonally adjusted Series (SA1)
60
70
80
90
100
110
120
130
140
150
Jan-91 Jan-92 Jan-93 Jan-94 Jan-95 Jan-96 Jan-97 Jan-98 Jan-99
![Page 18: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/18.jpg)
Estimation of the Henderson Trend Cycle
60
70
80
90
100
110
120
130
140
150
Jan-91 Jan-92 Jan-93 Jan-94 Jan-95 Jan-96 Jan-97 Jan-98 Jan-99
![Page 19: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/19.jpg)
Outlier Indentification and Weighting
0
0.2
0.4
0.6
0.8
1
1.2
0 0.5 1 1.5 2 2.5 3 3.5 4
Standard Deviations from expected value
Wei
gh
t g
iven
to
po
int
![Page 20: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/20.jpg)
I/S Ratio to select moving averages
X11ARIMA uses the global I/S ratio to select the length of seasonal moving average
I/S < 2.5 3x3 moving average
2.5< I/S < 3.5 recalculate I/S after removing 1year of data
3.5< I/S < 5.5 3x5 moving average
5.5< I/S < 6.5 recalculate I/S after removing 1 year of data
I/S > 6.5 3x9 moving average
![Page 21: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/21.jpg)
I/C Ratio to select moving averages
X11ARIMA uses the global I/C ratio to select the length of trend cycle moving average
I/C < 0.99 9-Term Henderson (5-Term for quarterly)
I/C < 3.49 13-Term Henderson (5-Term for quarterly)
I/C > 3.50 23-Term Henderson (7-Term for Quarterly)
![Page 22: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/22.jpg)
History (…continued)• 1980 X11ARIMA (Statistics CANADA)
Main Advantages:
- higher quality at the end of the time series due to ARIMA extension of the time series
- systemised quality measures (M1 to M11,Q)
- options and diagnostics for indirect and direct seasonal adjustment of aggregated series from component series
Limitations:
- ARIMA modelling not robust against outliers
- Seasonal adjustment not robust against level shifts
![Page 23: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/23.jpg)
ARIMA Modelling
• Models the series assuming that each observation is dependent on past observations
• It allows X11ARIMA to forecast up to three years and backcast one year of data.
• It reduces the size of revisions when new data is added
![Page 24: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/24.jpg)
Automatic ARIMA Modelling
• Models are automatically chosen by the programme using the following order:
(0,1,1) (0,1,1)
(0,1,2) (0,1,1)
(2,1,0) (0,1,1)
(0,2,2) (0,1,1)
(2,1,2) (0,1,1)
![Page 25: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/25.jpg)
Statistics
A model is fitted to the data when:
• Average percentage error in the forecast must be less than 15%
• Chi-Sq. probability must be over 5%
• R-squared value close to 1
• Estimated parameters must not be near 1.00
![Page 26: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/26.jpg)
Consumer Expenditure of BeerJan 1986 - Dec 1997
1700
2200
2700
3200
3700
4200
4700
Jan 86 Jan 87 Jan 88 Jan 89 Jan 90 Jan 91 Jan 92 Jan 93 Jan 94 Jan 95 Jan 96 Jan 97
![Page 27: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/27.jpg)
Short Series
• 3 years for any sort of seasonal adjustment• 5 years to fit an ARIMA model• 5 to automatically select a seasonal moving
average• 5 whole years to constrain to annual totals
Up to 8 - 12 years if possible
Too much data: Out of date information
Too little data : Not enough information
![Page 28: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/28.jpg)
Non- Calendar Data• X11ARIMA is designed to adjust data recorded on a
monthly or quarterly basis• The adjustment may be improved by prior adjusting• Important if statistical months are not the same each
year - moving holidays may include August Bank Holiday and Christmas
• Calenderisation is the process of shifting values from the start or end of the period to the appropriate month - to do this need to know trading day patterns ( i.e. no production on a Sunday)
![Page 29: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/29.jpg)
Aggregate Series
Assume series A, B,C,D are totalled such that aggregate series E = A+B+C+D
To seasonally adjust the aggregate series you have two choices
INDIRECT: SA( aggregate) SA(A)+SA(B)+SA(C)+SA(D)
or
DIRECT
SA(aggregate)=SA(E)
IF ABCD have similar seasonal patterns - DIRECT
IF ABCD have different seasonal patterns - INDIRECT
Note: if you use the direct approach there are additional steps to ensure that the series adds up.
![Page 30: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/30.jpg)
Revisions Policy
• Follow any relevant policy• Revise the seasonal adjustment if the raw data is
revised• Major revisions are the last month/quarter and the
month/quarter of the previous year ago• If constraining to annual totals then must revise all
of any whole year• Revise the seasonal adjustment if revise original
data
![Page 31: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/31.jpg)
X12ARIMA(D Findlay, US bureau of the Census)
• Pre-modelling (REGARIMA)
• More filters
• More diagnostics and graphing facilities
![Page 32: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/32.jpg)
X12ARIMA(D Findlay, US bureau of the Census)
RegARIMA Models(Forecasts, Backcasts,
Preadjustments)
Modeling and ModelComparisonDiagnostics
Enhanced X-11 SeasonalAdjustment
Seasonal AdjustmentDiagnostics
![Page 33: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/33.jpg)
REGARIMA
model ARIMAan is
etc.) components
calendar effects,(outlier regressors fixed ofmatrix a is
vectorparameter a is
modelled, be toseries theisWhen
t
t
t
t
tttt
![Page 34: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/34.jpg)
TRAMO SEATS(A Maravell, Bank of Spain)
• TRAMO - similar to REGARIMA
• SEATS - decomposes the ARIMA model fitted in TRAMO to perform the decomposition
• Components estimated using Wiener-Kolmogorov filter
![Page 35: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/35.jpg)
STAMP(A Harvey, LSE/Cambridge)
• Structural time series model
• Components estimated using the Kalman filter
• Includes some multivariate time series functions
![Page 36: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/36.jpg)
Advantages of Model Based Methods
• Infinite range of filters
• Assumptions made explicit
• Facilitate inference about time series
• Future extension to multivariate approaches possible
![Page 37: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/37.jpg)
Advantages of Model Based Methods
Provides analytical framework for answering questions such as:
- With what error is seasonality measured?
- How is this error carried through to growth rates?
- How are errors smoothed by averaging over several months?
- Should we use the trend or the seasoanally adjusted series for short-term monitoring?
- Is there significant evidence of a turning point?
![Page 38: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/38.jpg)
Disadvantages of Model Based Methods
• Software underdeveloped
• TRAMO SEATS not user friendly, lacks diagnostics and is poorly supported
• STAMP does not reflect the needs of producers of official statistics (e.g. no calendar adjustments)
• neither method handles seasonal heteroskedasticity
![Page 39: (ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics](https://reader031.vdocument.in/reader031/viewer/2022012914/56649d4a5503460f94a2709c/html5/thumbnails/39.jpg)
The Future
• National Statistics move to X12ARIMA
• Further development of model based methods
• Synthesis of X12ARIMA and TRAMO SEATS
• Longer-term: development of structural model based approaches, including multivariate seasonal adjustment