concept of data collection vincent scherrer junior adviser, system development entsog’s...
TRANSCRIPT
![Page 1: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/1.jpg)
Concept of Data Collection
Vincent ScherrerJunior Adviser, System Development
ENTSOG’s Transparency Workshop
Brussels – 11 September 2012
![Page 2: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/2.jpg)
2
Main goals of the project
Current Situation
Expected PDWS improvements
Conclusion
![Page 3: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/3.jpg)
3
Main goals of the project
Current Situation
Expected PDWS improvements
Conclusion
![Page 4: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/4.jpg)
4
Improve scope and qualityNew Transparency Guidelines> Binding publication> More relevant points (distribution systems, storages, production facilities...)> More data (physical flows, auction requests...)
More detailed ENTSOG deliverables> Demand breakdown (CCGT, final customers, industry)> More scenarios and cases> More accurate modelling
Upcoming tasks> Cost-benefit analysis> Gas quality
![Page 5: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/5.jpg)
5
Streamline the data collection processesData collection among members> Automation> Web-based interfaces> Eliminated redundancy> Warning system
ENTSOG internal data collection> Single repository of data> Versioning> User-friendly manual import mechanisms> More time for analysis and better deliverables
![Page 6: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/6.jpg)
6
Availability and openness
DataWarehouse TransparencyPlatform
Operational data
Future projects
Interruptions
TYNDP data
Auction results
Information should be meaningful, exploitable, and consistent
![Page 7: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/7.jpg)
7
Main goals of the project
Current Situation
Expected PDWS improvements
Conclusion
![Page 8: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/8.jpg)
8
Various data sources
Transparency TYNDP Forecast data
Infrastructure projects Other dataOutlook&Review
Historical data
System Development files
and databases
Transparency Platform/DB
TSOs TSOs TSOs Promoters Third parties (GSE, GLE, …)
Scattered environment, intensive treatment, insulated data
![Page 9: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/9.jpg)
9
Complex aggregation procedures
Balancing zones
Relevant points
System enhancem
ents
DemandSupply
Technical capacitiesFlows
(Re)Nominations
![Page 10: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/10.jpg)
10
Historical data analysisDetailed analysis of historical data and a comparison of multiple periods is a regular part of data processing
2008/2009 2009/2010 2010/2011 2011/2012 -
5,000
10,000
15,000
20,000
25,000
30,000
35,000
30 Jan - 14 FebAverage demand
Highest 16 dayAverage demand
Highest 16 daysPeak day demand
2008/2009 2009/2010 2010/2011 2011/20120%
10%
20%
30%
40%
50%
60%
70%
80%
UGS stock level 30 Jan.
![Page 11: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/11.jpg)
Understanding the data and changes to them is crucial
> Different calculation assumptions ?> Uploaded at different points in time ?> Unmatched system enhancements ?
11
Data quality issues
![Page 12: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/12.jpg)
12
Forecast vs Historical
> Data questionnaire corrupted ?
> Non-Standard Gross Calorific Value ?
> What to do ?
![Page 13: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/13.jpg)
13
Varying data from different data sources
Spread ?
![Page 14: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/14.jpg)
14
Main goals of the project
Current Situation
Expected PDWS improvements
Conclusion
![Page 15: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/15.jpg)
Manual data collection : Web-based
15
![Page 16: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/16.jpg)
16
Automated imports : Monitoring
Monitor the flow of messages> TSOs : direct access to the system, warning per mail ?> Detect an inform about odd values> Detect missing values> …
![Page 17: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/17.jpg)
17
Data consistency and data views
Quality control and good datawarehouse practices will enable us to look at the data from many different angles
> Entry flows in a country ?> Exit flows out of a country ?> Aggregated EU-27 demand> For a particular relevant point, what infrastructure projects are planned ?> Analyze cross-border flows and loads> What are the most congested cross-border connections ?> What happened during the 2012 cold snap ?> Maximal and minimal demand over the last 52 weeks for each country ? At the EU
level ?> What is the net demand per country on a daily basis ?> What are the planned infrastructure projects per country ? Per infrastructure type ?
![Page 18: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/18.jpg)
18
Data consistency : Infrastructure projects
Available as a Transparency Module> Different views but same data> Advanced search capabilities
![Page 19: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/19.jpg)
19
Data consistency : Different time scales
From day…
To month…
To year
![Page 20: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/20.jpg)
20
Odd values
Detect odd values with…> Fixed constraints> Comparison with the past> Check if missing> Comparison with previous versions of the same data
Treat odd values with…> Quarantine dubious values> Each value has a state> Associate with workflows (manual or automatic)
![Page 21: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/21.jpg)
21
Data availability
Excel
XML
RSS
Conform to best practices> Push and pull mechanisms
> Most common formats
> Flexible data sets
> Quantitative and qualitative analysis
![Page 22: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/22.jpg)
22
Export flexibility
1/01/2009 7/04/2009 12/07/2009 16/10/2009 20/01/2010 26/04/2010 31/07/2010 4/11/2010 8/02/2011 15/05/2011 19/08/2011 23/11/2011 27/02/2012
-2000
-1000
0
1000
2000
3000
4000
5000
6000
7000
signed - Zone Germany - Hub - Demand - Energy quantity - GWh/d - Historical-Historical Demand by TSOssigned - Zone Connection Supplier Norway - Hub Germany - Flow Import - Energy quantity - GWh/d - Historical-Historical Flows from imports sent by the TSOssigned - Zone Connection Storage Germany - Hub Germany - Flow Storage - Energy quantity - GWh/d - Historical-historical Flows from storages sent by the TSOssigned - Zone Connection Supplier Russia(Mainland) - Interconnector OPAL - Flow Import - Energy quantity - GWh/d - Historical-Historical Flows from imports sent by the TSOssigned - Zone Germany - NP Send-out - Flow National Production - Energy quantity - GWh/d - Historical-Historical Flows from national production sent by the TSOs
![Page 23: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/23.jpg)
23
Analysis
![Page 24: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/24.jpg)
24
AggregationLNG imports
Hub-to-Hub
![Page 25: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/25.jpg)
25
Main goals of the project
Current Situation
Expected PDWS improvements
Conclusion
![Page 26: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/26.jpg)
The new system will facilitate data collection and processing and should significantly improve ENTSOG’s ability to deliver reports such as TYNDP, Outlooks and reviews
> Comprehensive quality control...
> Drastically expanded analysis possibilitiesfor ENTSOG, members, stakeholders, 3rd parties…
> Flexible data extracts and reports…
> Better deliverables from ENTSOG...
26
Benefits
Sound technical basis to face current and future
Transparency Requirements
![Page 27: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/27.jpg)
27
Do you have any questions ?
![Page 28: Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012](https://reader030.vdocument.in/reader030/viewer/2022032722/56649ce35503460f949ae63d/html5/thumbnails/28.jpg)
Thank You for Your Attention
ENTSOG -- European Network of Transmission System Operators for GasAvenue de Cortenbergh 100, B-1000 Brussels
EML:WWW: www.entsog.eu
Vincent ScherrerJunior Adviser