status of data repository/dss development/dataprepworkshop_23-2… · fmp, statistics, reports etc...
TRANSCRIPT
![Page 1: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/1.jpg)
1
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
STATUS OF DATA REPOSITORY/DSS DEVELOPMENT
Yann LAURENT ([email protected] )
![Page 2: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/2.jpg)
2
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
1. Introduction to DSS
2. Existing Reporting System
3. Building a DSS
Plan
![Page 3: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/3.jpg)
3
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
Introduction to DSS
Introduction to Data Repository and Decision Support System
![Page 4: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/4.jpg)
4
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
One key outcome of the CLME + project is the DSS: decision support system
• The DSS is the repository of all information, data and document to support decision making in EAF approach
• Outcomes of the CLME + FAO sub-project are expected to feedthe DSS.
• In the project, implementation of the DSS is the output of the activity O3.2.2.3.PI1 with
• (Milestone A) Repository/DSS designed to provide updated information useful for EAF-based fisheries management, by Year 2;
• (Target) Repository/DSS (infra)structure in place, with sustainable hosting & maintenance solution, by Year 2.5
Introduction to DSS
![Page 5: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/5.jpg)
5
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
In the CLME + FAO subproject, the following information or data are expected to accessible from the DSS
• Integrated national fishing vessel registry information included in the Global Record of Fishing Vessels, with services tailored for and accessible from the DSS (O3.2.2.1.T.PI3 )
• Repository/DSS designed to provide Information useful for EAF-based fisheries management (O3.2.2.3.PI1 ):
• Information in support to fisheries management (document resources on FMP, statistics, reports etc…)
• Information in support to stock assessment (stock status reports, statistics and data, methodologies etc…)
• Links to external sources of information
• More ?
Introduction to DSS
![Page 6: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/6.jpg)
6
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
In practical, what is the DSS and which types of information can be expected to be found once implemented
• Stocks and fisheries information:• Inventories
• Stocks status
• Regional vessel registries information
• National and regional statistics
• An organized repository of
documents
What do we have already ?
Introduction to DSS
FAO GLOBAL RECORD
WECAFC Regional
Database (RDB)
FIRMS
iMarine VRE
![Page 7: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/7.jpg)
7
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
DSS: need for data access and sharing policies
• DSS is an entry point to the existing information
➔ Need to define WHO has access to WHAT
• Output 1.3: Sub-regional data policy to support EAF management of the fishery
• Definition of data access and sharing policies: public data Vs confidential data :If access is restricted (individual data for stock assessment computation for instance), need to define who can authorized a user to access this information
• See the WECAFC Data Collection Reference Framework for data access and sharing policies in the region
Introduction to DSS
![Page 8: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/8.jpg)
8
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
Existing tools
Existing systems for data and information dissemination
![Page 9: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/9.jpg)
9
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
DSS: more insight on existing dissemination system
• FIRMS for inventories sharing
• WECAFC Regional database for data and statistics sharing
• Global vessel record to host regional vessel record
• iMarine VRE for training on stock assessment
• iMarine VRE for documents sharing
Existing tools
![Page 10: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/10.jpg)
10
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
DSS: more insight on existing dissemination system
• FIRMS for inventories sharing : see previous presentation !
• WECAFC Regional database for data and statistics sharing
• Global vessel record to host regional vessel record
• iMarine VRE for training on stock assessment
• iMarine VRE for documents sharing
Existing tools
![Page 11: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/11.jpg)
11
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
DSS: more insight on existing dissemination system
• FIRMS for inventories sharing
• WECAFC Regional database for data and statistics sharing
• Global vessel record to host regional vessel record
• iMarine VRE for training on stock assessment
• iMarine VRE for documents sharing
Existing tools
![Page 12: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/12.jpg)
12
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
• Development of the WECAFC Regional database:
• The definition of minimum data requirements for reporting: Data collection Reference Framework DCRF
• A series of tools developed under the BlueBRIDGE project (EU funded) to support reporting:
• A simple tool for the regional data manager
to create data calls based on the DCRF
• A user-friendly tool based on Excel to
help the national data manager to report to WECAFC
Building a RDB
![Page 13: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/13.jpg)
13
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
Simplifying reporting to regional organization
• WECAFC Regional database: Regional Data Manager
Building a RDB
iMarine Tabular Data Manager
![Page 14: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/14.jpg)
14
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
Simplifying reporting to regional organization
• WECAFC Regional database: Regional Data Manager
Building a RDB
iMarine Tabular Data Manager
Template creation
A DSD is created
![Page 15: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/15.jpg)
15
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
Simplifying reporting to regional organization
• WECAFC Regional database: Regional Data Manager
Building a RDB
iMarine Regional database administration
Creation of data calls
Based on the DSD
Importing the DSD
Creating the collection (data call)
Ready to be used by the national data manager
![Page 16: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/16.jpg)
16
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
Simplifying reporting to regional organization
• WECAFC Regional database: National Data Manager
Building a RDB
Install an iMarine plugin in Excel
Validation services (web services; no macro)
![Page 17: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/17.jpg)
17
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
Simplifying reporting to regional organization
• WECAFC Regional database: National Data Manager
Building a RDB
Will use his Excel to fill out the form
Ready for submission !
![Page 18: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/18.jpg)
18
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
Simplifying reporting to regional organization
• WECAFC Regional database: Back to Regional Data Manager
Building a RDB
iMarine Regional database administration
Review of submitted data and final validation
![Page 19: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/19.jpg)
19
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
Simplifying reporting to regional organization
• WECAFC Regional database: A data viewer and query
Only possible if WECAFC data and metadata are harmonized and standardized !
Building a RDB
![Page 20: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/20.jpg)
20
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
DSS: more insight on existing dissemination system
• FIRMS for inventories sharing
• WECAFC Regional database for data and statistics sharing
• Global vessel record to host regional vessel record
• iMarine VRE for training on stock assessment
• iMarine VRE for documents sharing
Existing tools
![Page 21: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/21.jpg)
21
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
Regional vessel record
• This work is under going by the joint WECACF-CRFM-OSPESCA working group on IUU
• Two meetings were held since its creation: define minimum data requirement to uniquely identify a vessel across the regional (Unique Vessel Identifier) and to build a regional vessel record (list of minimum information to be reported for a vessel)
• Technical solution to host the regional record: possibly the FAO Global record (see http://www.fao.org/global-record/information-system/en/)
Existing tools
![Page 22: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/22.jpg)
22
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
DSS: more insight on existing dissemination system
• FIRMS for inventories sharing
• WECAFC Regional database for data and statistics sharing
• Global vessel record to host regional vessel record
• iMarine VRE for training on stock assessment
• iMarine VRE for documents sharing
Existing tools
![Page 23: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/23.jpg)
23
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
iMarine VRE for training on stock assessment
iMarine is a EU based e-infrastructure aiming at “supporting the implementation of the Ecosystem Approach to fisheries management and the conservation of living marine resources.”
The infrastructure provides a certain number of facilities (VRE) containing different types of services (data collation, data curation, data processing, data dissemination) based on standards for data and metadata (SDMX, OGC etc..)
Existing tools
![Page 24: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/24.jpg)
24
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
iMarine VRE for training on stock assessment
One VRE is the WECAFC-FIRMS VRE from which resources are accessible to deliver training on stock assessment:
Data upload
R script upload
Existing tools
Data processing
Student
![Page 25: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/25.jpg)
25
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
DSS: more insight on existing dissemination system
• FIRMS for inventories sharing
• WECAFC Regional database for data and statistics sharing
• Global vessel record to host regional vessel record
• iMarine VRE for training on stock assessement
• iMarine VRE for documents sharing
Existing tools
![Page 26: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/26.jpg)
26
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
iMarine VRE for documents sharing
Existing tools
![Page 27: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/27.jpg)
27
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
Building a DSS
Building a DSS for CLME + FAO sub project
![Page 28: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/28.jpg)
28
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
iMarine VRE for CLME+
An iMarine VRE will be created.
Users already registered in the system as national data manager for the WECAFC RDB can be granted access to this VRE
• Data and sharing policies are already in place in the iMarineinfrastructure: access is strictly controlled
• National and regional data already uploaded in the WECAFC RDB can be shared
• The VRE repository can be used to share any type of information (doc, pdf, images, data)
• Existing components in the infrastructure can be added
Building a DSS
![Page 29: STATUS OF DATA REPOSITORY/DSS DEVELOPMENT/DataPrepWorkshop_23-2… · FMP, statistics, reports etc ... Review of submitted data and final validation. 19 Data Preparation Workshop](https://reader034.vdocument.in/reader034/viewer/2022050214/5f606d6ccdab451b404bbbb5/html5/thumbnails/29.jpg)
29
Data Preparation Workshop - Shrimp and Groundfish Fisheries Barbados, 23-25 October 2018
Thank you for your attention