Download - Data Standards Workflow
Data Standards Workflow
Raw data Scripts Database
Store raw data in subversion to
keep track of history
Stored files (netcdf)
accessible through the web
Extract Transform Load
Charts & Maps
Tools and websites
Provide
Add meta information
Script to convert raw data into
netcdf
OpenEarthRawData
OpenEarth
OPeNDAP
OpenEarthTools
Data Standards Workflow
Raw data Scripts Database
Store raw data in subversion to
keep track of history
Stored files (netcdf)
accessible through the web
Extract Transform Load
Charts & Maps
Tools and websites
Provide
Add meta information
Script to convert raw data into
netcdf
OpenEarthRawData
OpenEarth
OPeNDAP
OpenEarthTools
Extract
• subversion• storing raw data
Subversion• Remote file server• Work on local copy• Track changes
Subversion server
Local copy
checkout update commit
Delete
Add
Copy
Extract
Procedure
Subversion server
Local copy
checkout updatecommit
Delete
Add
Copy
Procedure: check outExtract – storing raw data
• Checkout the directory (i.e. create local copy) • https://repos.deltares.nl/repos/OpenEarthRawData/course
• Right mouse click (RMC) for Tortoise menu
D:\data\micore
https://repos.deltares.nl/repos/OpenEarthRawData/course
Extract – storing raw data
Procedure: check out
Subversion server
Local copy
checkout updatecommit
Delete
Add
Copy
Procedure: addExtract – storing raw data
Add a directory for your data
• branches/• tags/• trunk/
• organization/• datasetname
• cache/• raw/• scripts/• inspire_description.xml
• course• Pc number/
• cache/• raw/
• transect.txt• scripts/• inspire_description.xml
Allows for use of authorization
We’re working under course today. Add your pc directory
You can store your data here, after the course
We’ll make this file later
Get this file from:OpenEarthRawData\course\example\raw
Extract – storing raw data
• Add the pcname directory to your local subversion copy
Extract – storing raw data
Procedure: add
Subversion server
Local copy
checkout updatecommit
Delete
Add
Copy
Procedure: commitExtract – storing raw data
• RMC for Tortoise menu• Commit your local changes. Changes will be sent
to server.Some useful message here
Extract – storing raw data
Procedure: commit
Subversion• Remote file server• Work on local copy• Track changes
Subversion server
Local copy
checkout update commit
Delete
Add
Copy
Extract - summary
Procedure
