safe replication and data staging core services of the eudat cdi johannes reetz, rzg 2nd eudat...
TRANSCRIPT
![Page 1: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/1.jpg)
Safe Replication and Data StagingCore Services of the EUDAT CDI
Johannes Reetz, RZG
2nd EUDAT conference
Rome, 29 Oct 2013
![Page 2: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/2.jpg)
2
![Page 3: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/3.jpg)
domain of registered data
individual value
preservationacquisitiongenerationdescription
enrichmentprocessingreductionanalysis
Data Stage-Out
publication
Safe Replication
community valueDat
a Sta
ge-In
society value
IdentifierService
EPIC Handle PID
![Page 4: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/4.jpg)
4
Replication from repositories to data storages in different administrative domains
• (long-term) archiving and preservation
• optimize access for users from different regions
• bring data closer to powerful computers for data analytics
Typical policies triggered by Community Data Managers:• Replicate collection X from my repository to data centres A and B• Store the replica safely for N years• Check the integrity of the replica every M years
![Page 5: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/5.jpg)
5
Transferring data from EUDAT storages to compute facilities
• reliable, efficient, easy-to-use tools to manage data transfers
• ingest data into the EUDAT domain of registered data
![Page 6: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/6.jpg)
Each data centre (administrative domain) has a dedicated Handle namespace (prefix)
replica storages
repositories
6
EPICHandleService
http://cmon.eudat.eu
EPICHandleService
enabled EUDAT sites
![Page 7: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/7.jpg)
replica storages
repositories
7
http://cmon.eudat.eu
EPICHandleService
GridFTP
![Page 8: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/8.jpg)
8
CLARIN (MPI-PL/TLA)production
![Page 9: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/9.jpg)
9
CLARIN (EKUT)production
![Page 10: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/10.jpg)
10
CLARIN (CUNI/LINDAT)production
![Page 11: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/11.jpg)
ENES (DKRZ/CMIP5)
11
production
![Page 12: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/12.jpg)
12
EPOS (INGV)production
![Page 13: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/13.jpg)
13
VPH (UCL)production
![Page 14: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/14.jpg)
14
EPOS (ORPHEUS/ KNMI)work in progress
![Page 15: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/15.jpg)
15
INCF (KTH)work in progress
![Page 16: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/16.jpg)
16
DiXa (EBI)work in progress
![Page 17: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/17.jpg)
Track 1 – Agenda – Session 1 17
14:00: B2SAFE and B2STAGE: Core Services of the EUDAT CDI, Johannes Reetz
14:10: B2SAFE adoption in the EPOS community, Claudio Cacciari
14:25: B2SAFE for Replicating Linguistic Resources, Willem Elbers
14:40: B2SAFE Setup with a Dspace Repository, Pavel Stranak
14:55: VPH and the Biomedical Scientific Case for EUDAT, Peter Coveney
15:10: Community integrated B2STAGE tools, Stefan Zasada/Giuseppe Fiameni
15:35: B2SAFE Practical Policies, Willem Elbers
15:45: B2SAFE Data Policy Manager, Maria Francesca Iozzi
Track 1 – Agenda – Session 1
use cases in production
![Page 18: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/18.jpg)
Track 1 – Agenda – Session 1 18
14:00: B2SAFE and B2STAGE: Core Services of the EUDAT CDI, Johannes Reetz
14:10: B2SAFE adoption in the EPOS community, Claudio Cacciari
14:25: B2SAFE for Replicating Linguistic Resources, Willem Elbers
14:40: B2SAFE Setup with a Dspace Repository, Pavel Stranak
14:55: VPH and the Biomedical Scientific Case for EUDAT, Peter Coveney
15:10: Community integrated B2STAGE tools, Stefan Zasada/Giuseppe Fiameni
15:35: B2SAFE Practical Policies, Willem Elbers
15:45: B2SAFE Data Policy Manager, Maria Francesca Iozzi
use case in production
![Page 19: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/19.jpg)
Track 1 – Agenda – Session 1 19
14:00: B2SAFE and B2STAGE: Core Services of the EUDAT CDI, Johannes Reetz
14:10: B2SAFE adoption in the EPOS community, Claudio Cacciari
14:25: B2SAFE for Replicating Linguistic Resources, Willem Elbers
14:40: B2SAFE Setup with a Dspace Repository, Pavel Stranak
14:55: VPH and the Biomedical Scientific Case for EUDAT, Peter Coveney
15:10: Community integrated B2STAGE tools, Stefan Zasada/Giuseppe Fiameni
15:35: B2SAFE Practical Policies, Willem Elbers
15:45: B2SAFE Data Policy Manager, Maria Francesca Iozzi
Track 1 – Agenda – Session 1
practical policies and policy management
![Page 20: Safe Replication and Data Staging Core Services of the EUDAT CDI Johannes Reetz, RZG 2nd EUDAT conference Rome, 29 Oct 2013](https://reader038.vdocument.in/reader038/viewer/2022110304/551c2914550346a84f8b5f6a/html5/thumbnails/20.jpg)
Johannes Reetz RZG / MPG
Claudio Cacciari CINECA
Willem ElbersMax-Planck-Institute for Psycholinguistics
Pavel StranakCharles University
Peter CoveneyUniversity College London
Stefan Zasada University College London
Giuseppe FiameniCINECA
Maria Francesca Iozzi SIGMA/University of Oslo
SAFE REPLICATION AND DATA STAGING - Speakers
20