irods workshop, september 26-28 2012, linköping (sweden) irods workshop users needs summary agnès...

12
IRODS workshop, September 26-28 2012 , Linköping (Sweden) iRODS Workshop users needs summary Agnès Ansari – [email protected]

Upload: garey-lindsey

Post on 02-Jan-2016

215 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: IRODS workshop, September 26-28 2012, Linköping (Sweden) iRODS Workshop users needs summary Agnès Ansari – agnes.ansari@idris.fr Wednesday, 26 September

IRODS workshop, September 26-28 2012 , Linköping (Sweden)

iRODS Workshop users needs summary

Agnès Ansari – [email protected]

Page 2: IRODS workshop, September 26-28 2012, Linköping (Sweden) iRODS Workshop users needs summary Agnès Ansari – agnes.ansari@idris.fr Wednesday, 26 September

2

NEEDS AND REQUIREMENTS SUMMARY

• Information from the different talks we had and from the discussion

We discussed:• Users needs• Community needs• PRACE-EUDAT collaboration

Page 3: IRODS workshop, September 26-28 2012, Linköping (Sweden) iRODS Workshop users needs summary Agnès Ansari – agnes.ansari@idris.fr Wednesday, 26 September

3

SHARING (1)

Between: • multiple users of a group• multiple users of different groups• multiple users groups• multiple users of one community• users of several communities (interdisciplinary

projects)• National and international levels

Access rights on files are needed

Page 4: IRODS workshop, September 26-28 2012, Linköping (Sweden) iRODS Workshop users needs summary Agnès Ansari – agnes.ansari@idris.fr Wednesday, 26 September

4

SHARING (2)

Global sharing: Data can be publicly available

• Within a single site• Within multiple sites• At the national level

Page 5: IRODS workshop, September 26-28 2012, Linköping (Sweden) iRODS Workshop users needs summary Agnès Ansari – agnes.ansari@idris.fr Wednesday, 26 September

5

PRESERVATION

• There is a need for• long term preservation• mid term preservation• meta data have also to be taken into account

In case of long term preservation, a migration plan has to be planned.

Page 6: IRODS workshop, September 26-28 2012, Linköping (Sweden) iRODS Workshop users needs summary Agnès Ansari – agnes.ansari@idris.fr Wednesday, 26 September

6

DATA TRANSFER

• To/from file system• To/from mass storage system• To/from data base• From middleware (Ireland)

Page 7: IRODS workshop, September 26-28 2012, Linköping (Sweden) iRODS Workshop users needs summary Agnès Ansari – agnes.ansari@idris.fr Wednesday, 26 September

7

REPLICATION

• Needed for data security• Single site replication policy• Multi-sites replication policy• No replication policy• meta data have also to be taken into account

Page 8: IRODS workshop, September 26-28 2012, Linköping (Sweden) iRODS Workshop users needs summary Agnès Ansari – agnes.ansari@idris.fr Wednesday, 26 September

8

METADATA SET/SEARCH CAPABILITY

• Often needed for sharing between communities

Page 9: IRODS workshop, September 26-28 2012, Linköping (Sweden) iRODS Workshop users needs summary Agnès Ansari – agnes.ansari@idris.fr Wednesday, 26 September

9

PUBLICATION

• There is a need for data publication (data publicly available) • Sensitive data has to be considered where some restrictions on publication has to be set

Page 10: IRODS workshop, September 26-28 2012, Linköping (Sweden) iRODS Workshop users needs summary Agnès Ansari – agnes.ansari@idris.fr Wednesday, 26 September

10

DATA MINING AND WORKFLOW

• The is a need to search for data • Can be done using meta data

Page 11: IRODS workshop, September 26-28 2012, Linköping (Sweden) iRODS Workshop users needs summary Agnès Ansari – agnes.ansari@idris.fr Wednesday, 26 September

11

EUDAT Collaboration:

• Some EUDAT Communities (EPOS, VPH) manifested their interest in staging data onto and from PRACE resources. • PRACE users could be provided with the possibility to deposit their results into EUDAT storage and request EUDAT to preserve them.

Page 12: IRODS workshop, September 26-28 2012, Linköping (Sweden) iRODS Workshop users needs summary Agnès Ansari – agnes.ansari@idris.fr Wednesday, 26 September

12

VOLUME

• Overall volume for the biggest project > 100TB