Project OverviewGridPP Storage

J JensenGridPP storage workshop

RHUL, April 2010

Strategic View

“The GridPP storage group will provide and support storage middleware necessary and sufficient to

Grid-enable storage at every GridPP site.”

Strategic view needs to change

(GridPP3) Goals

1. Storage Element interfaces (SRM+GridFTP+IS)1. GridFTP performance2. IS accuracy

2. Deployment/upgrade/maintenance/ debugging

3. Standards compliance, interoperable4. Usable storage

Things to Ponder for Workshop

SRM

xfer, access, info

disks

Dist’d filesystemsOperations, catalogues, security, testing

Things to Ponder for the Workshop

• GridPP3 still has ~1yr to go

Last workshop – July 2009

• Configuration/deployment revisited– cfengine, Quattor, puppet

• Procurement, monitoring• STEP outcome reviewed – we did OK– Are we still doing OK…?

• Hammercloud

– Old chestnuts: space alloc. and pledges, accurate publishing, ACLs, bottlenecks, networks, dark data, file://, load balancing, pool draining, stability

– New chestnuts: hot files

Last workshop – July 2009

• Future stuff: filesystems, virtualisation– ext4, ZFS

• Distributed filesystems (or “filesystems”)– Lustre, NFS4, GPFS, AFS, Hadoop, xrootd

• Integration of monitoring?• Planning for investing, procurements

How does it fit

Real Work™:Testing,

Deploying, Operating

Management:Strategy,

Deliverables, Planning, Risks

Us and Them

us

them

them

them

Us and Them

usexpts

users

mgmt wlcg

NGI

sites/IT

So finally

• Thank you for coming• Have a nice and productive workshop