John BentCondor, WiND projects

UW-Madison

NeST: Network StorageFlexible Commodity Storage

Appliances

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

New worlds, new promises

› The grid has transformed dist comp

› Multiple LANS have merged

› Confederations of auto admin domains

› Possibilities for resource and data sharing abound

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

New worlds, new problems

› Interoperability between domains

› Management of resources more important

› Discovery of resources more difficult

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

Enter NeST

› Traditional file servers have not evolved NeST is a 2nd gen file server

› Flexible storage appliance for the grid Provides local and remote access to data Easy management of storage resources

› User level sw turns machines into storage apps Deployable and portable

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

Research meets production

› NeST exists at an exciting intersection

› Freedom to pursue academic curiosities

› Opportunities to discover real user concerns

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

Very exciting intersection

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

Very exciting intersection

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

Outline

› Introduction

› Interoperability

› Resource management

› Questions?

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

Multi-protocol support

› Interoperability between admin domains› NeST currently speaks

Grid FTP and FTP HTTP NFS (beta) Chirp

› Designed for integration of new protocols

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

Why not JBOS?

› Just a bunch of servers has limitations

› NeST advantages over JBOS: Single config and admin interface Optimizations across multiple protocols

• e.g. cache aware scheduling

Management and control of protocols• e.g. prefer local users to remote users

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

Dangerous migrations

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

Wasted migrations

› Wasted migrations are more expensive

› Distant resources are a mixed blessingGreat opportunitiesPossibility for great waste

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

Full migration support

› NeST makes storage schedulable and reservable

› NeST allows creation of dynamic users Too expensive to create all accounts everywhere Sharing is insecure and makes accounting

difficult

› NeST has lots Reservations of time and space

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

Three way matching

MachineMachine NeSTJob

JobAd

MachineAd

StorageAd

matc

h

Refers toNearestStorage.

Knows whereNearestStorage is.

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

Three way ClassAdsType = “job”TargetType = “machine”Cmd = “sim.exe”Owner = “thain”Requirements = (OpSys==“linux”) && NearestStorage.HasCMSData

Job ClassAd

Type = “machine”TargetType = “job”OpSys = “linux”Requirements = (Owner==“thain”)NearestStorage = ( Name = “turkey”) && (Type==“Storage”)

Machine ClassAd

Type = “storage”Name = “turkey.cs.wisc.edu”HasCMSData = trueCMSDataPath = /cmsdata”

Storage ClassAd

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

Conclusions

› User level sw turns machines into storage appliances

› Single admin interface across multiple protocols

› Participates in resource discovery› Management of space and

transfers

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

For more information

› http://www.cs.wisc.edu/condor/nest Version 0.9 now available (linux only, no NFS) Solaris and NFS coming soon Requests welcome

› People John Bent, Nick Leroy, Alain Roy, Joseph Stanley Miron Livny, Andrea Arpaci-Dusseau, Remzi Arpaci-Dusseau

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

Dispatcher

Transfer MgrConcurrencies

Storage Mgr

Control flow

Datal flow

Chirp FTP Grid ftp NFS

Common protocol layer

HTTP

Physical network layer

Physical storage layer

Design structure

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

Lot management overhead

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

NeST v JBOS, solo

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

NeST v JBOS, team

www.cs.wisc.edu/condorwww.cs.wisc.edu/condor/nest

NeST proportional sharing