“ xrootd ” storage

11-July-2008Fabrizio Furano - Data access and Storage: new directions 2

11-July-2008Fabrizio Furano - Data access and Storage: new directions 3

11-July-2008Fabrizio Furano - Data access and Storage: new directions 4

11-July-2008Fabrizio Furano - Data access and Storage: new directions 5

11-July-2008Fabrizio Furano - Data access and Storage: new directions 6

11-July-2008Fabrizio Furano - Data access and Storage: new directions 7

11-July-2008Fabrizio Furano - Data access and Storage: new directions 8

11-July-2008Fabrizio Furano - Data access and Storage: new directions 9

11-July-2008Fabrizio Furano - Data access and Storage: new directions 10

Pre-xferdata

“locally”

Pre-xferdata

“locally”

Legacyremoteaccess

Legacyremoteaccess

Remoteaccess+Remoteaccess+Data

Processing

Data access

OverheadNeed for

potentiallyuseless replicas

And a hugeBookkeeping!

OverheadNeed for

potentiallyuseless replicas

And a hugeBookkeeping!

LatencyWasted CPU

cyclesBut easy

to understand

LatencyWasted CPU

cyclesBut easy

to understand

Interesting!Efficientpractical

Interesting!Efficientpractical

ApplicationApplication

11-July-2008Fabrizio Furano - Data access and Storage: new directions 11

Client1Client1

ServerServer

Client2Client2

Client3Client3

TCP (control)

Clients still seeOne Physical

connection perserver

Clients still seeOne Physical

connection perserver

TCP(data)

Async datagets

automaticallysplitted

Async datagets

automaticallysplitted

11-July-2008Fabrizio Furano - Data access and Storage: new directions 12

11-July-2008Fabrizio Furano - Data access and Storage: new directions 13

11-July-2008Fabrizio Furano - Data access and Storage: new directions 14

11-July-2008Fabrizio Furano - Data access and Storage: new directions 15

11-July-2008Fabrizio Furano - Data access and Storage: new directions 16

11-July-2008Fabrizio Furano - Data access and Storage: new directions 17

cmsdcmsd

xrootdxrootdPragueNIHAM

… any other

cmsdcmsd

xrootdxrootd

CERN

cmsdcmsd

xrootdxrootd

ALICE global redirector (alirdr)all.role meta managerall.manager meta alirdr.cern.ch:1312root://alirdr.cern.ch/root://alirdr.cern.ch/

IncludesIncludesCERN, GSI, and othersCERN, GSI, and others

xroot clustersxroot clusters

Meta Managers can be geographically

replicatedCan have several in different places for region-aware load

balancing

cmsdcmsd

xrootdxrootd

GSIall.manager meta alirdr.cern.ch:1312 all.manager meta alirdr.cern.ch:1312 all.manager meta alirdr.cern.ch:1312all.role manager all.role manager all.role manager

cmsdcmsd

xrootdxrootd

GSI

11-July-2008Fabrizio Furano - Data access and Storage: new directions 18

cmsdcmsd

xrootdxrootd PragueNIHAM

… any othercmsdcmsd

xrootdxrootd

CERN

cmsdcmsd

xrootdxrootd

ALICE global redirector

all.role meta managerall.manager meta alirdr.cern.ch:1312

all.role manager all.role managerall.role manager

But missing a file?Ask to the global metamgr

Get it from any othercollaborating cluster

all.manager meta alirdr.cern.ch:1312 all.manager meta alirdr.cern.ch:1312 all.manager meta alirdr.cern.ch:1312

Local clients worknormally

11-July-2008Fabrizio Furano - Data access and Storage: new directions 19

11-July-2008Fabrizio Furano - Data access and Storage: new directions 20

11-July-2008Fabrizio Furano - Data access and Storage: new directions 21

11-July-2008Fabrizio Furano - Data access and Storage: new directions 22

11-July-2008Fabrizio Furano - Data access and Storage: new directions 23

11-July-2008Fabrizio Furano - Data access and Storage: new directions 24

11-July-2008Fabrizio Furano - Data access and Storage: new directions 25

11-July-2008Fabrizio Furano - Data access and Storage: new directions 26

11-July-2008Fabrizio Furano - Data access and Storage: new directions 27

11-July-2008Fabrizio Furano - Data access and Storage: new directions 28Courtesy of Gerardo Ganis (CERN PH-SFT)

11-July-2008Fabrizio Furano - Data access and Storage: new directions 29Courtesy of Gerardo Ganis (CERN PH-SFT)