Using Virtual Machine-ware to Using Virtual Machine-ware to run SLHC Simulationsrun SLHC Simulations

Laura Gilbert - Oxford Atlas Physics meeting 5th June 2006

Virtual Machine SoftwareVirtual Machine Software

Host OSHost OS

VMWARE PLAYERVMWARE PLAYERhardware emulationhardware emulation

Guest OSGuest OS

Guest SoftwareGuest Software

ethernetethernet hard diskshard disks cd-romcd-romprocessorprocessor floppyfloppy

processorprocessor ethernetethernet cd-romcd-romhard diskshard disksfloppyfloppy

The SLHC VMThe SLHC VM

WINDOWSWINDOWS

VMWARE PLAYERVMWARE PLAYERhardware emulationhardware emulation

Scientific Linux 4.3Scientific Linux 4.3

ATLAS SLHC SoftwareATLAS SLHC Software OtherOther

ethernetethernet hard diskshard disks cd-romcd-romprocessorprocessor floppyfloppy

processorprocessor ethernetethernet cd-romcd-romhard diskshard disksfloppyfloppy

The SLHC VMThe SLHC VM

WINDOWSWINDOWS

VMWARE PLAYERVMWARE PLAYERhardware emulationhardware emulation

Scientific Linux 4.3Scientific Linux 4.3

ATLAS SLHC SoftwareATLAS SLHC Software OtherOther

ethernetethernet hard diskshard disks cd-romcd-romprocessorprocessor floppyfloppy

processorprocessor ethernetethernet cd-romcd-romhard diskshard disksfloppyfloppy

SL4.3 – 2/usr /tmp

SL4.3 – 1/ /etc /var …

SLHC Software

Data Drive

Remotely stored files -Remotely stored files -readonly, sharedreadonly, shared

Local files – writable,Local files – writable,personalpersonal

Installing and Running Installing and Running the ATLAS Virtual the ATLAS Virtual

MachineMachine Download and install VMware player:Download and install VMware player:http://www.vmware.com/download/player/http://www.vmware.com/download/player/

Mount Mount ppfs2\particle\gilbertppfs2\particle\gilbert on Z:. Contains two on Z:. Contains two remote disks (~10GB).remote disks (~10GB).

Copy into working dir and untar:Copy into working dir and untar: ppfs2\particle\gilbert\VMs\DRIVERS\11.2.0_SLHC\SL43_remote.vmx : 4MBppfs2\particle\gilbert\VMs\DRIVERS\11.2.0_SLHC\SL43_remote.vmx : 4MB ppfs2\particle\gilbert\VMs\UserDisks.zip : 150MBppfs2\particle\gilbert\VMs\UserDisks.zip : 150MB

Creates own memory and eth0 address on first Creates own memory and eth0 address on first run, altering run, altering SL43_remote.vmxSL43_remote.vmx..

Run Run SL43_remote.vmx SL43_remote.vmx in VMplayer: in VMplayer: username “SLHCuser” passwd “VMtest”.username “SLHCuser” passwd “VMtest”. run “vmware-toolbox --minimize” to use copy/paste run “vmware-toolbox --minimize” to use copy/paste

between host & guest. between host & guest. To shutdown use cntrl+alt+insert.To shutdown use cntrl+alt+insert.

Installing and Running Installing and Running the ATLAS Virtual the ATLAS Virtual

MachineMachine

Features/DrawbacksFeatures/Drawbacks

Currently using NAT Currently using NAT (sharing physical IP with (sharing physical IP with Windows). Outward Windows). Outward networking works as networking works as usual. usual.

Can be isolated. Security Can be isolated. Security issues to consider.issues to consider.

Can use SSSH to log into Can use SSSH to log into VM from host and VM from host and transfer files.transfer files.

Would need to set up Would need to set up port-forwarding on port-forwarding on windows host to log in windows host to log in remotely.remotely.

ConnectiConnectivityvity

Features/DrawbacksFeatures/Drawbacks

Memory allocation can be Memory allocation can be altered by the user in altered by the user in vmplayer, but only on vmplayer, but only on reboot. Default 160MB.reboot. Default 160MB.

Clicking the cross will Clicking the cross will automatically snapshot the automatically snapshot the machine and suspend it. machine and suspend it.

It can be restarted from It can be restarted from the same point later on.the same point later on.

It can them be physically It can them be physically moved and run again in a moved and run again in a different dir.different dir.

Difficult to "nice" at Difficult to "nice" at present, suggest running present, suggest running primarily overnight for primarily overnight for now.now.

Can result in more Can result in more frequent rebootsfrequent reboots

Memory/SnapshottingMemory/Snapshotting

Features/DrawbacksFeatures/Drawbacks

Data disks can start small, Data disks can start small, are transparently disposable are transparently disposable and replacable. Thus small and replacable. Thus small download.download.

Can also in theory be Can also in theory be "shrunk"."shrunk".

Remote disks are all Remote disks are all readonly so should be no readonly so should be no corruption/interference.corruption/interference.

The skeleton vms are all The skeleton vms are all invisible to one another invisible to one another despite shared disks. despite shared disks.

Data disks will expand Data disks will expand up top 20G, can use up up top 20G, can use up all space if not watched.all space if not watched.

Effect of many VMs Effect of many VMs accessing same software accessing same software and SL drives needs to and SL drives needs to be tested.be tested.

Can only write to local Can only write to local disks. /etc and so forth disks. /etc and so forth are read-only.are read-only.

DisksDisks

More comments on setup More comments on setup and runningand running

Floppy and CD-ROM are disabled for security and Floppy and CD-ROM are disabled for security and simplicity. Can be enabled. simplicity. Can be enabled.

Possible for user to alter networking also (eg. Switch Possible for user to alter networking also (eg. Switch to bridging).to bridging).

Security therefore relies on users. Security therefore relies on users. Hard disks can be switched around if you know what Hard disks can be switched around if you know what

you’re doing.you’re doing. Timekeeping dodgy!Timekeeping dodgy! Don’t fiddle with anything to start with! If it Don’t fiddle with anything to start with! If it

breaks/produces errors let me kbreaks/produces errors let me k

SLHC SimulationSLHC Simulation Skeleton SLHC jobs adapted from Abdel.Skeleton SLHC jobs adapted from Abdel. SLHC software installed under /ATLAS SLHC software installed under /ATLAS

with additional modules under with additional modules under /ATLAS/addons./ATLAS/addons.

Go to /personal/jobs. Run “./ #1 #2”. Go to /personal/jobs. Run “./ #1 #2”. Output will go in /personal/data, logs in Output will go in /personal/data, logs in /personal/log./personal/log.

Runs simulation jobs in batches of 100. Runs simulation jobs in batches of 100. Scp outputs to ppslgen: Scp outputs to ppslgen:

/datadisk/bigdisk/lhc/VMData/log, /data. /datadisk/bigdisk/lhc/VMData/log, /data. Log measures cpu time. Log measures cpu time.

Further WorkFurther Work Install 12 when it's running for Install 12 when it's running for

normal ATLAS simulation work.normal ATLAS simulation work. Test tolerance of multiple access Test tolerance of multiple access

to remote disksto remote disks Benchmark speeds on desktopBenchmark speeds on desktop Find out how to deal with Find out how to deal with

unsynchronised clocks.unsynchronised clocks. Can I have 5 volunteers?Can I have 5 volunteers?

Thanks to Abdel, Chris and Rosario for help and Thanks to Abdel, Chris and Rosario for help and enlightening discussions.enlightening discussions.