COL-12368-01

C H A P T E R2

Booting from a Fibre Channel SAN

This chapter describes the boot from a Fibre Channel SAN process and includes the following sections:

• Overview, page 2-1

• Setting Up Hardware, page 2-2

• Checking the HCA Firmware Version, page 2-3

• Configuring a Fibre Channel Connection, page 2-3

• Installing an Image on Fibre Channel Storage, page 2-10

• Booting an Image, page 2-34

OverviewThis section describes how to perform a SAN boot with SRP and includes the following high-level steps:

Step 1 Install and connect all required hardware.

For more information, see the “Installing Hardware” section on page 2-2.

Step 2 Load the correct firmware onto the HCA.

You can upgrade standard and low-profile HCAs to run BoIB-capable firmware. To upgrade the firmware on your HCA, see the Cisco SFS InfiniBand Host Drivers User Guide for Linux.

Note Skip this step if your HCA already runs BoIB firmware. To determine if your HCA already runs the appropriate software, see the “Checking the HCA Firmware Version” section on page 2-3.

Step 3 Configure an ITL group to connect your host to the Fibre Channel storage.

For details, see the “Installing an Image on Fibre Channel Storage” section on page 2-10.

Note Skip this step if your environment runs VFrame software. VFrame Director, along with a server switch and gateways, creates a programmable switching fabric for mapping servers to storage and networking resources. For more information, see the Cisco VFrame InfiniBand Director User Guide.

2-1isco SFS Boot over InfiniBand User Guide for Linux

Chapter 2 Booting from a Fibre Channel SAN Setting Up Hardware

Step 4 Load an image onto a Fibre Channel storage device.

For details, see the “Configuring a Fibre Channel Connection” section on page 2-3.

Note Skip this step if an image already resides on your storage.

Step 5 Boot the remote image.

For details, see the “Booting an Image” section on page 2-34.

Setting Up HardwareA SAN boot with the BoIB feature uses the following hardware:

• A host with an HCA

• A server switch with a Fibre Channel gateway

• A Fibre Channel storage device (connected, optionally, through a SAN switch or switch fabric)

• (Optional) A portable CD ROM drive for servers without a local drive

• (Optional) A KVM device, recommended to view the installation process

Installing HardwareTo create the physical environment for your SAN boot, perform the following high-level steps:

Step 1 Install the HCA into your host.

For details, see the Cisco SFS InfiniBand Host Drivers User Guide for Linux.

Step 2 Connect the HCA to an IB port on your server switch.

Step 3 Install the Fibre Channel gateway into your server switch.

For details, see the Cisco SFS InfiniBand Fibre Channel Gateway User Guide.

Step 4 Connect the Fibre Channel gateway to a Fibre Channel storage device or to a SAN fabric with a Fibre Channel storage device.

Note If you upgrade your Linux kernel after installing these host drivers, you need to reinstall the host drivers.

2-2Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Checking the HCA Firmware Version

Checking the HCA Firmware VersionThis section describes how to check the HCA firmware version. To verify that your HCA provides the BoIB feature, enter the /usr/local/topspin/sbin/tvflash -i command from the host CLI. If .Boot appears in the description of your HCA, the HCA includes the BoIB feature.

If your HCA does not run BoIB firmware, update the HCA. For instructions, see the Cisco SFS InfiniBand Host Drivers User Guide for Linux.

The following example shows how to check the HCA firmware version:

host1# /usr/local/topspin/sbin/tvflash -i HCA #0: MT23108, Cougar Cub, revision A1 Primary image is v3.5.000 build 3.2.0.118, with label 'HCA.CougarCub.A1.Boot' Secondary image is v3.5.000 build 3.2.0.106, with label 'HCA.CougarCub.A1.Boot' Vital Product Data Product Name: Cougar cub P/N: MHXL-CF128-T E/C: C-00 S/N: MT0420F00221 Freq/Power: N/A Checksum: Ok Date Code: N/A

Note The firmware is available on the BoIB ISO image. For instructions on how to upgrade your firmware, see the Cisco SFS InfiniBand Host Drivers User Guide for Linux.

Configuring a Fibre Channel ConnectionThis section describes how to configure a Fibre Channel connection and includes the following topics:

• Using Element Manager and a Host with a Remote Boot HCA, page 2-3

• Using the CLI and a Host with a Remote Boot HCA, page 2-5

Using Element Manager and a Host with a Remote Boot HCAThis section describes how to use the Element Manager and a host with a remote boot HCA. These procedures are based on the following requirements:

• The HCA in your host runs BoIB feature firmware.

• You have installed all hardware components successfully.

• Only one HCA resides in your host.

To install an image onto storage, perform the following steps:

Step 1 (Recommended) Restrict global access.

2-3Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Configuring a Fibre Channel Connection

Note If you do not restrict access, only the first seven LUNs that your host can access will appear in the boot menu.

After you install an image, you must deny your host access to all LUNs that contain bootable images (except the LUN that stores the image that you want to boot). Hosts might not boot successfully when they can access multiple LUNs that store bootable images. After you install the image, if you grant your host access to additional LUNs that do not contain bootable images, your host continues to boot successfully.

a. Launch Element Manager and open your server switch.

b. From the FibreChannel menu, select Storage Manager. The Storage Manager window opens.

c. Click the Storage folder at the top of the left-hand navigation tree.

d. In the Gateway Port Access field, check the Restricted check box.

e. In the LUN Access field, check the Restricted check box.

f. Click the Apply button.

Step 2 Configure an ITL.

Note If you are using a VFrame environment, do not configure ITLs manually. VFrame configures ITLs for you.

a. Boot your host and press the x key when the Type ‘x’ to configure boot options prompt appears during the boot process. The GUID of the host appears in the host display. Record the GUID and leave the host at this screen. You will refresh the screen later in this process.

b. Return to the Storage Manager window of Element Manager and click the SRP Hosts folder in the navigation tree.

c. Click the Define New button. The Define New SRP Host window opens.

d. Enter the GUID of your host (from Step a) in the Host GUID field, or select it from the drop-down menu (if available).

e. (Optional) Enter a text description for the host in the Description field.

f. Click the Next > button.

g. Click the Finish button. The new initiator appears under the SRP Hosts folder.

h. Click the new initiator under the SRP Hosts folder, and then click the Targets tab.

i. Verify that the WWPN of the target onto which you want to install the image appears in the list.

j. Double-click in the list the WWPN (from Step i) in the list of the target onto which you want to install the image. The IT Properties window opens.

k. Click the ... button next to the Port Mask field. The Select Ports window opens.

l. Click the button of the port that connects the host to the storage, and then click OK.

m. Click the Apply button in the IT Properties window, and then close the window.

n. Click the LUN Access tab, and then click the Discover LUNs button. The targets that your server switch sees appear in the Available LUNs column.

o. Click the target (from Step i) onto which you want to install an image, and then click the Add > button.

2-4Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Configuring a Fibre Channel Connection

p. Click the Apply button.

q. (Optional) If you plan to install the bootable image to an LU of a RAID device, perform the following steps to define the bootable LU as LUN 0:

– In the Accessible LUNs field, double-click the LU to which you want to install the image. The ITL Properties window opens.

– In the SRP LUN ID field, enter 00:00:00:00:00:00:00:00.

– Click the Apply button, and then close the window.

r. Return to your host and press the r key to refresh your view. The WWPN of the target (from Step i) appears in the display, beneath the GUID.

s. (Optional but recommended) Configure the WKSN.

– Return to the Storage Manager window of Element Manager, click your SRP host, and then click the General tab.

– From the Boot Target WWPN field, select the boot target from the drop-down menu or manually enter it.

– From the Boot FC LUN field, select the boot LUN from the drop-down menu or manually enter it.

– Click the Apply button.

Using the CLI and a Host with a Remote Boot HCAThis section describes how to use the CLI and a host with a remote boot HCA. These procedures are based on the following requirements:

• The HCA in your host runs BoIB feature firmware.

• You have installed all hardware components successfully.

• Only one HCA resides in your host.

To install an image onto storage, perform the following steps:

Step 1 (Recommended) Restrict global access.

Note If you do not restrict access, only the first seven LUNs that your host can access will appear in the boot menu.

After you install an image, you must deny your host access to all LUNs that contain bootable images (except the LUN that stores the image that you want to boot). Hosts do not boot successfully when they can access multiple LUNs that store bootable images. If, after you install the image, you grant your host access to additional LUNs that do not contain bootable images, your host continues to boot successfully.

Step 2 Log into your server switch.

Login: superPassword: xxxxx

2-5Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Configuring a Fibre Channel Connection

Step 3 Enter privileged EXEC mode by entering the enable command.

SFS-3012R> enableSFS3012R#

Step 4 Enter global configuration mode by entering the configure terminal command.

SFS-3012R# configure terminalSFS-3012R(config)#

Step 5 Restrict LUN access to initiators for all new ITs and ITLs.

Enter the fc srp-global command with the following items:

• lun-policy keyword

• restricted keyword

SFS-3012R(config)# fc srp-global lun-policy restricted

Step 6 Restrict portmask access to initiators for all new ITs and ITLs.

Enter the fc srp-global command with the following items:

• gateway-portmask-policy keyword

• restricted keyword

SFS-3012R(config)# fc srp-global gateway-portmask-policy restricted

Step 7 Configure an ITL.

Note To install an image with VFrame, do not configure ITLs manually.

Step 8 Boot your host and press the x key when the Type ‘x’ to configure boot options prompt appears during the boot process. The GUID of the host appears in the host display. Record the GUID and leave the host at this screen. You refresh the screen later in this process.

Step 9 Add your host to the configuration file and create WWPNs on the Fibre Channel gateway that point to the host.

Return to your server switch CLI and enter the fc srp initiator command with the following items:

• GUID of the host (from Step 8)

• GUID extension of the host (always 00:00:00:00:00:00:00:00)

• auto-bind keyword

SFS-3012R(config)# fc srp initiator 00:05:ad:00:00:00:17:3c 00:00:00:00:00:00:00:00 auto-bind

Step 10 Assign an easily recognizable identifier to the initiator.

(Optional) Enter the fc srp initiator command with the following items:

• GUID of the host (from Step 8)

• GUID extension of the host (always 00:00:00:00:00:00:00:00)

• description keyword

• Text description, enclosed in quotation marks

SFS-3012R(config)# fc srp initiator 00:05:ad:00:00:00:17:3c 00:00:00:00:00:00:00:00 description "test-initiator"

2-6Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Configuring a Fibre Channel Connection

Step 11 Enter the exit command to return to privileged EXEC mode.

SFS-3012R(config)# exitSFS-3012R#

Step 12 View the WWPNs of the host.

Enter the show fc srp initiator command with the following items:

• GUID of the host (from Step 8)

• GUID extension of the host (always 00:00:00:00:00:00:00:00)

SFS-3012R# show fc srp initiator 00:05:ad:00:00:00:17:3c 00:00:00:00:00:00:00:00

================================================================================ SRP Initiators================================================================================ guid: 00:05:ad:00:00:00:17:3c extension: 00:00:00:00:00:00:00:00 description: test-initiator wwnn: 20:02:00:05:ad:00:00:00 credit: 0 active-ports: none pkeys: bootup-target: 00:00:00:00:00:00:00:00 bootup-lu: 00:00:00:00:00:00:00:00 action: auto-bind result: success wwpns: port wwpn fc-addr 2/1 20:02:00:05:ad:20:00:00 00:00:00 2/2 20:02:00:05:ad:24:00:00 00:00:00 3/1 20:02:00:05:ad:30:00:00 00:00:00 3/2 20:02:00:05:ad:34:00:00 00:00:00 4/1 20:02:00:05:ad:40:00:00 00:00:00 4/2 20:02:00:05:ad:44:00:00 00:00:00 5/1 20:02:00:05:ad:50:00:00 00:00:00 5/2 20:02:00:05:ad:54:00:00 00:00:00 6/1 20:02:00:05:ad:60:00:00 00:00:1d 6/2 20:02:00:05:ad:64:00:00 00:00:1d 7/1 20:02:00:05:ad:70:00:00 00:00:00 7/2 20:02:00:05:ad:74:00:00 00:00:00 8/1 20:02:00:05:ad:80:00:00 00:00:00 8/2 20:02:00:05:ad:84:00:00 00:00:00 9/1 20:02:00:05:ad:90:00:00 00:00:00 9/2 20:02:00:05:ad:94:00:00 00:00:00 10/1 20:02:00:05:ad:a0:00:00 00:00:00 10/2 20:02:00:05:ad:a4:00:00 00:00:00 11/1 20:02:00:05:ad:b0:00:00 00:00:00 11/2 20:02:00:05:ad:b4:00:00 00:00:00 12/1 20:02:00:05:ad:c0:00:00 00:00:00 12/2 20:02:00:05:ad:c4:00:00 00:00:00 13/1 20:02:00:05:ad:d0:00:00 00:00:00 13/2 20:02:00:05:ad:d4:00:00 00:00:00

Step 13 Record the WWPN of the port that connects the host to the storage.

Step 14 Verify that the host can see the target. If the WWPN of the target does not appear in the command output, give the gateway some time to configure the ITs and retry the command.

Enter the show fc srp initiator-wwpn-view command with the following items:

• WWPN of the port (from Step 13)

• target keyword

2-7Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Configuring a Fibre Channel Connection

SFS-3012R# show fc srp initiator-wwpn-view 20:02:00:05:ad:60:00:00 target

================================================================================ SRP Targets Accessible to Initiator Via Port WWN 20:02:00:05:ad:60:00:00================================================================================ wwpn: 21:00:00:04:cf:f6:c2:ab wwnn: 20:00:00:04:cf:f6:c2:ab description: SRP.T10:21000004CFF6C2AB ioc-guid: 00:05:ad:00:00:00:15:1a service-name: SRP.T10:21000004CFF6C2AB protocol-ids: 04:00:00:00:00:00:00:00:00:00 fc-address: 00:00:23 mtu: 0 connection-type: nl-port physical-access: 6/1

Step 15 Return to global configuration mode by entering the configure terminal command.

SFS-3012R# configure terminalSFS-3012R(config)#

Step 16 Grant the host access to one target. This is the target from which your host will boot through the port.

Enter the no fc srp it command with the following items:

• GUID of the host (from Step 8)

• GUID extension of the host (always 00:00:00:00:00:00:00:00)

• WWPN of the target to which you want to install the image

• gateway-portmask-policy keyword

• restricted keyword

• Fibre Channel gateway port that connects the host to the storage (in slot#/port# format)

SFS-3012R(config)# no fc srp it 00:05:ad:00:00:00:17:3c 00:00:00:00:00:00:00:00 21:00:00:04:cf:f6:c2:ab gateway-portmask-policy restricted 6/1

Step 17 Configure ITLs to which the host belongs. The ITLs inherit the portmask policy of the IT (from Step 7).

Enter the fc srp initiator command with the following items:

• GUID of the host (from Step 8)

• GUID extension of the host (always 00:00:00:00:00:00:00:00)

• discover-itl keyword

SFS-3012R(config)# fc srp initiator 00:05:ad:00:00:00:17:3c 00:00:00:00:00:00:00:00 discover-itl

2-8Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Configuring a Fibre Channel Connection

Step 18 Grant the host access to one LUN. This is the LUN from which your host boots.

Enter the no fc srp itl command with the following items:

• GUID of the host (from Step 8)

• GUID extension of the host (always 00:00:00:00:00:00:00:00)

• WWPN of the target onto which you want to install the image

• LUN ID of the LUN onto which you want to install the image

• lun-policy keyword

• restricted keyword

SFS-3012R(config)# no fc srp itl 00:05:ad:00:00:00:17:3c 00:00:00:00:00:00:00:00 21:00:00:04:cf:f6:c2:ab 00:00:00:00:00:00:00:00 lun-policy restricted

Step 19 (Optional) Install the bootable image to an LU of a RAID device. Enter the fc srp itl command with the following items:

• GUID of the host (from Step 8)

• GUID extension of the host (always 00:00:00:00:00:00:00:00)

• WWPN of the target onto which you want to install the image

• Fibre Channel LUN ID of the LUN to which you wish to install the image

• srp-lunid keyword

• SRP LUN ID that you want to assign to the LU (for the installation, you must enter 00:00:00:00:00:00:00:00)

• logical-id keyword

• logical ID of the LU, without colons (:)

SFS-3012R(config)# fc srp itl 00:05:ad:00:00:00:17:3c 00:00:00:00:00:00:00:00 21:00:00:04:cf:f6:c2:ab 00:00:00:00:00:00:00:01 srp-lunid 00:00:00:00:00:00:00:00 logical-id 0103000820000004cff6c2ab00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000

Step 20 Return to your host and press the r key to refresh your view.

The WWPN of the target appears in the display under the GUID.

Step 21 Configure the LUN as the WKSN of your host.

Return to your server switch and enter the fc srp initiator command with the following items:

• GUID of the host (from Step 8)

• GUID extension of the host (always 00:00:00:00:00:00:00:00)

• bootup keyword

• target keyword

• WWPN of the target onto which you want to install the image

• lu keyword

• LUN ID of the LUN onto which you want to install the image

SFS-3012R(config)# fc srp initiator 00:05:ad:00:00:00:17:3c 00:00:00:00:00:00:00:00 bootup target 21:00:00:04:cf:f6:c2:ab lu 00:00:00:00:00:00:00:00

2-9Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Installing an Image on Fibre Channel StorageThis section describes how to install a bootable image on Fibre Channel storage with the following resources:

• Installing and Booting RHEL3 or RHEL4, page 2-10

• Installing and Booting SLES9 Service Pack 3, page 2-18

Note To ensure a successful boot, install with a separate /boot partition during the standard Linux setup.

Installing and Booting RHEL3 or RHEL4This section describes how to install and boot the RHEL3 or the RHEL4. Use a Kickstart configuration file that contains the driverdisk parameter to access the BoIB CD over the network.

driverdisk --source=nfs:10.0.0.35:/qadata/home/releng/builds/Linux-3.2.0/build118/image/topspin-boib-3.2.0-118.iso

Note Although there is a long delay while the ISO image is mounted and accessed, you must use an ISO image, not a directory.

On RHEL3 and RHEL4, if you install over NFS, you need to use Kickstart with driverdisk, or place your ISO image in the same directory as the Red Hat ISO images.

The following procedure begins the installation from a CD, but completes the installation over NFS:

Step 1 Place the first installation CD in your host and boot the server from the CD.

Step 2 (RedHat only) At your host CLI, exit interactive mode.

2-10Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 3 (RedHat only) At the boot prompt, enter the linux dd or linux dd askmethod command to prompt the installer to run the driver CD (Figure 2-1).

To complete the installation over NFS, enter the linux dd askmethod command.

Figure 2-1 Begin the Linux and Red Hat Installation

2-11Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

The installation begins loading (Figure 2-2).

Figure 2-2 Installation Process

Step 4 (RedHat only) At the Do you have a driver disk? prompt, click Yes (Figure 2-3).

Figure 2-3 Driver Disk Screen

2-12Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 5 (RedHat only) On the Driver Disk Source screen, select your CD ROM, and then select OK.

The Insert Driver Disk screen appears (Figure 2-4).

Figure 2-4 Insert Driver Disk Screen

Step 6 (RedHat only) Remove the Linux installation CD and place the driver CD in the drive, and then click OK (Figure 2-4).

The ts_srp_host driver loads (Figure 2-5 and Figure 2-6).

Figure 2-5 Driver Disk Loading

2-13Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Figure 2-6 SRP Host Driver Loading

Step 7 (RedHat only) At the Do you wish to load any more driver disks? screen, click No.

The Installation Method screen (Figure 2-7) appears if you previously appended the askmethod option to the linux dd command (see Step 3). If you do not use the askmethod option, this screen does not appear. Continue to install from the CDs.

Figure 2-7 Select Installation Method

(In this example, the user has selected installation over NFS).

2-14Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 8 Select the network interface on which you want to install the image and click OK (Figure 2-8).

Figure 2-8 Select Networking Device

The Configure TCP/IP screen appears (Figure 2-9).

Figure 2-9 Enter Network IP Configuration Information

2-15Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 9 Enter the appropriate IP network information for the remote device from where you want to install the packages, and click the OK button.

The NFS Setup screen appears (Figure 2-10).

Figure 2-10 NFS Setup Screen

Step 10 Enter the NFS server name and the path to the Red Hat directory and click the OK button.

2-16Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 11 (RedHat only) Complete the installation as you normally would (Figure 2-11).

Caution Install and verify that the host installs the boot loader to the SRP drive. If you have a local ATA drive, by default the host is configured to install the boot loader on the ATA drive. Make sure that you avoid installing the boot loader on the ATA drive.

Figure 2-11 Install Red Hat Packages

Step 12 (RedHat only) After the installation is complete, remove the driver CD and reboot the host.

Step 13 Change the default boot order to well known so that SRP Boot is selected first. You can change the order using the boot ROM menu (Figure 2-12) or the Linux command line.

From the boot ROM menu, select the number corresponding to the WKBS. Save the configuration by typing s. Type x to exit boot ROM. The system boots the SRP target now and on subsequent reboots.

Note The IB switch configuration must be saved after installing over SRP in order for the WKBS to work.

2-17Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Figure 2-12 Select WKBS from the Boot ROM Menu

To change the default boot option without using the boot ROM itself, use the tvflash -o boot_type=well_known command.

Setting the value to well_ known requires the use of a boot ROM that is SRP-capable.

host1# /usr/local/topspin/sbin/tvflash -o boot_type=well_knownWriting [============================================================]host1# /usr/local/topspin/sbin/tvflash -o auto_upgrade=yes boot_enable_port_1=yes boot_enable_port_2=yes boot_wait_on_error=no boot_try_forever=no boot_type=well_known boot_saved_port=0 boot_saved_ioc_num=0 boot_saved_dgid=0000:0000:0000:0000:0000:0000:0000:0000 boot_saved_service_name=0000:0000:0000:0000 boot_pxe_secs=0

Note If you do not install over NFS, you are prompted to reinsert the CD at the end of the process.

Installing and Booting SLES9 Service Pack 3This section describes how to install and boot SLES9 Service Pack 3.

Note This distribution can be installed directly from the BoIB CD. Older supported SLES9 Service Packs are available, but as a smaller ISO image that is included on our BoIB CD. You have to burn the smaller ISO image to a CD yourself.

To install SLES9, Service Pack 3 on a remote SRP disk, perform the following steps:

Step 1 Insert the Service Pack 3 CD 1 in your host.

2-18Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 2 Boot your host. When the initial GUI screen appears, press the F6 key when the screen in Figure 2-13 appears.

Figure 2-13 Initial GUI Screen

2-19Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 3 Select the Installation in the screen (Figure 2-14).

Figure 2-14 Select Installation on GUI Screen

2-20Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 4 Press the F2 key and select 1024 x 768 to configure the screen resolution (Figure 2-15).

Figure 2-15 Configure Screen Resolution

2-21Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 5 Press the Enter key to continue the installation. A screen similar to the one shown in Figure 2-16 appears.

Figure 2-16 Disk-Change Prompt

Step 6 Place the driver CD in your host (Figure 2-16).

Step 7 Press the Enter key to continue.

2-22Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 8 Select CD-ROM (Figure 2-17).

Figure 2-17 Select Driver Update Medium

Step 9 Click OK and press the Enter key.

Note To view installation details, press and hold Ctrl-Alt-F3 to view the output or press and hold Ctrl-Alt-F4 to view the console. See your SLES distribution documentation for details. Press and hold Ctrl-Alt-F1 to return to the primary display.

Step 10 Click OK and press the Enter key.

2-23Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 11 Insert the service pack CD 1 back into your host. The Drivers Updates added dialog box appears (Figure 2-18).

Figure 2-18 Driver Updates Added Screen

2-24Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 12 Click OK and press the Enter key. The Driver Update medium dialog box appears (Figure 2-19).

Figure 2-19 Driver Update Medium

2-25Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 13 Click OK and press the Enter key. The Driver Updates added dialog box appears (Figure 2-20).

Figure 2-20 Driver Updates Added Screen

2-26Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 14 Click Back and press the Enter key. The choose the Driver Update medium dialog box appears (Figure 2-21).

Figure 2-21 Driver Update Medium

2-27Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 15 When prompted, place the SLES 9 CD 1 in your host (Figure 2-22).

Step 16 Click OK and press the Enter key after ensuring the required CD is in the drive (Figure 2-22).

Figure 2-22 Ensure Required CD is in the Drive

Note To ensure a successful boot, install with a separate /boot partition during the standard Linux installation steps.

The following steps are for uniprocessor hosts.

2-28Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 17 Continue the normal SLES installation until you reach the Installation Settings screen (Figure 2-23).

Figure 2-23 Installation Settings Screen

Step 18 Click the Software link (Figure 2-24). The Software Selection screen appears (Figure 2-25).

Figure 2-24 Click the Software Link

2-29Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 19 Click the Detailed Selection ... button (see button in Figure 2-25). The detailed selection screen appears (Figure 2-26).

Figure 2-25 Click the Detailed Selection Button

2-30Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 20 From the Filter drop-down menu, select Search. A Search text field appears in the left pane (Figure 2-27).

Figure 2-26 Search Text Field in Filter Drop-down Menu

2-31Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 21 Enter kernel in the Search field and click the Search button. The list of software appears in the right pane (Figure 2-28).

Figure 2-27 Enter Selection in the Search Field

Step 22 Uncheck the kernel-default check box (Figure 2-28). Click OK if a dialog box pops up.

Figure 2-28 Uncheck the kernel-default Check Box

2-32Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Installing an Image on Fibre Channel Storage

Step 23 Check the kernel-smp check box (Figure 2-29). Click OK if a dialog box pops up.

Figure 2-29 Check the kernel-smp Check Box

Step 24 Click the Accept button (Figure 2-30).

Figure 2-30 Click the Accept Button

2-33Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Booting an Image

Step 25 Click Continue to resolve interdependencies (Figure 2-31).

Figure 2-31 Click Continue to Resolve Interdependencies

Step 26 Continue your standard SLES installation steps.

Booting an ImageThis section describes how to boot an image. After you install an image onto Fibre Channel storage with a host, you may continue to boot that host from the storage, or you may replace that host with a new, identical host.

Booting the Installation HostTo boot the remote image with your installation host, reload the host. If the boot fails, verify that you have taken the following steps:

• Reconfigured the boot order of the host to put SRP boot first.

• Reconfigured the boot service to use WKSN first and configured the WKSN on your server switch (see Step 20 of Using the CLI and a Host with a Remote Boot HCA, page 2-5).

2-34Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Booting an Image

Booting a New, Diskless Host with a New HCAThis section provides procedures that are based on the following requirements:

• Your host includes an HCA that runs BoIB firmware.

• You have configured the Fibre Channel gateway on your server switch to deny port and LUN access to all new initiators.

Using the CLI

This section describes how to use the CLI. To boot an image that exists using a new host and HCA, perform the following steps:

Step 1 Remove or reconfigure any host that runs the existing image. Only one host on your network may boot a given image.

Step 2 Physically connect your new host to your server switch.

Step 3 Configure an ITL.

Note To install an image with VFrame, do not configure ITLs manually.

a. Open your host and record the GUID from the label on your HCA. Alternatively, you can boot your host and press the x key when the Type ‘x’ to configure boot options prompt appears during the boot process. The GUID of the host appears in the host display. Record the GUID and leave the host at this screen. You may refresh the screen later in this process.

b. Log into your server switch.

c. Enter privileged EXEC mode by typing the enable command.

SFS-3012R> enableSFS-3012R#

d. Enter global configuration mode by typing the configure terminal command.

SFS-3012R# configure terminalSFS-3012R(config)#

e. Add your host to the configuration file and create WWPNs, on the Fibre Channel gateway, that point to the host.

Enter the fc srp initiator command with the following items:

– GUID of the host (from Step a)

– GUID extension of the host (always 00:00:00:00:00:00:00:00)

– auto-bind keyword

SFS-3012R(config)# fc srp initiator 00:05:ad:00:00:00:17:3c 00:00:00:00:00:00:00:00 auto-bind

f. (Optional) Assign an easily-recognizable identifier to the initiator.

Enter the fc srp initiator command with the following items:

– GUID of the host (from Step a)

– GUID extension of the host (always 00:00:00:00:00:00:00:00)

2-35Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Booting an Image

– description keyword

– Text description, enclosed in quotation marks

SFS-3012R(config)# fc srp initiator 00:05:ad:00:00:00:17:3c 00:00:00:00:00:00:00:00 description "test-initiator"

g. Return to privileged EXEC mode by entering the exit command.

SFS-3012R(config)# exitSFS-3012R#

h. Display the WWPNs of the Fibre Channel gateway ports that point to the host.

Enter the show fc srp initiator command with the following items:

– GUID of the host (from Step a)

– GUID extension of the host (always 00:00:00:00:00:00:00:00)

SFS-3012R# show fc srp initiator 00:05:ad:00:00:00:17:3c 00:00:00:00:00:00:00:00

================================================================================ SRP Initiators================================================================================ guid: 00:05:ad:00:00:00:17:3c extension: 00:00:00:00:00:00:00:00 description: test-initiator wwnn: 20:02:00:05:ad:00:00:00 credit: 0 active-ports: none pkeys: bootup-target: 00:00:00:00:00:00:00:00 bootup-lu: 00:00:00:00:00:00:00:00 action: auto-bind result: success wwpns: port wwpn fc-addr 2/1 20:02:00:05:ad:20:00:00 00:00:00 2/2 20:02:00:05:ad:24:00:00 00:00:00 3/1 20:02:00:05:ad:30:00:00 00:00:00 3/2 20:02:00:05:ad:34:00:00 00:00:00 4/1 20:02:00:05:ad:40:00:00 00:00:00 4/2 20:02:00:05:ad:44:00:00 00:00:00 5/1 20:02:00:05:ad:50:00:00 00:00:00 5/2 20:02:00:05:ad:54:00:00 00:00:00 6/1 20:02:00:05:ad:60:00:00 00:00:1d 6/2 20:02:00:05:ad:64:00:00 00:00:1d 7/1 20:02:00:05:ad:70:00:00 00:00:00 7/2 20:02:00:05:ad:74:00:00 00:00:00 8/1 20:02:00:05:ad:80:00:00 00:00:00 8/2 20:02:00:05:ad:84:00:00 00:00:00 9/1 20:02:00:05:ad:90:00:00 00:00:00 9/2 20:02:00:05:ad:94:00:00 00:00:00 10/1 20:02:00:05:ad:a0:00:00 00:00:00 10/2 20:02:00:05:ad:a4:00:00 00:00:00 11/1 20:02:00:05:ad:b0:00:00 00:00:00 11/2 20:02:00:05:ad:b4:00:00 00:00:00 12/1 20:02:00:05:ad:c0:00:00 00:00:00 12/2 20:02:00:05:ad:c4:00:00 00:00:00 13/1 20:02:00:05:ad:d0:00:00 00:00:00 13/2 20:02:00:05:ad:d4:00:00 00:00:00

i. Record the WWPN of the Fibre Channel gateway port that connects the host to the storage.

2-36Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Booting an Image

j. Verify that the host can see the target that contains the bootable image. If the WWPN of the boot target does not appear in the command output, give the gateway some time to configure the ITs and retry the command.

Enter the show fc srp initiator-wwpn-view command with the following items:

– WWPN of the port (from Step i)

– target keyword

SFS-3012R# show fc srp initiator-wwpn-view 20:02:00:05:ad:60:00:00 target

================================================================================ SRP Targets Accessible to Initiator Via Port WWN 20:02:00:05:ad:60:00:00================================================================================ wwpn: 21:00:00:04:cf:f6:c2:ab wwnn: 20:00:00:04:cf:f6:c2:ab description: SRP.T10:21000004CFF6C2AB ioc-guid: 00:05:ad:00:00:00:15:1a service-name: SRP.T10:21000004CFF6C2AB protocol-ids: 04:00:00:00:00:00:00:00:00:00 fc-address: 00:00:23 mtu: 0 connection-type: nl-port physical-access: 6/1

k. Return to global configuration mode by entering the configure terminal command.

SFS-3012R# configure terminalSFS-3012R(config)#

l. Grant the host access to the target from which your host will boot (through the port).

Enter the no fc srp it command with the following items:

– GUID of the host (from Step a)

– GUID extension of the host (always 00:00:00:00:00:00:00:00)

– WWPN of the target that stores the bootable image

– gateway-portmask-policy keyword

– restricted keyword

– Fibre Channel gateway port that connects the host to the storage (in slot#/port# format)

SFS-3012R(config)# no fc srp it 00:05:ad:00:00:00:17:3c 00:00:00:00:00:00:00:00 21:00:00:04:cf:f6:c2:ab gateway-portmask-policy restricted 6/1

m. Configure ITLs to which the host belongs. The ITLs inherit the portmask policy of the IT.

Enter the fc srp initiator command with the following items:

– GUID of the host (from Step a)

– GUID extension of the host (always 00:00:00:00:00:00:00:00)

– discover-itl keyword

SFS-3012R(config)# fc srp initiator 00:05:ad:00:00:00:17:3c 00:00:00:00:00:00:00:00 discover-itl

n. Grant the host access to the LUN from which your host boots.

Enter the no fc srp itl command with the following items:

– GUID of the host (from Step a)

2-37Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Booting an Image

– GUID extension of the host (always 00:00:00:00:00:00:00:00)

– WWPN of the target that stores the bootable image

– LUN ID of the LUN that stores the bootable image

– lun-policy keyword

– restricted keyword

SFS-3012R(config)# no fc srp itl 00:05:ad:00:00:00:17:3c 00:00:00:00:00:00:00:00 21:00:00:04:cf:f6:c2:ab 00:00:00:00:00:00:00:00 lun-policy restricted

o. Configure the LUN as the WKSN of your host.

Enter the fc srp initiator command with the following items:

– GUID of the host (from Step a)

– GUID extension of the host (always 00:00:00:00:00:00:00:00)

– bootup keyword

– target keyword

– WWPN of the target that stores the boot image.

– lu keyword

– LUN ID of the LUN that stores the boot image

SFS-3012R(config)# fc srp initiator 00:05:ad:00:00:00:17:3c 00:00:00:00:00:00:00:00 bootup target 21:00:00:04:cf:f6:c2:ab lu 00:00:00:00:00:00:00:00

Step 4 Boot your host.

Note If the host does not boot successfully, reboot the host and enter interactive mode, then configure the boot order to begin with SRP boot or WKSN.

Using Element Manager

To use Element Manager, perform the following steps:

Step 1 Remove or reconfigure any host that runs the existing image. Only one host on your network can boot a specific image.

Step 2 Physically connect your new host to your server switch.

Step 3 Configure an ITL.

Note To install an image with VFrame, do not configure ITLs manually.

a. Open your host and record the GUID from the label on your HCA. Alternatively, you can boot your host and press the x key when the Type ‘x’ to configure boot options prompt appears during the boot process. The GUID of the host appears in the host display. Record the GUID and leave the host at this screen. You may refresh the screen later in this process.

b. Launch Element Manager and open your server switch.

2-38Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Booting an Image

c. From the FibreChannel menu, select Storage Manager. The Storage Manager window opens.

d. Click the SRP Hosts folder in the navigation tree.

e. Click the Define New button. The Define New SRP Host window opens.

f. Enter the GUID of your host (from Step a) in the Host GUID field.

g. (Optional) Enter a text description for the host in the Description field.

h. Click the Next > button.

i. Click the Finish button. The new initiator appears under the SRP Hosts folder.

j. Click the new initiator under the SRP Hosts folder, and then click the Targets tab.

k. Verify that the target that stores the image that you want to boot appears in the list.

l. Double-click the target in the list where you want to install the image. The IT Properties window opens.

m. Click the ... button next to the Port Mask field. The Select Ports window opens.

n. Click the button of the port that connects the host to the storage, and then click OK.

o. Click the Apply button in the IT Properties window, and then close the window.

p. Click the LUN Access tab, and then click the Discover LUNs button. The targets that your server switch sees appear in the Available LUNs column.

q. Click the target that stores the image that you want to boot, and then click the Add > button.

r. Click the Apply button.

s. (Optional but recommended) Configure the WKSN.

– Return to the Storage Manager window of Element Manager and click the General tab.

– From the Boot Target WWPN field, select the boot target from the drop-down menu or manually enter it.

– From the Boot FC LUN field, select the boot LUN from the drop-down menu or manually enter it.

– Click the Apply button.

Step 4 Boot your host.

2-39Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01

Chapter 2 Booting from a Fibre Channel SAN Booting an Image

2-40Cisco SFS Boot over InfiniBand User Guide for Linux

OL-12368-01