setting up ibm aix fiber channel mpio in infortrend

Version: 1.1

Updated: Oct., 2017

Abstract:

This document describes that how to configure the fiber channel

MPIO in IBM AIX with Infortrend EonStor DS family.

Setting up IBM AIX fiber channel

MPIO in Infortrend EonStor DS family

Application Note

Setting up IBM AIX fiber channel MPIO in Infortrend EonStor DS

Copyright © 2016 Infortrend Technology, Inc. All rights reserved. Infortrend VMware Solution – Best Practice

/ 16

Contents

Environment requirement .................................................................................................................. 3

AIX requirement ..................................................................................................................................... 3

Storage requirement .............................................................................................................................. 3

Steps for setting up the native MPIO ................................................................................................... 4

Checking the AIX system status ............................................................................................................. 4

Starting the setting ................................................................................................................................ 5

Test ....................................................................................................................................................... 12

Appendix .......................................................................................................................................... 15



/ 16

Environment requirement

AIX requirement

All AIX versions are supported, and the following version has been verified: AIX 6.1 ML4

Storage requirement

All EonStor DS Family models equipped with fiber channel adapters are supported. To use the fiber channel for MPIO configuration, make sure there are two fiber channel adapters installed in the IBM AIX server. To verify that the adapters are ready, type command “lsdev -Cc adapter”, and fcs0 and fcs1 should show up with status “available”.



/ 16

Steps for setting up the native MPIO Please follow the steps to complete the MPIO configuration, and the commands will be showed in dark

blue and the results will be showed in black or red.

Checking the AIX system status

# uname -a AIX aix 3 5 000F90AF4C00

# lsdev -Cc adapter ent0 Available 10-80 IBM 10/100 Mbps Ethernet PCI Adapter (23100020) fcs0 Available 20-58 FC Adapter fcs1 Available 20-59 FC Adapter fda0 Available 01-D1 Standard I/O Diskette Adapter lai0 Available 1F-00 GXT135P Graphics Adapter paud0 Available 01-Q2 Ultimedia Integrated Audio ppa0 Available 01-R1 CHRP IEEE1284 (ECP) Parallel Port Adapter sa0 Available 01-S1 Standard I/O Serial Port sa1 Available 01-S2 Standard I/O Serial Port scsi0 Available 10-60 Wide/Ultra-2 SCSI I/O Controller scsi1 Available 10-61 Wide/Ultra-2 SCSI I/O Controller sioka0 Available 01-K1-00 Keyboard Adapter siokma0 Available 01-K1 Keyboard/Mouse Adapter sioma0 Available 01-K1-01 Mouse Adapter siota0 Available 01-Q1 Tablet Adapter



/ 16

Starting the setting

1. Change the Peripheral Device Type to (7F) No Device Present on SANWatch/EmbbededRAIDWatch

2. Modify the shell file “aixmpio.sh” as shown in the example text box below.

3. Execute the shell file “aixmpio.sh” using command “./aixmpio.sh” or “bash aixmpio.sh” 4. Type command “bosboot –a” after changing the permission of shell file “aixmpio.sh”

#!/bin/ksh odmadd << \! /* one space each after “odmadd” and “<<” */ PdAt: uniquetype = "disk/fcp/mpioosdisk" attribute = "mpio_model_map" deflt = "0808IFT " /* five spaces after “0808IFT */ values = "041480" width = "" type = "R" generic = "" rep = "s" nls_index = 0 !



/ 16

# cat aixmpio.sh #!/bin/ksh odmadd << \! PdAt: uniquetype="disk/fcp/mpioosdisk" attribute="mpio_model_map" deflt="0808IFT " values="041480" width="" type="R" generic="" rep="s" nls_index=0 ! # chmod 711 aixmpio.sh # ./aixmpio.sh # bosboot -a bosboot: Boot image is 32802 512 byte blocks.

5. Type the command below to check if the fiber channel configuration for AIX MPIO is being set successfully. Command: odmget -q uniquetype=disk/fcp/mpioosdisk PdAt | grep deflt

# odmget -q uniquetype=disk/fcp/mpioosdisk PdAt | grep deflt deflt = "" deflt = "" deflt = "" deflt = "" deflt = "" deflt = "no" deflt = "none" deflt = "0x000000080000000000000200010124020a00000000000000000000070a05000000000000000000080c0000ffff0000ffffffff00040a06000100000000" deflt = "0x00000000010700ffff000000ff0202ffff070a00ffff0000000000ffff" deflt = "4" deflt = "0" deflt = "2" deflt = "1" deflt = "simple" deflt = "yes" deflt = "no" deflt = "no" deflt = "30" deflt = "60" deflt = "0x40000" deflt = "120" deflt = "28800" deflt = "28800" deflt = "0x00100000" deflt = "" deflt = "" deflt = "single_path" deflt = "PCM/friend/fcpother" deflt = "080EHITACHI OPEN-3/HITACHI OPEN-8/HITACHI OPEN-9/HITACHI OPEN-E/HITACHI OPEN-K/HITACHI

OPEN-L/HITACHI OPEN-M/HITACHI OPEN-V" deflt = "080EHITACHI 3380-K/HITACHI 3390-3/HITACHI 6586-K/HITACHI 6588-3" deflt = "0811HITACHI OP-C-3380/HITACHI OP-C-3390/HITACHI OP-C-6586/HITACHI OP-C-6588" deflt = "0811EMC SYMMETRIX" deflt = "080CIBM 2105"



/ 16

deflt = "240C" deflt = "0" deflt = "080CIBM 1750" deflt = "080CIBM 2107" deflt = "080CIBM 2145" deflt = "0808DGC ,B102CX/AX" deflt = "080BNETAPP LUN,6004N370/N330/N360/N520/N530/N550/N560/N760/N770/N780/N790" deflt = "080BNETAPP LUN,60062859-A/2862-A/2863-A/2864-A/2865-A/2866-A/2867-A/2868-A/2869-A" deflt = "080BNETAPP LUN,6006FAS270" deflt = "080BNETAPP LUN,6007FAS2020/FAS2050/FAS3020/FAS3040" deflt = "080BNETAPP LUN,6007FAS3050/FAS3070/FAS6030/FAS6040/FAS6070/FAS6080" deflt = "yes" deflt = "0808IFT " 6. Type the command below to check if the fiber channels are connectable.

“fcstat fcs0” and “fcstat fcs1”

# fcstat fcs0

FIBER CHANNEL STATISTICS REPORT: fcs0

Device Type: FC Adapter (df1000fd) Serial Number: VM64816748 Option ROM Version: 02C8211A Firmware Version: B1F2.10A10 World Wide Node Name: 0x20000000C95EA09A World Wide Port Name: 0x10000000C95EA09A

FC-4 TYPES: Supported: 0x0000012000000000000000000000000000000000000000000000000000000000 Active: 0x0000010000000000000000000000000000000000000000000000000000000000

Class of Service: 3 Port Speed (supported): 4 GBIT Port Speed (running): 4 GBIT Port FC ID: 0x000001 Port Type: Private Loop

Seconds Since Last Reset: 0

Transmit Statistics Receive Statistics ------------------- ------------------

Frames: 48 151 Words: 3072 3840

LIP Count: 0 NOS Count: 0 Error Frames: 0 Dumped Frames: 0 Link Failure Count: 61 Loss of Sync Count: 11 Loss of Signal: 6 Primitive Seq Protocol Error Count: 0 Invalid Tx Word Count: 478 Invalid CRC Count: 0

IP over FC Adapter Driver Information No DMA Resource Count: 0 No Adapter Elements Count: 0



/ 16

FC SCSI Adapter Driver Information No DMA Resource Count: 0 No Adapter Elements Count: 0 No Command Resource Count: 0

IP over FC Traffic Statistics Input Requests: 0 Output Requests: 0 Control Requests: 0 Input Bytes: 0 Output Bytes: 0

FC SCSI Traffic Statistics Input Requests: 0 Output Requests: 0 Control Requests: 0 Input Bytes: 0 Output Bytes: 0

# fcstat fcs1

FIBRE CHANNEL STATISTICS REPORT: fcs1

Device Type: FC Adapter (df1000fd) Serial Number: VM64816748 Option ROM Version: 02C8211A Firmware Version: B1F2.10A10 World Wide Node Name: 0x20000000C95EA09B World Wide Port Name: 0x10000000C95EA09B

FC-4 TYPES: Supported: 0x0000012000000000000000000000000000000000000000000000000000000000 Active: 0x0000010000000000000000000000000000000000000000000000000000000000 Class of Service: 3 Port Speed (supported): 4 GBIT Port Speed (running): 4 GBIT Port FC ID: 0x000001 Port Type: Private Loop

Seconds Since Last Reset: 0

Transmit Statistics Receive Statistics ------------------- ------------------

Frames: 46 151 Words: 3072 3840

LIP Count: 0 NOS Count: 0 Error Frames: 1 Dumped Frames: 0 Link Failure Count: 82 Loss of Sync Count: 12 Loss of Signal: 6 Primitive Seq Protocol Error Count: 0 Invalid Tx Word Count: 9 Invalid CRC Count: 1



/ 16

IP over FC Adapter Driver Information No DMA Resource Count: 0 No Adapter Elements Count: 0

FC SCSI Adapter Driver Information No DMA Resource Count: 0

No Adapter Elements Count: 0 No Command Resource Count: 0

IP over FC Traffic Statistics Input Requests: 0 Output Requests: 0 Control Requests: 0 Input Bytes: 0 Output Bytes: 0

FC SCSI Traffic Statistics Input Requests: 0 Output Requests: 0 Control Requests: 0

Input Bytes: 0 Output Bytes: 0

7. Map a partition to AIX server through the two fiber channels. 8. Rescan hardware changes on AIX server.

cfgmgr -v lsdev -Cc disk # the new disks “hdiskN” should be set to “MPIO other FC scsi disk drive” by now, as shown in the example below.

# cfgmgr # lsdev -Cc disk

hdisk0 Available 10-60-00-0,0 Other SCSI Disk Drive hdisk1 Available 20-58-01 MPIO Other FC SCSI Disk Drive

# lspv hdisk0 000f90afbee846db rootvg active hdisk1 000f90af727893c6 ift active

9. Check the disk information #lscfg -vpl hdisk1

10. Check the disk size #bootinfo –s hdisk1



/ 16

11. Configure MPIO parameters

Smitty mpio modify the two MPIO configurations as shown in the example below: Reservation Policy=no_reserve health check interva=60

# smitty mpio



/ 16

12. Modify the MPIO disk parameters

chdev -l hdiskN -a queue_depth=16 chdev -l hdiskN -a reassign_to=30 chdev -l hdiskN -a rw_timeout=70 # chdev -l hdisk1 -a queue_depth=16

hdisk1 changed # chdev -l hdisk1 -a reassign_to=30

hdisk1 changed # chdev -l hdisk1 -a rw_timeout=70

hdisk1 changed 13. If using the HACMP setting

Modify the configuration file under the path: /etc/cluster/disktype.lst Add one more row: disk/fcp/mpioosdisk FCPARRAY



/ 16

Test

a) Build volume group “smitty vg” using “hdiskN”. Type command: smitty mkvg # smitty mkvg

b) Build logical volume：smitty lv. Command: smitty mklv

# smitty mklv



/ 16

c) Create jfs2 file system：smitty fs. Command: smitty crfs

# smitty crfs



/ 16

d) mkdir /ift && chmod 777 /ift

Command: mkdir /ift The command isn’t necessary if the path “/ift” already exist; Command: chmod 777 /ift Set the permission for the directory according to your needs.

e) Mount the testing logical volume to the directory “ift”. Command: mount /ift

# mount /ift

f) Create data under the directory “ift”, then check which fiber channel it is currently using. Command: iostat -a 1 | grep fcs0 iostat -a 1 | grep fcs1

time dd if=/dev/zero of=/ift/testfile bs=131072 count=81920 #create a 10GB data iostat -a 1 | grep fcs #check the fiber channel traffic

g) Unplug the fiber optic line which is doing the “write” operation. The data transfer will switch to another line

within 20-30 seconds. Re-plug the fiber optic line that you just unplugged and the data transfer will return to the original fiber channel within 30 seconds



/ 16

Appendix shutdown –Fr #restart AIX server lscfg –vpl fcsN # Check corresponding slots of the fiber channel adapters

# lscfg -vpl fcs0 fcs0 P1-I1/Q1 FC Adapter Part Number....................LP11002-M4 Serial Number.................VM64816748 Network Address.............10000000C95EA09A ROS Level and ID............02C8211A Device Specific.(Z0)........1036406D Device Specific.(Z1)........00000000 Device Specific.(Z2)........00000000 Device Specific.(Z3)........03000909 Device Specific.(Z4)........FFC0115A Device Specific.(Z5)........02C8211A Device Specific.(Z6)........06C1211A Device Specific.(Z7)........07C1211A Device Specific.(Z8)........20000000C95EA09A Device Specific.(Z9)........BS2.10A10 Device Specific.(ZA)........B1F2.10A10 Device Specific.(ZB)........B2F2.10A10 Device Specific.(YL)........P1-I1/Q1 PLATFORM SPECIFIC Name: fibre-channel Model: LP11002-M4 Node: fibre-channel@b Device Type: fcp Physical Location: P1-I1/Q1

# lscfg -vpl fcs1 fcs1 P1-I1/Q2 FC Adapter Part Number.................LP11002-M4 Serial Number...............VM64816748 Network Address.............10000000C95EA09B ROS Level and ID............02C8211A Device Specific.(Z0)........1036406D Device Specific.(Z1)........00000000 Device Specific.(Z2)........00000000 Device Specific.(Z3)........03000909 Device Specific.(Z4)........FFC0115A Device Specific.(Z5)........02C8211A Device Specific.(Z6)........06C1211A Device Specific.(Z7)........07C1211A Device Specific.(Z8)........20000000C95EA09B Device Specific.(Z9)........BS2.10A10 Device Specific.(ZA)........B1F2.10A10 Device Specific.(ZB)........B2F2.10A10 Device Specific.(YL)........P1-I1/Q2 PLATFORM SPECIFIC



/ 16

Name: fibre-channel Model: LP11002-M4 Node: fibre-channel@b,1 Device Type: fcp Physical Location: P1-I1/Q2

umount /ift #unmount the multi-path device smitty rmlv #delete logical volume varyoffvg vgname #stop the volume group exportvg vgname #delete the volume group rmdev –dl hdiskname #delete the disk

setting up ibm aix fiber channel mpio in infortrend

Documents