© 2010 IBM Corporation

IBM Power Systems

Live Partition Mobility (LPM)

© 2010 IBM Corporation

IBM Power Systems

2

Where to find Live Partition Mobility InformationWhat’s New in LPM – updated each release of firmware

Find the latest feature here – even before Redbook is updatedhttp://www-01.ibm.com/support/knowledgecenter/POWER8/p8hc3/p8hc3_whatsnew.htm?cp=POWER8%2F1-8-1-3-7-0

IBM PowerVM Live Partition Mobility Redbookhttp://www.redbooks.ibm.com/abstracts/sg247460.html

• rt/knowledgecenter/POWER8/p8hc3/p8hc3_whatsnew.htm?cp=POWER8%2F1-8-1-3-7-0

• IBM PowerVM Live Partition Mobility Redbook• http://www.redbooks.ibm.com/abstracts/sg247460.html

© 2010 IBM Corporation

IBM Power Systems

3

Live Partition Mobility

Rebalance processing power across servers when

and where you need it

Reduce planned downtime by moving workloads to another server

during system maintenance

Move a running partition from one POWER6/POWER7/POWER8 server to another with no

application downtime

© 2010 IBM Corporation

IBM Power Systems

4

Partition Mobility: Active and Inactive LPARs

Active Partition Mobility Active Partition Migration is the actual movement of a running LPAR from one

physical machine to another without disrupting the operation of the OS and applications running in that LPAR.

Applicability Workload consolidation (e.g. many to one) Workload balancing (e.g. move to larger system) Planned CEC outages for maintenance/upgrades Impending CEC outages (e.g. hardware warning received)

Inactive Partition Mobility Inactive Partition Migration transfers a partition that is logically ‘powered off’ (not

running) from one system to another.

Partition Mobility supported on POWER6™ ,POWER7TM

and Power8 with AIX 5.3, AIX 6.1, AIX 7.1 and Linux and System i

© 2010 IBM Corporation

IBM Power Systems

5

Live Partition Mobility

MOnce enough memory pages have been

moved, suspend the source system

Create shell partition on target system

Validate environment for appropriate

resources

System #2System #1

StorageSubsystem

A

HMC

Hypervisor

VIOS

A

vscsi0

vtscsi0

vhost0

fcs0

en2(if)

VLAN

ent2SEA

ent0

ent1

en0(if)

ent1

Hypervisor

VIOS fcs0

en2(if)

VLAN

ent2SEA

ent0

ent1

A

vscsi0

en0(if)

ent1

vtscsi0

vhost0

MoverService

VASI

MoverService

VASI

Shell PartitionSuspended Partition AIX Client 1AIX Client 1Finish the migration

and remove the original LPAR

definitions

Start migrating memory pages

Create virtual SCSI devicesM M M M M M M M M M M M MMM

© 2010 IBM Corporation

IBM Power Systems

6

Live Partition Mobility – Control Points

Storage Area Network

Ethernet Network

Shared Disk(Storage Device)

HMC

LUN

PhysicalVolume LUN

ent0

ent2SEA

ent1virt

AIX Client Partition 1(Mobile Partition)

POWERHypervisor

System #1(Source System)

en2if

fcs0

vtscsi0

vhost0Virtual I/O Server

hdiskX

fcs0ent0

ent1virt

ent2SEA

en2if

System #2(Destination System)

POWERHypervisor

Virt

ual I

/O S

erve

r

AIX Client Partition 1

ServiceProcessor Se

rvic

ePr

oces

sor

HMC HMC

1

2

© 2010 IBM Corporation

IBM Power Systems

7

Live Partition Mobility Minimum Requirements Multiple POWER6 or POWER7 or Power8 systems PowerVM Enterprise Edition activations on systems System Firmware Recommended Min E*340_039 for POWER6 All Power7 and Power8 firmware releases supported HMC Version 7 Releases 3.2, 3.3, 3.4 (for remote HMC support), 3.5, 7.1 VIO Server

– V1.5.2.1-FP-11.1 for POWER6– V2.1.2.11-FP-22.1 for POWER7

Integrated Virtualization Manager if there is no HMC Shared SAN between servers Supported client operating systems

– Minimum AIX V5.3 TL7 SP1 or AIX V6.1 SP1 for POWER6– Minimum AIX V5.3 TL9 SP7 or AIX V6.1 TL2 SP8 for POWER7– Minimum SuSE Linux for Power V10 SP1– Minimum RedHat Linux for Power Version 5.1 (RHSA-2007:0993-13)– Moving LPAR can only contain virtual resources

• Virtual SCSI• Virtual Fibre Channel• Virtual Ethernet• Default virtual serial adapters

© 2010 IBM Corporation

IBM Power Systems

From “What’s New” website - Firmware support matrix for partition mobility

8

© 2010 IBM Corporation

IBM Power Systems

Managed System (host) Requirements

© 2010 IBM Corporation

IBM Power Systems

10

PowerVMTM Editions

Express Standard Enterprise

Maximum LPARs 1+2 / Server 10 / Core 10 / Core

Management IVM IVM, HMC IVM, HMC

Virtual I/O Server

Shared Dedicated Capacity

NPIV

Multiple Shared Processor Pools

Active Memory Sharing

Live Partition Mobility

© 2010 IBM Corporation

IBM Power Systems

11

PowerVM Enterprise Edition

Managed System (host) - Properties

© 2010 IBM Corporation

IBM Power Systems

12

Live Partition Capability Status - HMC

© 2010 IBM Corporation

IBM Power Systems

From “What’s New website” – Concurrent Migrations

Restrictions: Firmware levels 7.2 and 7.3 are restricted to eight concurrent migrations. With a 1 GB network adapter, up to four concurrent migrations are supported. From VIOS Version 2.2.2.0 or

later, you must have a 10 GB network adapter to support eight concurrent migrations. From VIOS Version 2.2.2.0, or later, you must have more than one pair of VIOS partitions to support more than

eight concurrent mobility operations. The Suspend/Resume feature for logical partitions is not supported on POWER8™ processor-based servers. Systems that are managed by the Integrated Virtualization Manager (IVM) support up to 8 concurrent migrations. To support the migration of up to 16 active or suspended mobile partitions from the source server to a single or

multiple destination servers, the source server must have at least two VIOS partitions that are configured as mover service partitions. Each mover service partition must support up to 8 concurrent partition migration operations. If all 16 partitions are to be migrated to the same destination server, then the destination server must have at least two mover service partitions configured, and each mover service partition must support up to 8 concurrent partition migration operations.

13

© 2010 IBM Corporation

IBM Power Systems

14

Logical Memory Block (LMB) Size

ent0 fcs0ent0

ent1virt

ent2SEA

en2if

ent2SEA

ent1virt

System #2(Destination System)

Storage Area Network

Ethernet Network

Shared Disk(Storage Device)

POWERHypervisor

Virt

ual I

/O S

erve

r

HMC

AIX Client Partition 1

LUN

AIX Client Partition 1(Mobile Partition)

POWERHypervisor

System #1(Source System)

en2if

PhysicalVolume LUN

fcs0

vtscsi0

vhost0Virtual I/O Server

hdiskX

Two (2) – POWER6/7 Servers

LMB size LMB size

© 2010 IBM Corporation

IBM Power Systems

15

Logical Memory Block (Memory Region Size)

Managed System - Properties

MUST match on Source / Destination Power Servers

© 2010 IBM Corporation

IBM Power Systems

16

Logical Memory Block (Memory Region Size)

LMB Modification Requires Reboot of Managed System

© 2010 IBM Corporation

IBM Power Systems

Virtual I/O Server (VIOS) Requirements

© 2010 IBM Corporation

IBM Power Systems

18

Mover Service Partition (MSP)

Required for ACTIVE Partition Mobility only

Provides VIO Server functions:– Asynchronously extracts, transports, installs partition

state during migrations

MSP must contain a single VASI virtual device– Virtual asynchronous services interface (VASI)– Provides communication between Hypervisors to gain

access to partition state

© 2010 IBM Corporation

IBM Power Systems

19

VIOS – MSP Flag set “ON” (Active Migration)

Source Server Destination Server

© 2010 IBM Corporation

IBM Power Systems

20

Live Partition Mobility (LPM) - Networking

SEA

POWER7 – Server-BPOWER7 – Server-A

ENT0

Same SUBNET on Source and Destination

SEA SEA SEA

EthernetController

ENT1

© 2010 IBM Corporation

IBM Power Systems

Virtual Machine (LPAR) Requirements

© 2010 IBM Corporation

IBM Power Systems

22

Processor Architecture Compatibility

Virtual Machine – Manage Profile

Mode Supported by Destination Host

© 2010 IBM Corporation

IBM Power Systems

23

Virtual Client I/O & Services

No Physical I/O Virtual Machine Services

© 2010 IBM Corporation

IBM Power Systems

24

Virtual Client – Networking

Destination host must support Client VLAN

Virtual Ethernet Supported VLAN

© 2010 IBM Corporation

IBM Power Systems

25

NPIV Provisioned Storage

Each WWPN pair Must be zoned to same LUN

© 2010 IBM Corporation

IBM Power Systems

26

Live Partition Mobility (LPM) - NPIV

npiv

POWER7 – Server-BPOWER7 – Server-A

FCS0 FCS1

World Wide Port Names Float between Servers

NPIV Capable adapter required on DestinationMulti-Pathing Software

npiv npiv npiv

© 2010 IBM Corporation

IBM Power Systems

27

LPM

© 2010 IBM Corporation

IBM Power Systems

28

Live Partition Mobility (LPM) - VSCSIPOWER7 – Server-BPOWER7 – Server-A

No_Reserve No_ReserveNo_Reserve No_Reserve

Repeat Process for every Possible DestinationMPIO

© 2010 IBM Corporation

IBM Power Systems

29

Virtual Client – Memory Restrictions

Inactive Mobility ONLY

© 2010 IBM Corporation

IBM Power Systems

30

Virtual Client – Shared Processor Pool

MSPP configuration not required on Destination host

© 2010 IBM Corporation

IBM Power Systems

31

Processor & Memory Availability

Destination host must have processor / memory Resources

© 2010 IBM Corporation

IBM Power Systems

Live Partition Mobility - Migration

© 2010 IBM Corporation

IBM Power Systems

33

© 2010 IBM Corporation

IBM Power Systems

34

© 2010 IBM Corporation

IBM Power Systems

35

© 2010 IBM Corporation

IBM Power Systems

36

Initiating Live Partition Mobility

Migration Activities

Migrate

Validate

Recover

© 2010 IBM Corporation

IBM Power Systems

37

Live Partition Mobility - Validation

© 2010 IBM Corporation

IBM Power Systems

38

Live Partition Mobility - Validation

Possible Results

Errors

Warnings

Migration Screen

© 2010 IBM Corporation

IBM Power Systems

39

Live Partition Mobility - Migrate

© 2010 IBM Corporation

IBM Power Systems

40

Live Partition Mobility - Migrating

© 2010 IBM Corporation

IBM Power Systems

41

Live Partition Mobility – Migration Completed

© 2010 IBM Corporation

IBM Power Systems

42

Live Partition Mobility – Migration Completed

© 2010 IBM Corporation

IBM Power Systems

43

© 2010 IBM Corporation

IBM Power Systems

44

© 2010 IBM Corporation

IBM Power Systems

End of Presentation