vi3_35_25_u2_mscs

8/2/2019 vi3_35_25_u2_mscs

1/50

Setup forMicrosoft Cluster Service

Update 2 and later for

ESX Server 3.5, ESX Server 3i version 3.5, VirtualCenter 2.5

8/2/2019 vi3_35_25_u2_mscs

2/50

VMware, Inc.3401 Hillview Ave.Palo Alto, CA 94304www.vmware.com

2 VMware, Inc.

Setup for Microsoft Cluster Service

You can find the most up-to-date technical documentation on our Web site at:

http://www.vmware.com/support/

The VMware Web site also provides the latest product updates.

If you have comments about this documentation, submit your feedback to:

[email protected]

20072009 VMware, Inc. All rights reserved. This product is protected by U.S. and internationalcopyright and intellectual property laws. VMware products are covered by one or more patentslisted at http://www.vmware.com/go/patents.

VMware, the VMware boxes logo and design, Virtual SMP and VMotion are registered trademarks ortrademarks of VMware, Inc. in the United States and/or other jurisdictions. All other marks and names

mentioned herein may be trademarks of their respective companies.


Revision: 20090814Item: EN-000081-03
http://www.vmware.com/supportmailto:[email protected]:[email protected]://www.vmware.com/supporthttp://www.vmware.com/support/

8/2/2019 vi3_35_25_u2_mscs

3/50

VMware, Inc. 3

Contents

AboutThisBook 5

1 GettingStarted 9Introduction 9

ClusteringSoftware 10

ClusteringHardware 10

ClusteringConfigurations 10

ClusteringVirtualMachinesonaSingleHost(ClusterinaBox) 10

ClusteringVirtualMachinesAcrossPhysicalHosts(ClusterAcrossBoxes) 11

ClusteringPhysicalMachineswithVirtualMachines(Standby Host) 13

PrerequisitesforClustering 13

PrerequisitesforClusterinaBox 14

PrerequisitesforClusteringAcrossBoxes 14

PrerequisitesforStandbyHostClustering 15

SharedStorageSummary 15

Caveats,Restrictions,andRecommendations 16

RecommendationsforUsingMSCSandBootfromSAN 17

SettingupaClusteredContinuousReplicationEnvironmentforMicrosoftExchange 18

2 ClusteringVirtualMachinesonOnePhysicalHost 19Task1:CreatingtheFirstNode 19

Task2:CreatingtheSecondNode 20

Task3:AddingHardDiskstoNode1 21


3 ClusteringVirtualMachinesAcrossPhysicalHosts 25Task1:CreatingtheFirstNode 25

Task2:CreatingtheSecondNode 27


Task4:

Adding

Hard

Disks

to

Node2 30

8/2/2019 vi3_35_25_u2_mscs

4/50


4 VMware, Inc.

4 ClusteringPhysicalandVirtualMachines 33Task1:CreatingtheFirstNode 33

Task2:

Creating

the

Second

Node 34

Task3:InstallingMicrosoftClusterService 36

Task4:CreatingAdditionalPhysical/VirtualPairs 36

5 UpgradingClusteredVirtualMachines 37LegacyClusterSetupOptions 37

UpgradingClusterinaBox(CIB) 38

UpgradingCIB:SharedRDMsandBootDisksinSeparateVMFSVolumes 38UpgradingCIB:RDMsandBootDisksinSameVMFSVolume 39

UpgradingCIB:VirtualDisks 40

UpgradingClusterAcrossBoxes 40

UsingSharedPassThroughRDMs 40

UpgradingaClusterwithFilesinSharedVMFS2Volumes 41

UpgradingClustersUsingPhysicaltoVirtualClustering 42

Appendix:SetupChecklist 43

Index 47

8/2/2019 vi3_35_25_u2_mscs

5/50

VMware, Inc. 5

Thisbook,SetupforMicrosoftClusterService,firstdiscussesthetypesofclustersyoucanimplementusingvirtualmachineswithMicrosoftClusterService.Itthengives

stepbystepinstructionsforeachtypeofcluster,andconcludeswithachecklistof

clusteringrequirementsandrecommendations.

SetupforMicrosoftClusterServicecoversbothESXServer3.5andESXServer3iversion 3.5.Foreaseofdiscussion,thisbookusesthefollowingproductnaming

conventions:

FortopicsspecifictoESXServer3.5,thisbookusesthetermESXServer3.

FortopicsspecifictoESXServer3iversion3.5,thisbookusestheterm

ESX Server 3i.

Fortopicscommontobothproducts,thisbookusesthetermESXServer.

Whentheidentificationofaspecificreleaseisimportanttoadiscussion,thisbook

referstotheproductbyitsfull,versionedname.

WhenadiscussionappliestoallversionsofESXServerforVMware

Infrastructure 3,thisbookusesthetermESXServer3.x.

Intended Audience

ThisbookisforsystemadministratorswhoarefamiliarwithbothVMwaretechnology

andMicrosoftClusterService.

About This Book

NOTE ThisisnotaguidetousingMicrosoftClusterService.UseyourMicrosoftdocumentationforinformationoninstallationandconfigurationofMicrosoftClusterService.

8/2/2019 vi3_35_25_u2_mscs

6/50


6 VMware, Inc.

Document Feedback

VMwarewelcomesyoursuggestionsforimprovingourdocumentation.Ifyouhave

comments,sendyourfeedbackto:

[email protected]

VMware Infrastructure Documentation

TheVMwareInfrastructuredocumentationconsistsofthecombinedVMware

VirtualCenterandESXServerdocumentationset.

Abbreviations Used in Figures

ThefiguresinthisbookusetheabbreviationslistedinTable 1.

Technical Support and Education Resources

Thefollowing

sections

describe

the

technical

support

resources

available

to

you.

To accessthecurrentversionsofthisbookandotherbooks,goto:

http://www.vmware.com/support/pubs.

Online and Telephone Support

Useonlinesupporttosubmittechnicalsupportrequests,viewyourproductand

contractinformation,

and

register

your

products.

Go

to:

http://www.vmware.com/support

Customerswithappropriatesupportcontractsshouldusetelephonesupportforthe

fastestresponseonpriority1issues.Goto:

http://www.vmware.com/support/phone_support.html

Table 1. Abbreviations

Abbreviation Description

FC FibreChannel

SAN Storageareanetworktypedatastoresharedbetweenmanagedhosts

VM# Virtualmachinesonamanagedhost
mailto:[email protected]://www.vmware.com/support/pubshttp://www.vmware.com/supporthttp://www.vmware.com/support/phone_support.htmlhttp://www.vmware.com/support/phone_support.htmlhttp://www.vmware.com/supporthttp://www.vmware.com/support/pubsmailto:[email protected]

8/2/2019 vi3_35_25_u2_mscs

7/50

VMware, Inc. 7

About This Book

Support Offerings

FindouthowVMwaresupportofferingscanhelpmeetyourbusinessneeds.Goto:

http://www.vmware.com/support/services

VMware Education Services

VMwarecoursesofferextensivehandsonlabs,casestudyexamples,andcourse

materialsdesignedtobeusedasonthejobreferencetools.Formoreinformationabout

VMwareEducationServices,goto:

http://mylearn1.vmware.com/mgrreg/index.cfm
http://www.vmware.com/support/serviceshttp://mylearn1.vmware.com/mgrreg/index.cfmhttp://mylearn1.vmware.com/mgrreg/index.cfmhttp://www.vmware.com/support/services

8/2/2019 vi3_35_25_u2_mscs

8/50


8 VMware, Inc.

8/2/2019 vi3_35_25_u2_mscs

9/50

VMware, Inc. 9

1

Thischapterintroducesclustering,discussesthedifferenttypesofclustersand

prerequisitesforeachtype,andincludessomecaveatsandrecommendationsinthe

followingsections:

Introductiononpage 9

ClusteringConfigurationsonpage 10

PrerequisitesforClusteringonpage 13

Caveats,Restrictions,andRecommendationsonpage 16

Recommendations forUsingMSCSandBootfromSANonpage 17

SettingupaClusteredContinuousReplicationEnvironmentforMicrosoft

Exchangeonpage 18

Introduction

Thisdocumentdiscussestraditionalclustering(hotstandby)usingMSCSinaVMware

Infrastructureenvironment.Clusteringvirtualmachinescanreducehardwarecostsof

traditionalhighavailabilityclusters.

VMwarealsosupportsacoldstandbyclusteringsolutionusingVMwareHAin

conjunctionwithVirtualCenterclusters.VMwareHAfunctionality,aswellasthe

differencesbetweenthetwoapproaches,isdiscussedintheResourceManagementGuide.

Getting Started

1

8/2/2019 vi3_35_25_u2_mscs

10/50


10 VMware, Inc.

Anumberofdifferentapplicationsuseclustering:

Statelessapplications,suchasWebserversandVPNservers.

Applicationsthathavebuiltinrecoveryfeatures,suchasdatabaseservers,mailservers,andfileservers.

VirtualCenterServercanbeusedasaclusteredapplication.See

http://www.vmware.com/pdf/VC_MSCS.pdf .

Clustering Software

Severalclusteringsoftwareproductscanbeusedinconjunctionwithvirtualmachines.However,VMwaretestsclusteringonlywithMSCSandsupportsonlyMSCS.

Clustering Hardware

Atypicalclusteringsetupincludes:

Disksthataresharedbetweennodes.Ashareddiskisrequiredasaquorumdisk.

Inaclusteracrossboxes,theshareddiskmustbeonanFCSAN.

Aprivateheartbeatnetworkbetweennodes.

Clustering Configurations

SeveralclusteringconfigurationsarepossibleinaVMwareInfrastructureenvironment

andarebrieflydiscussedbelow:

ClusteringVirtualMachinesonaSingleHost(ClusterinaBox)onpage 10

ClusteringVirtualMachinesAcrossPhysicalHosts(ClusterAcrossBoxes)on

page 11

ClusteringPhysicalMachineswithVirtualMachines(Standby Host)onpage 13

Clustering Virtual Machines on a Single Host (Cluster in a Box)AclusterinaboxconsistsoftwoclusteredvirtualmachinesonthesameESXServer

hostconnectedtothesamestorage(eitherlocalorremote).SeeFigure 11foran

example.

8/2/2019 vi3_35_25_u2_mscs

11/50

VMware, Inc. 11

Chapter 1 Getting Started

Figure 1-1. Cluster in a Box

Thisconfigurationprotectsagainstfailuresattheoperatingsystemandapplication

level,butitdoesnotprotectagainsthardwarefailures.

Chapter 2,ClusteringVirtualMachinesonOnePhysicalHost,discusseshowtoset

upaclusterinaboxusingMSCS.

Clustering Virtual Machines Across Physical Hosts (ClusterAcross Boxes)

A

cluster

across

boxes

configuration

provides

both

hardware

and

software

level

protectionbyplacingtheclusternodesonseparateESXServerhosts,asshownin

Figure 12.ThisconfigurationrequiressharedstorageonanFCSANforthequorum

disk.

Thisconfigurationprotectsagainstsoftwarefailuresandhardwarefailuresonthe

physicalmachine.

Chapter 3,ClusteringVirtualMachinesAcrossPhysicalHosts,discusseshowtoset

upaclusteracrossboxesusingMSCS.

physical machine

storage (local or SAN)

private network

virtual machineNode2


clustersoftware

clustersoftware

public network

8/2/2019 vi3_35_25_u2_mscs

12/50


12 VMware, Inc.

Figure 1-2. Cluster Across Boxes

Youcanexpandtheclusteracrossboxesmodelandplacemultiplevirtualmachineson

multiplephysicalmachines.Forexample,youcanconsolidatefourclustersoftwo

physicalmachineseachtotwophysicalmachineswithfourvirtualmachineseach.

This setupprotectsyoufrombothhardwareandsoftwarefailures.Atthesametime,

thissetupresultsinsignificanthardwarecostsavings.

Figure 1-3. Clustering Multiple Virtual Machines Across Hosts

Figure 13shows

how

four

two

node

clusters

can

be

moved

from

eight

physical

machinestotwo.

physical machine physical machine

storage (SAN)

privatenetwork

publicnetwork



clustersoftware

clustersoftware

physicalmachine

physicalmachine

VM1

VM3

VM5

VM7

VM2

VM4

VM6

VM8

1

3

5

7

2

4

6

8

8/2/2019 vi3_35_25_u2_mscs

13/50

VMware, Inc. 13


Clustering Physical Machines with Virtual Machines(Standby Host)

Forasimpleclusteringsolutionwithlowhardwarerequirements,youmightchoosetohaveonestandbyhost.Setupyoursystemtohaveavirtualmachinecorrespondingto

eachphysicalmachineonthestandbyhost,andthencreateclusters,oneeachforeach

physicalmachineanditscorrespondingvirtualmachine.Incaseofhardwarefailurein

oneofthephysicalmachines,thevirtualmachineonthestandbyhostcantakeoverfor

thatphysicalhost.

Figure 14showsastandbyhostusingthreevirtualmachinesonasinglephysical

machine.Eachvirtualmachineisrunningclusteringsoftware.

Figure 1-4. Clustering Physical and Virtual Machines

Prerequisites for ClusteringUsingMSCSinanyoftheconfigurationsdiscussedrequirespreparation.Thissection

liststheprerequisitesfortheESXServerhostandthevirtualmachine.Foradditional

softwareprerequisiteinformation,seetheGuidetoCreatingandConfiguringaServerClusterunderWindowsServer2003ontheMicrosoftWebsite.Appendix:SetupChecklistonpage 43summarizesprerequisitesfordifferenttypes

ofclusters.

physicalmachine

clustersoftware

clustersoftware

virtualmachine

cluster

software

virtualmachine

clustersoftware

virtual

machineclustersoftware

clustersoftware

8/2/2019 vi3_35_25_u2_mscs

14/50


14 VMware, Inc.

Prerequisites for Cluster in a Box

Tosetupaclusterinabox,youmusthave:

ESXServerhost,oneofthefollowing:

ESXServer3AnESXServerhostwithaphysicalnetworkadapterfortheserviceconsole.Iftheclusteredvirtualmachinesneedtoconnectwithexternal

hosts,thenanadditionalnetworkadapterishighlyrecommended.

ESXServer3iAnESXServerhostwithaphysicalnetworkadapterfortheVMkernel.Iftheclusteredvirtualmachinesneedtoconnectwithexternal

hosts,

a

separate

network

adapter

is

recommended. AlocalSCSIcontroller.IfyouplantouseaVMFSvolumethatexistsonaSAN,you

needanFCHBA(QLogicorEmulex).

Youcansetupsharedstorageforaclusterinaboxeitherbyusingavirtualdiskorby

usingaremoterawdevicemapping(RDM)LUNinvirtualcompatibilitymode

(nonpassthroughRDM).

Whenyou

set

up

the

virtual

machine,

you

need

to

configure:

Twovirtualnetworkadapters.

Aharddiskthatissharedbetweenthetwovirtualmachines(quorumdisk).

Optionally,additionalharddisksfordatathataresharedbetweenthetwovirtual

machinesifyoursetuprequiresit.Whenyoucreateharddisks,asdescribedinthis

document,thesystemcreatestheassociatedvirtualSCSIcontrollers.

Prerequisites for Clustering Across Boxes

Theprerequisitesforclusteringacrossboxesaresimilartothoseforclusterinabox.

You musthave:

ESXServerhost.VMwarerecommendsthreenetworkadaptersperhostforpublic

networkconnections.Theminimumconfigurationis:

ESXServer

3An

ESX

Server

host

configured

with

at

least

two

physical

networkadaptersdedicatedtothecluster,oneforthepublicandoneforthe

privatenetwork,andonenetworkadapterdedicatedtotheserviceconsole.

ESXServer3iAnESXServerhostconfiguredwithatleasttwophysicalnetworkadaptersdedicatedtothecluster,oneforthepublicandoneforthe

privatenetwork,andonenetworkadapterdedicatedtotheVMkernel.

SharedstoragemustbeonanFCSAN.

YoumustuseanRDMinphysicalorvirtualcompatibilitymode(passthrough

RDMornonpassthroughRDM).Youcannotusevirtualdisksforsharedstorage.

8/2/2019 vi3_35_25_u2_mscs

15/50

VMware, Inc. 15


Prerequisites for Standby Host Clustering

Theprerequisitesforstandbyhostclusteringaresimilartothoseforclusteringacross

boxes.You

must

have:

ESXServerhost.VMwarerecommendsthreenetworkadaptersperhostforpublic

networkconnections.Theminimumconfigurationis:

ESXServer3AnESXServerhostconfiguredwithatleasttwophysicalnetworkadaptersdedicatedtothecluster,oneforthepublicandoneforthe

privatenetwork,andonenetworkadapterdedicatedtotheserviceconsole.

ESXServer

3i

An

ESX

Server

host

configured

with

at

least

two

physical

networkadaptersdedicatedtothecluster,oneforthepublicandoneforthe

privatenetwork,andonenetworkadapterdedicatedtotheVMkernel.

YoumustuseRDMsinphysicalcompatibilitymode(passthroughRDM).

You cannotusevirtualdiskorRDMinvirtualcompatibilitymode

(nonpassthroughRDM)forsharedstorage.

YoucannothavemultiplepathsfromtheESXServerhosttothestorage.

Runningthirdpartymultipathingsoftwareisnotsupported.Becauseofthis

limitation,VMwarestronglyrecommendsthatthereonlybeasinglephysicalpath

fromthenativeWindowshosttothestoragearrayinaconfigurationof

standbyhostclusteringwithanativeWindowshost.TheESXServerhost

automaticallyusesnativeESXServermultipathing,whichcanresultinmultiple

pathstosharedstorage.

Usethe

STORport

Miniport

driver

for

the

FC

HBA

(QLogic

or

Emulex)

in

the

physicalWindowsmachine.

Shared Storage Summary

Table 11illustrateswhichsharedstoragesetupissupportedforwhichclustering

solution.Thesetupforeachsolutionisshowninbold.Table 1-1. Shared Storage Summary

Cluster in a

Box

Cluster

Across Boxes

Standby Host

Clustering

Virtualdisks Yes No No

PassthroughRDM

(physicalcompatibilitymode)

No Yes Yes

Nonpass

through

RDM

(virtualcompatibilitymode)Yes Yes No

8/2/2019 vi3_35_25_u2_mscs

16/50


16 VMware, Inc.

Caveats, Restrictions, and Recommendations

Thissectionsummarizescaveats,restrictions,andrecommendationforusingMSCSin

aVMwareInfrastructureenvironment.

VMwareonlysupportsthirdpartyclustersoftwarethatisspecificallylistedas

supportedinthehardwarecompatibilityguides.ForlatestupdatestoVMware

supportforMicrosoftoperatingsystemversionsforMSCS,orforanyother

hardwarespecificsupportinformation,seetheStorage/SANCompatibilityGuideforESXServer3.5andESXServer3i.

Each

virtual

machine

has

five

PCI

slots

available

by

default.

A

cluster

uses

four

of

theseslots(twonetworkadaptersandtwoSCSIhostbusadapters),leavingone

PCIslotforathirdnetworkadapter(orotherdevice),ifneeded.

VMwarevirtualmachinescurrentlyemulateonlySCSI2reservationsanddonot

supportapplicationsusingSCSI3persistentreservations.

UseLSILogicvirtualSCSIadapter.

UseWindows

Server

2003

SP2

(32

bit

or

64

bit)

or

Windows

2000

Server

SP4.

VMwarerecommendsWindowsServer2003.

Usetwonodeclustering.

ClusteringisnotsupportedoniSCSIorNFSdisks.

NICteamingisnotsupportedwithclustering.

(SEEUPDATE)ThebootdiskoftheESXServerhostshouldbeonlocalstorage. MixedHBAenvironments(QLogicandEmulex)onthesamehostarenot

supported.

MixedenvironmentsusingbothESXServer2.5andESXServer3.xarenot

supported.

ClusteredvirtualmachinescannotbepartofVMwareclusters(DRSorHA).

YoucannotusemigrationwithVMotiononvirtualmachinesthatrunclustersoftware.

SettheI/Otimeoutto60secondsormorebymodifying

HKEY_LOCAL_MACHINE\System\CurrentControlSet\Services\Disk\

TimeOutValue.

ThesystemmightresetthisI/Otimeoutvalueifyourecreateacluster.Youmust

reset

the

value

in

that

case.

8/2/2019 vi3_35_25_u2_mscs

17/50

VMware, Inc. 17


Usetheeagerzeroedthickformatwhenyoucreatedisksforclusteredvirtual

machines.Bydefault,theVIClientorvmkfstoolscreatedisksinzeroedthick

format.Youcanconvertadisktoeagerzeroedthickformatbyimporting,

cloning,orinflatingthedisk.Disksdeployedfromatemplatearealsoineagerzeroedthickformat.

Adddisksbeforenetworking,asexplainedintheVMwareKnowledgeBasearticle

athttp://kb.vmware.com/kb/1513.

Recommendations for Using MSCS and Boot from SAN

(SEEUPDATE)ThissectiongivessomerecommendationsforclusteredvirtualmachinesthatusebootfromSAN.ForgeneralinformationaboutbootfromSAN,seetheFibreChannelSANConfigurationGuide.

BootingfromSANiscomplex.Problemsyouencounterinphysicalenvironments

extendto

virtual

environments.

VMware

recommends

the

following

when

you

put

the

bootdiskofavirtualmachineyouwishtouseinaclustersetuponaSAN.

ConsiderthebestpracticesforbootfromSANthatMicrosoftpublishesinthe

followingknowledgebasearticle:

http://support.microsoft.com/kb/305547/en-us

UseStorPortlsilogicdriversinsteadofSCSIportdriverswhenrunningMicrosoft

ClusterService

for

Windows

Server

2003

guest

operating

systems.

VMwaredoesnotrecommendmigrationwithVMotionofclusteredvirtual

machines.

GiventhecomplexityofbootingclusteredvirtualmachinesfromSAN,VMware

recommendsyoutestclusteredconfigurationsindifferentfailoverscenarios

beforeyouputthemintoproductionenvironments.

Ifyourenvironmentissusceptibletoconditionsthatcauseclusternodeserverstoloseallpathstothestoragearray,dothefollowing(forallclusterconfigurations):

Setbussharingforthebootdisk(scsi0)toNone.

Setscsi0.returnBusyOnNoConnectStatustoFALSEforeachnode.See

Tosetscsi0.returnBusyOnNoConnectStatusonpage 18.

Setuptheguestoperatingsystemtorestartautomaticallyafteracrash.See

Tosetupautomaticrestartfortheguestoperatingsystemonpage 18.

Whenallpathstostoragearelost,theactivenodewillcrashandattempttoreboot.

NOTE YoucannotuseclusteredvirtualmachinesthatbootfromaniSCSISAN.

8/2/2019 vi3_35_25_u2_mscs

18/50


18 VMware, Inc.

To set scsi0.returnBusyOnNoConnectStatus

1 LogintoaVIClientandselectthevirtualmachinefromtheinventorypanel.

Theconfigurationpageforthisvirtualmachineappears.

2 IntheSummarytab,clickEditSettings.3 ClickOptions>Advanced>General,andthenclickConfigurationParametersto

opentheConfigurationParametersdialogbox.

4 ClickAddRow.5 Type

scsi0.returnBusyOnNoConnectStatus

in

the

Name

column

and

FALSE

in

theValuecolumn.

6 ClickOKtoclosetheConfigurationParametersdialogbox,andthenclickOKagain to close theVirtualMachinePropertiesdialog box.

To set up automatic restart for the guest operating system

1 RightclickMyComputer.

2 ChooseProperties,thenselecttheAdvancedtabandclickSettingsunderStartup

andRecovery.

3 ChooseAutomaticallyrestartonsystemfailure.Setting up a Clustered Continuous ReplicationEnvironment for Microsoft Exchange

Youcansetupaclusteredcontinuousreplication(CCR)environmentforMicrosoft

ExchangeinyourVMwareInfrastructureenvironment.

MicrosoftdiscussessetupforExchangeServer2007ontheirWebsiteat:

http://technet.microsoft.com/en-us/library/bb124558.aspx

MicrosoftdiscussessetupofCCRclustersontheirWebsiteat:

http://technet.microsoft.com/en-us/library/bb123996.aspx

WhenworkinginaVMwareInfrastructureenvironment,youusevirtualmachines

insteadofusingphysicalmachinesastheclustercomponents.Usephysical

compatibilitymodeRDMs.IfthebootdisksoftheCCRvirtualmachinesareonaSAN,

seeRecommendationsforUsingMSCSandBootfromSANonpage 17.

8/2/2019 vi3_35_25_u2_mscs

19/50

VMware, Inc. 19

2

ThischapterguidesyouthroughcreatingatwonodeMSCSclusteronasingle

ESX Servermachine.Theprocessconsistsoffourtasks,discussedinthefollowing

sections:

Task1:CreatingtheFirstNodeonpage 19

Task2:CreatingtheSecondNodeonpage 20

Task3:AddingHardDiskstoNode1onpage 21


Task 1: Creating the First Node

Creatingthe

first

node

consists

of

these

major

steps,

discussed

in

detail

in

this

section.

Creatingthevirtualmachineforthefirstnodewithtwovirtualnetworkadapters.

Installingtheoperatingsystem.

Poweringdownthefirstnode.

Clustering Virtual Machines

on One Physical Host

2

NOTE MicrosoftClusterServiceisalreadyinstalledforWindowsServer2003.SeetheGuidetoCreatingandConfiguringaServerClusterunderWindowsServer2003andotherdocumentationontheMicrosoftWebsite.

ForWindows2000Server,youmustinstalltheMicrosoftClusterServicesoftware.

NOTE Beforeyoucreateavirtualmachine,createavirtualdiskineagerzeroedthickformatusingvmkfstools,andselectthatdiskduringvirtualmachinecreation.

S t f Mi ft Cl t S i

8/2/2019 vi3_35_25_u2_mscs

20/50


20 VMware, Inc.

To create and configure the first nodes virtual machine

1 LaunchaVIClientandconnecttotheESXServerhostoraVirtualCenterServer.

Use

the

user

name

and

password

of

the

user

who

will

own

the

virtual

machine.

2 Intheinventorypanel,rightclickthehostandchooseNewVirtualMachine.3 Makethefollowingselectionsusingthewizard.

4 InstallaWindowsServer2000orWindowsServer2003operatingsystemonthe

virtualmachine.

Task 2: Creating the Second Node

CreatingthesecondnodeinvolvescloningtheNode1virtualmachineandaddingdisks

thatpointtothesharedstorage.YoucanclonethenodeusingaVIClientconnectedto

aVirtualCenterServer,asdescribedbelow,orusingvmkfstools.SeetheServerConfigurationGuideforareferencetovmkfstools.

Table 2-1. New Virtual Machine Properties

Page Selection

WizardType Typical.

NameandLocation Chooseaname(forexample,Node1)andlocation.

ResourcePool Selecttheresourcepoolforthevirtualmachine,orselectthehostiftherearenoresourcepools.

Datastore Chooseadatastoreasthelocationforthevirtualmachineconfigurationfileandthevirtualmachinedisk(.vmdk)file.

GuestOperatingSystem ChoosetheWindows2000ServerorWindowsServer2003

operatingsystemthatyouintendtoinstall.

CPUs Usethedefaultunlessyouhavespecialrequirements.

Memory Usethedefaultunlessyouneedadditionalmemoryandyourserversupportsit.

Network ChangeNICstoConnectto2,andselectthesecondnetworkforthesecondNIC.

YouneedoneNICfortheprivatenetworkandthesecond

NICforthepublicnetwork.

VirtualDiskCapacity IfyouneedaprimarySCSIdisklargerthan4GB,entertheappropriatevalueintheCapacityfield.

ReadytoComplete ClickOKtocreatethevirtualmachine.

Chapter 2 Clustering Virtual Machines on One Physical Host

8/2/2019 vi3_35_25_u2_mscs

21/50

VMware, Inc. 21


To clone the Node1 virtual machine

1 Shutdowntheguestoperatingsystemandpoweroffthevirtualmachine.

2 IntheVIClientinventorypanel,selectNode1andchooseClonefromtherightbuttonmenu.

3 Makethefollowingselectionswiththewizard:

Youhavenowcreatedyoursecondclusternode,avirtualmachinewithtwonetwork

adaptersonwhichtheoperatingsystemisinstalled.

Task 3: Adding Hard Disks to Node1

Afteryouhavecreatedtwovirtualmachinesasclusternodes,youarereadytoadda

sharedquorum

disk.

You

can

also

add

additional

shared

disks

to

the

cluster

if

you

plan

onclusteringadditionaldatadisks.Afteryouhaveaddeddisks,youcanconfigurethe

clusterspublicandprivateIPaddresses.

To prepare for adding disks

Youmustzerooutthedisksyouusewithaclusterinaboxscenario.Youcanuse

vmkfstoolstodoso.IfyourunonanESXServer3ihost,youusethevmkfstools

RemoteCLI,

which

you

must

execute

with

connection

parameters.

See

the

ESXServer3iConfigurationGuideforinformationoninstallingandusingRemoteCLIcommands.

Table 2-2. Cloned Virtual Machine Properties

Page Selection


ResourcePartition Selecttheresourcepoolforthevirtualmachine,orselectthehostiftherearenoresourcepools.

Datastore Chooseadatastoreasthelocationforthevirtualmachineconfigurationfileandthe.vmdkfile.

Customization ChooseDonotcustomize.ReadytoComplete ClickOKtocreatethevirtualmachine.

CAUTION Whenyouzerooutadisk,youlosealldata.


8/2/2019 vi3_35_25_u2_mscs

22/50


22 VMware, Inc.

Tocreateandzerooutthedisk,usethefollowingcommand:

Tozerooutanexistingdisk,useathefollowingcommand:

Repeat

this

process

for

each

virtual

disk

you

want

to

use

as

a

shared

disk

in

the

cluster.

Forexample,ifyouhaveonequorumdiskandonesharedstoragedisk,youmustrun

thetoolonbothdisks.

To add a quorum disk and optional shared storage disk

1 SelectthevirtualmachineyoucreatedandchooseEditSettings.2 ClickAdd,selectHardDisk,andclickNext.3 SelectChooseanexistingvirtualdiskandselectoneofthedisksyouprepared.

SeeToprepareforaddingdisksonpage 21.

4 Chooseanewvirtualdevicenode.Forexample,chooseSCSI(1:0),andusethedefaultmode.

5 ClickFinish.

ThewizardcreatesbothanewharddiskandanewSCSIcontroller.

Service

Console

vmkfstools -c -d eagerzeroedthick -a lsilogic

/vmfs/volumes//.vmdk

Remote

CLI

vmkfstools.pl --server --username

--password -c

-d eagerzeroedthick -a lsilogic


Service

Console

vmkfstools [-w |--writezeroes]


Remote

CLI

vmkfstools.pl --server --username

--password [-w |--writezeroes]


NOTE YoucanalsouseamappedSANLUNsettovirtualcompatibilitymode.Inthatcase,youdontneedtorunthevmkfstoolscommandslistedinTo

prepareforaddingdisks.

NOTE Thismustbeanewcontroller.YoucannotuseSCSI0.


8/2/2019 vi3_35_25_u2_mscs

23/50

VMware, Inc. 23

p g y

6 SelectthenewSCSIcontrollerandclickChangeControllerType.MakesurethecontrollerissettoLsiLogic(thedefault).BusLogicisnotsupportedwhenyouuseMSCSwithESXServer3.0orlater.

7 Inthesamepanel,setSCSIBusSharingtoVirtualandclickOK.

8 Ifyourequireadditionalshareddatadisks,repeatStep 1throughStep 6but

chooseanewtargetdevice,suchasSCSI(1:1),onthecontrollerthatwasjustcreated.Figure 21showsyoursetupatthispoint.

Figure 2-1. Cluster in a Box Setup for One Node

physicalmachine


local or remote storage

FC

VNIC1 VNIC2

NIC1

VSCSI1 VSCSI2

SCSI1 SCSI2

virtual switch1 virtual switch2

remote storage


8/2/2019 vi3_35_25_u2_mscs

24/50

24 VMware, Inc.


AfteryousetupNode1,repeattheprocesstoconfigureIPaddressesandaddoneor

moredisks

to

Node2.

SetuptheIPaddressessotheprivateandpublicnetworksmatchthoseofNode1.

PointthequorumdisktothesamelocationastheNode1quorumdisk.Pointany

sharedstoragediskstothesamelocationastheNode1sharedstoragedisks.

IfyouareaddinganRDMorvirtualdisktothesecondnode,chooseUseexistingdisk.

ThecompletedsetupisshowninFigure 22.

Figure 2-2. Cluster in a Box Complete Setup

CAUTION IfyoucloneavirtualmachinewithanRDMsetup,allRDMsareconvertedtovirtualdisks.UnmapallRDMsbeforecloning,andremapthemaftercloningis

complete.

virtual switch2(private)

virtual switch1(public)

physical machine


FC

VNIC1 VNIC2

NIC1

VSCSI1 VSCSI2


VNIC1VNIC2

VSCSI1VSCSI2

SCSI2

remote storage


SCSI1

8/2/2019 vi3_35_25_u2_mscs

25/50

VMware, Inc. 25

3

ThischapterguidesyouthroughcreatinganMSCSclusterthatconsistsoftwovirtual

machinesontwoESXServerhosts.

Althoughthisprocessissimilartotheprocessforsettingupaclusterinabox,stepsare

repeatedforeaseofuse.Thechapterconsistsofthefollowingsections:





Task 1: Creating the First NodeCreatingthefirstnodeconsistsofthesemajorsteps,discussedinthissection:

CreatingthevirtualmachineforNode1.SeePrerequisitesforClusteringAcross

Boxesonpage 14forrequirements.

InstallingtheoperatingsystemonNode1.

Clustering Virtual Machines

Across Physical Hosts 3

NOTE MicrosoftClusterServiceisalreadyinstalledforWindowsServer2003soyoudontneedtoinstallit.SeetheGuidetoCreatingandConfiguringaServerClusterunderWindowsServer2003andotherdocumentationontheMicrosoftWebsite.ForWindows2000Server,youmustinstalltheMicrosoftClusterServicesoftware.

NOTE Beforeyoucreateavirtualmachine,createavirtualdiskineagerzeroedthickformatusingvmkfstools.Thenpointtothatdiskduringvirtualmachinecreation.


8/2/2019 vi3_35_25_u2_mscs

26/50

26 VMware, Inc.

To create the first nodes virtual machine

1 LaunchaVIClientandconnecttotheVirtualCenterServerthatmanagesthe

clustersESXServerhosts.

Usetheusernameandpasswordoftheuserwhowilladministerthevirtual

machine.

2 Intheinventorypanel,rightclicktheESXServerhostandchooseNewVirtualMachine.

3 Makethefollowingselectionswiththewizard:

4 InstallaWindows2000ServerorWindowsServer2003operatingsystemonthevirtualmachine.


Page Selection

WizardType Typical.

NameandLocation Chooseaname(forexampleNode1)andlocation.

ResourcePool Selecttheresourcepoolforthevirtualmachine,orthehostiftherearenoresourcepools.

Datastore Chooseadatastoreasthelocationforthevirtualmachineconfigurationfileandthe.vmdkfile.

GuestOperatingSystem ChoosetheWindows2000ServerorWindowsServer2003operatingsystemyouintendtoinstall.

CPUs Usethedefaultsuggestedforyouroperatingsystem.


Network ChangeNICstoConnectto2,andselectthesecondnetworkforthesecondNIC.



Chapter 3 Clustering Virtual Machines Across Physical Hosts

8/2/2019 vi3_35_25_u2_mscs

27/50

VMware, Inc. 27


CreatingthesecondnodeinvolvescloningtheNode1virtualmachineontoasecond

ESXServer

host,

adding

disks

to

that

virtual

machine,

and

ensuring

that

the

disks

point

tothestoragesharedwithNode1.YoucanclonethenodebyusingaVIClient

connectedtoaVirtualCenterServer,describedinthefollowingprocedure,orbyusing

vmkfstools.SeetheServerConfigurationGuideforareferencetovmkfstools.

To clone the Node1 virtual machine

1 Shutdowntheguestoperatingsystemandpoweroffthevirtualmachine.

2 IntheVIClientinventorypanel,selectNode1andchooseClonefromthe

rightbuttonmenu.Makethefollowingselectionswiththewizard:

Youhavenowcreatedavirtualmachinewithtwonetworkadaptersonwhichthe

operatingsystemyouchoseforNode1isinstalled.

NOTE IfyoucloneavirtualmachinewithRDMs,theRDMsareconvertedtovirtualdisksduringtheconversionprocess.RemoveallRDMsbeforecloning,andremapthem

aftercloningiscomplete.

Table 3-2. Cloned Virtual Machine Properties

Page Selection

NameandLocation Chooseaname(forexampleNode2)andlocation.

HostorCluster Choosethesecondhostfortheclustersetup.

ResourcePartition Selecttheresourcepoolforthevirtualmachine,orselectthehostiftherearenoresourcepools.

Datastore Choose

a

datastore

as

the

location

for

the

virtual

machine

configurationfileandthe.vmdkfile.

Thismustbeadiskineagerzeroedthickformat.

Customization ChooseDonotcustomize.ReadytoComplete ClickOKtocreatethevirtualmachine.


8/2/2019 vi3_35_25_u2_mscs

28/50

28 VMware, Inc.


Afteryouhavecreatedthetwovirtualmachineswiththeoperatingsysteminstalled,

youneed

perform

the

following

tasks:

ConfiguringtheguestoperatingsystemsprivateandpublicIPaddresses.

SeethedocumentationfortheMicrosoft2003operatingsystemforconfiguration

information.

Addingavirtualharddiskthatissharedbythetwovirtualmachinesasthe

quorumdisk,andoptionally,oneormoreshareddatadiskstoNode1.

To add a quorum disk and optional shared storage disks

1 SelectthevirtualmachineyoucreatedandchooseEditSettings.2 ClickAdd,selectHardDisk,andclickNext.3 IntheSelectaDiskpage,chooseMappedSANLUNandclickNext.

YourharddiskpointstoaLUNthatusesRDM.

4 IntheLUNselectionpage,chooseanunformattedLUNandclickNext.

AskyourSANadministratorwhichoftheLUNsareunformatted.Youcanalsosee

allformattedLUNsinthehostsConfigurationtabanddeducewhichLUNsare

unformattedbycomparingthelistofformattedLUNswiththelistintheLUN

selectionpage.

5 IntheSelectDatastorepage,selectadatastoreandclickNext.

ThisdatastoremustbeonaSANbecauseyouneedasinglesharedRDMfilefor

eachsharedLUNontheSAN.

6 SelectPhysicalasthecompatibilitymode,andclickNext.

ASCSIcontrolleriscreatedwhenthevirtualharddiskiscreated.

7 Chooseanewvirtualdevicenode,forexamplechooseSCSI(1:0),andusethe

defaultmode.

NOTE ThesedisksmustpointtoSANLUNs.BothRDMinphysicalcompatibilitymode(passthroughRDM)andRDMinvirtualcompatibilitymode

(nonpassthroughRDM)aresupported.

Theprocedurebelowusesphysicalcompatibilitymode.

NOTE ThismustbeanewSCSIController.YoucannotuseSCSI0.


8/2/2019 vi3_35_25_u2_mscs

29/50

VMware, Inc. 29

8 ClickFinishtocompletecreatingthedisk.

ThewizardcreatesbothanewSCSIcontrollerandanewharddisk.

9 Selectthe

new

SCSI

controller

and

click

ChangeControllerType.

10 SelectLsiLogicinthedialogboxthatappears.

MSCSonESXServer3.xisnotsupportedinconjunctionwithBusLogic.

11 Inthesamepanel,setSCSIBusSharingtoPhysicalandclickOK.

12 Ifyouneedadditionalshareddatadisksinyourconfiguration,repeatStep 1

throughStep 8butchooseanewVirtualDeviceNode,suchasSCSI(1:1).

Figure 31showsthesetupatthispoint.


8/2/2019 vi3_35_25_u2_mscs

30/50

30 VMware, Inc.

Figure 3-1. Cluster Across Boxes, Node1 Setup


AfteryouhavesetupNode1,setupNode2sotheprivateandpublicnetworksmatch.

ThensharethequorumandanyshareddatadisksforNode1withNode2.Usingthe

RDMthat

you

created

when

setting

up

the

first

cluster

node.

To reuse a SAN-based RDM

1 OnNode2,clickAdd,selectHardDisk,andclickNext.2 IntheSelectaDiskpage,chooseUseExistingDisk,andclickNext.3 SelecttheRDMcreatedontheshareddatastoreinStep 5forNode1.

4 ContinuewithStep 6throughStep 10forthequorumdisk(seeToaddaquorumdiskandoptionalsharedstoragedisksonpage 28).

5 (Optional)ContinuewithStep 6throughStep 8foreachadditionalshareddata

disk(seeToaddaquorumdiskandoptionalsharedstoragedisksonpage 28).

ThecompletedsetuplookslikeFigure 32.

physicalmachine



FC

VNIC1 VNIC2

NIC1 NIC2

VSCSI1 VSCSI2

SCSI1 SCSI2



remote storage


8/2/2019 vi3_35_25_u2_mscs

31/50

VMware, Inc. 31

Figure 3-2. Cluster Across Boxes Complete Setup

physicalmachine

physicalmachine



FC

VNIC1 VNIC2

NIC1 NIC2

VSCSI1 VSCSI2

SCSI1 SCSI2



FC

VNIC1VNIC2

NIC1NIC2





VSCSI1VSCSI2

SCSI1SCSI2

remote storage


8/2/2019 vi3_35_25_u2_mscs

32/50

32 VMware, Inc.

8/2/2019 vi3_35_25_u2_mscs

33/50

VMware, Inc. 33

4

ThischapterguidesyouthroughcreatinganMSCSclusterinwhicheachphysical

machinehasacorrespondingvirtualmachine.

Thechapterconsistsofthefollowingsections:



Task3:InstallingMicrosoftClusterServiceonpage 36

Task4:CreatingAdditionalPhysical/VirtualPairsonpage 36

Task 1: Creating the First NodeBecausethefirstnodeisaphysicalmachine,nodetailedinstructionsforcreatingthe

firstnodeareincludedinthischapter.SeetheMicrosoftClusterServicedocumentation

forallprerequisitesandcaveats.Youshouldsetupyoursystemasfollows:

ChoosetheAdvancedMinimumconfigurationwithintheWindowsCluster

Administratorapplication.

Setupthephysicalmachinetohaveatleasttwonetworkadapters.

SetupthephysicalmachinetohaveaccesstothesamestorageonaSANasthe

ESX Serverhostonwhichyouwillrunthecorrespondingvirtualmachine.

Installtheoperatingsystemyouwanttousethroughoutthecluster.

Clustering Physical and

Virtual Machines 4

NOTE VMwarerecommendsthatyoudontrunmultipathingsoftwareinthephysicalorvirtualmachines.


8/2/2019 vi3_35_25_u2_mscs

34/50

34 VMware, Inc.


Creatingthesecondnodeconsistsofthefollowingmajorsteps:

Creatingavirtualmachinethatissetupforclusteringacrossboxes.

MakingsurethesharedstoragevisiblefromNode1(thephysicalmachine)isalso

visiblefromNode2(thevirtualmachine).

Installingtheoperatingsystem.

NetworkadaptersetupofthenodedependsonthetypeofESXServeryouare

using.VMwarerecommendsthreenetworkadaptersperhostforconnectionsto

theoutside.SeePrerequisitesforStandbyHostClusteringonpage 15forinformationontheminimumconfiguration.

To create the second node

1 LaunchaVIClientandconnecttotheESXServerhost.

Usetheusernameandpasswordoftheuserwhowillownthevirtualmachine.

2 Intheinventorypanel,rightclickthehostandchooseNewVirtualMachine.3 Makethefollowingselectionswiththewizard:

NOTE Beforeyoucreateavirtualmachine,createavirtualdiskineagerzeroedthickformatusingvmkfstools.Thenpointtothatdiskduringvirtualmachinecreation.


Page Selection

WizardType Typical.


ResourcePool Selecttheresourcepoolforthevirtualmachine,orthehostiftherearenoresourcepools.

Datastore Chooseadatastoreasthelocationforthevirtualmachine

configurationfileandthe.vmdkfile.

GuestOperatingSystem

ChoosetheWindows2000ServerorWindowsServer2003operatingsystemyouwanttoinstalllater.

CPUs Usethedefault.


Network Change

NICsto

Connect

to

2,

and

select

the

second

network

for

thesecondNIC.

Chapter 4 Clustering Physical and Virtual Machines

8/2/2019 vi3_35_25_u2_mscs

35/50

VMware, Inc. 35

YouneedasharedSCSIcontrollerandsharedSCSIdisksforsharedaccesstoclustered

servicesanddata.ThenextsectionsetsupthedisksforNode2topointtothequorum

diskandsharedstoragedisks,ifany,forNode1.

To add a quorum disk and optional shared storage disk

1 SelectthevirtualmachineyoucreatedandchooseEditSettings.2 ClickAdd,selectHardDisk,andclickNext.3 IntheSelectaDiskpage,chooseMappedSANLUNandclickNext.

YourharddiskpointstoaLUNusingRDM.

4 IntheLUNselectionpage,choosetheLUNthatisusedbyNode1.

5 IntheSelectDatastorepage,selectthedatastore,whichisalsothelocationofthe

bootdisk,andclickNext.

6 SelectPhysicalcompatibilitymodeandclickNext.7 SelectavirtualdevicenodeonadifferentSCSIControllerthantheonethatwas

created

when

you

created

the

virtual

machine.

ThisSCSIControlleriscreatedwhenthevirtualharddiskiscreated.

8 ClickFinishtocompletecreatingthedisk.

Thewizardcreatesbothanewdevicenodeandanewharddisk.

9 SelectthenewSCSIcontroller,setSCSIBusSharingtoPhysical,andclickOK.10 (Optional)

For

additional

storage

disks,

repeat

Step 1

through

Step 6

but

choose

a

disk.Usethesamevirtualadapter.

11 InstallWindows2000ServerorWindowsServer2003onthevirtualmachine.



Table 4-1. New Virtual Machine Properties (Continued)

Page Selection


8/2/2019 vi3_35_25_u2_mscs

36/50

36 VMware, Inc.

Task 3: Installing Microsoft Cluster Service

ThefinaltaskistoconfigureMicrosoftClusterService.

SeetheGuidetoCreatingandConfiguringaServerClusterunderWindowsServer2003andotherinformationontheMicrosoftWebsite.

Insomecomplexstoragesolutions,suchasanFCswitchedfabric,aparticularstorage

unitmighthaveadifferentidentity(targetIDorrawdiskID)oneachcomputerinthe

cluster.Althoughthisisavalidstorageconfiguration,itcausesaproblemwhenyou

wanttoaddanodetothecluster.

To avoid identity target problems

1 WithintheMicrosoftClusterAdministratorutility,disablethestoragevalidation

heuristicsbyclickingtheBackbuttontoreturntotheSelectComputerpage.

2 ClicktheAdvancedbuttonandselecttheAdvanced(minimum)configuration

option.

MicrosoftClusterServiceshouldoperatenormallyinthevirtualmachineafteritis

installed.

Task 4: Creating Additional Physical/Virtual Pairs

Foreachphysicalmachine:

RepeatTask1tosetupanadditionalvirtualmachineontheESXServerhost.

Clusterthe

physical

machine

with

that

virtual

machine.

5

8/2/2019 vi3_35_25_u2_mscs

37/50

VMware, Inc. 37

5

ThischapterdiscusseshowtoupgradeclustersthatuseVMFS2toVMFS3.Itpresents

acomprehensivediscussionofallcasesinthefollowingsections:

LegacyClusterSetupOptionsonpage 37

UpgradingClusterinaBox(CIB)onpage 38

UpgradingClusterAcrossBoxesonpage 40

UpgradingClustersUsingPhysicaltoVirtualClusteringonpage 42

Legacy Cluster Setup Options

UsingVMFS2,youhadanumberofoptionsforsettingupyourMSCScluster:

Forvirtualmachinesclusteredonasinglephysicalhost(clusterinabox),you

coulduseapublicVMFSinoneoftwoways:

UsingnonpassthroughRDMs

Usingsharedvirtualdisks

Upgrading Clustered Virtual

Machines 5

NOTE UpgradingissupportedonlyfromESXServer2.5.2orhigher.You

can

upgrade

from

ESX

Server

2.5.2

to

ESX

Server

3.0.x

or

ESX

Server

3.5,

and

you

canupgradefromESXServer3.0.xtoESXServer3.5.

BecausetherearenoearlierversionsofESXServer3i,thischapterdoesnotapplytothat

platform.


Fo i tual achi es cluste ed o ultiple physical hosts (cluste ac oss boxes)

8/2/2019 vi3_35_25_u2_mscs

38/50

38 VMware, Inc.

Forvirtualmachinesclusteredonmultiplephysicalhosts(clusteracrossboxes),

youhadthreeoptions:

ShareddisksonsharedVMFS

TwopassthroughRDMsbackedbythesameLUNonpublicvolume

AsinglepassthroughRDMonasharedVMFSvolume

Forclustersofphysicalandvirtualmachines(standbyhostclustering),youuseda

publicvolumeusingpassthroughRDM.

Thischapterstepsyouthroughtheupgradeprocessforeachoftheseoptions.

Upgrading Cluster in a Box (CIB)

WithVMFS2,aclusterinaboxsetupusesapublicVMFS.Bydefault,thegeneral

upgradeprocess,discussedintheUpgradeGuide,includesinformationaboutupgradingofpublicVMFS2volumestoVMFS3.IfyoudidnotupgradetheVMFSused

bytheclusterduringtheupgradeprocess,youcanupgradeusingthe

VIClientlater.

Upgrading CIB: Shared RDMs and Boot Disks in Separate VMFSVolumes

Thissectionstepsyouthroughupgradingaclusterinaboxthatusesshared

nonpassthroughRDMsthatresideinadifferentVMFS2volumethanthebootdisks

fortheclustervirtualmachines.

To perform the upgrade

1 Poweroffallclusteredvirtualmachines.

2 UpgradetheESXServerhostfromESXServer2.5.2toESXServer3.x.

3 IfyoudidnotupgradetheVMFS2volumewhereyourcluster.vmdkfilesarekept

toVMFS3duringupgradeofthehost,upgradenow:

a SelecttheupgradedhostinaVIClientandclicktheConfigurationtab.

b ClickStorage.

c Selectthevolume.

d ClickUpgradetoVMFS3.4 Ifnecessary,upgradethevolumewhereyoursharedRDMfilesarelocatedand

upgradethosefiles,asinStep 3.

Chapter 5 Upgrading Clustered Virtual Machines

5 Right click each cluster virtual machine in the inventory panel and click Upgrade

8/2/2019 vi3_35_25_u2_mscs

39/50

VMware, Inc. 39

5 RightclickeachclustervirtualmachineintheinventorypanelandclickUpgradeVirtualHardware.

6 Poweroneachvirtualmachineandverifytheclustersetup.

IfthevirtualmachinefailstopoweronwitherrormessageInvalid Argument,

youhaveamisconfiguredclustersetup.ThevirtualdiskusedinESX2.xisnot

allowedtopoweroninESX3.xbecauseESX3.xchecksforinvaliddisktypes.

Upgrading CIB: RDMs and Boot Disks in Same VMFS Volume

Thissectionstepsyouthroughupgradingaclusterinaboxthatusesshared

nonpassthroughRDMsthatresideinthesameVMFS2volumeasthebootdisksfortheclustervirtualmachines.



2 IntheVIClientinventorypanel,selecttheupgradedhostinaVIClient.

3 ClicktheConfigurationtab,andclickStorage.

4 UpgradetheVMFS2volumewhereyourcluster.vmdkfilesandyoursharedRDM

filesarelocatedtoVMFS3,asfollows:

a Selectthevolumewherethefilesarelocated.

b ClickUpgradetoVMFS3.This

action

upgrades

the

VMFS2

volumes

to

VMFS3

and

relocates

the

.vmx

file

for

theclustervirtualmachinesintotheupgradedVMFS3volumeinadirectory

structure.

5 Rightclickthesecondclusternodesvirtualmachineintheinventorypaneland

clickUpgradeVirtualHardware.Anerrorlikethefollowingresults:

VMware ESX Server could not completely upgrade your virtual disk"/vmfs/volumes/2a3330116-da-11....vmdk due to the following error:

The system cannot find the file specified."

TheerroristheresultofStep 3,wheretheclustersvirtualmachineswererelocated

tothefirstnodesdirectory.

6 Ignoretheerror.

Thesystemupdatesyourvirtualhardwareregardlessoftheerror.Youcanverify

thisbyviewingthe.vmxfileentriesofthesecondclusternode.


7 Manually edit the .vmx file of the second cluster virtual machine so that the entries

8/2/2019 vi3_35_25_u2_mscs

40/50

40 VMware, Inc.

7 Manuallyeditthe.vmxfileofthesecondclustervirtualmachinesothattheentries

ofthequorumdiskandanyothershareddiskpointtothesharedRDMfilesthat

areinsidethefirstnodesdirectoryinsidetheVMFS3partition.

8 Poweroneachvirtualmachineandverifytheclustersetup.

Upgrading CIB: Virtual Disks

Thissectionstepsyouthroughupgradingaclusterinabox(CIB)thatusesshared

virtualdisksfortheclustervirtualmachines.


1 Importtheoldvirtualdisktothenewvirtualdisk,asfollows:

vmkfstools -I /vmfs/volumes/vol1/.vmdk

/vmfs/volumes/vol2//.vmdk

old-virtdisk.vmdkthevirtualdiskfromwhichyouareimporting

new-virtdisk.vmdkthenewvirtualdisktowhichyouareimporting

2 Renameold-virtdisk.vmdk.

3 Editthe.vmxfiletopointtonew-virtdisk.vmdk.

4 Poweronthenodeandverifythattheclusterservicestartswithoutproblems.

Upgrading Cluster Across Boxes

Thereare

two

types

of

clusters

across

boxes.

This

section

explains

how

to

upgrade

clustersacrossboxesusingsharedpassthroughRDMsandhowtoupgradeclusters

acrossboxeswithsharedfilesystems.

Using Shared Pass-Through RDMs

ThissectionexplainshowtoupgradeaclusterwithpassthroughRDMsforeachnode.

To upgrade the cluster


2 IntheVIClientinventorypanel,selecttheupgradedhost.

3 ClicktheConfigurationtab,andthenclickStorage.

Chapter 5 Upgrading Clustered Virtual Machines

4 UpgradetheVMFS2volumewhereyoursharedpassthroughRDMfilesarekept

8/2/2019 vi3_35_25_u2_mscs

41/50

VMware, Inc. 41

pg y p g p

toVMFS3:

a Selectthevolume.

b ClickUpgradetoVMFS3.5 Selectthevolumewherethebootdiskfortheclustervirtualmachineislocatedand

upgradeitasinStep 3.

Thisupgradesthevolumeandrelocatesthe.vmxfilesrelatedtothevirtual

machinesinsidethevolume.Thenewdirectorystructureisorganizedforeasy

management.

6 Rightclickontheclustervirtualmachineintheinventorypanelontheleft.

7 ChooseUpgradeVirtualHardwarefromtherightbuttonmenu.8 RepeatthestepsfortheNode2host.

9 Poweronthevirtualmachinesandverifythecluster.

Upgrading a Cluster with Files in Shared VMFS2 Volumes

Thissectionexplainshowtoupgradeaclusteracrossboxesifyouusedsharedfilesin

asharedVMFS2volume.

To upgrade the cluster

1 BeforeupgradingtoVMFS3,changethesharedVMFS2volumefromsharedto

public,

as

follows:vmkfstools -L lunreset vmhba:0

vmkfstools -F public vmhba

2 PerformthehostupgradesfromESXServer2.5.2toESXServer3.x.

3 SelectthefirstupgradedhostinaVIClientinventorypanel.

4 ClicktheConfigurationtab,andclickStorage.

5 UpgradetheVMFS2volumewhereyourcluster.vmdkfilesarekepttoVMFS3:

a Selectthevolume.

b ClickUpgradetoVMFS3.6 CreateLUNsforeachshareddisk(thatis,oneLUNforeachshareddisk).


7 Foreachdisk,createaseparateRDMforeachclusternodebackedbythesame

8/2/2019 vi3_35_25_u2_mscs

42/50

42 VMware, Inc.

p y

physicaldevice.CreatetheRDMandimportthevirtualdisktothisRDM.

vmkfstools -i /vmfs/volumes/vol1/.vmdk

/vmfs/volumes/vol2///-d rdmp:/vmfs/devices/disks/vmhbaC:T:L:P

Where

old-virtdisk=thesourcevirtualdisk.

myVMDir=thetargetvirtualmachinedirectory.

rdm-for-vm1=anoptionaldirectoryinwhichtostoreRDMfilesforthat

virtual

machine. myrdm.vmdk=thetargetRDMfilethatthiscommandcreates.

vmhbaC:T:L:P=thedevicerepresentingtherawLUNthatyouaremapping

C=controllernumber(theFCHBA).

T=thestoragearraystargetnumberthroughwhichtheLUNisaccessed.

L=LUNnumber.

P=partitionnumber.Inthisexampleyoumustuse0asthevalueto

addressthewholeLUN

8 Editthe.vmxfiletopointtotheRDMinsteadofthesharedfile:

scsi:.filename =

"/vmfs/volumes/vol2///"

scsi:.deviceType = "scsi-passthru-rdm"

9 RightclicktheclustervirtualmachineintheinventorypanelandselectUpgradeVirtualMachine.

10 RepeatStep 8andStep 9forNode2.

11 Poweronthenodesandverifythattheclusterservicestartswithoutproblems.

Upgrading Clusters Using Physical to Virtual Clustering

IfyouareusingaphysicaltovirtualclusterusingVMFS2,youuseapublicdiskthatis

mappedusingRDMfromthevirtualmachine.

Bydefault,theupgradeprocessconvertsyourVMFS2diskstoVMFS3.Youcanalso

explicitlyconvertVMFS2volumeslaterifyoudidnotconvertthemaspartofthe

defaultconversion.

8/2/2019 vi3_35_25_u2_mscs

43/50

VMware, Inc. 43

AdministratorswhoaresettingupMicrosoftClusterServiceonESXServer3.xcanuse

thisappendixasachecklist.

Theappendixincludesinformationinthefollowingtables:

Table A1RequirementsforClusteredDisks

Table A2OtherClusteringRequirementsandRecommendations

Table A1liststherequirementsforclustereddisks.

Appendix: Setup Checklist

Table A-1. Requirements for Clustered Disks

Component Single-host Clustering Multihost Clustering

Clusteredvirtualdisk(.vmdk)

SCSIbussharingmodemustbesettoVirtual.

Notsupported.

Clustereddisks,virtualcompatibilitymode(nonpassthroughRDM)

DevicetypemustbeVirtualcompatibilitymode.

SCSIbussharingmodemustbesettoVirtual.

Asingle,sharedRDMmapping

filefor

each

clustered

disk

is

required.

DevicetypemustbeVirtualcompatibilitymodeforclusteracross

boxes,butnotforstandbyhostclustering.

SCSIbussharingmodemustbesetto

Physical.Requiresasingle,sharedRDMmappingfileforeachclustereddisk.


Table A-1. Requirements for Clustered Disks (Continued)

8/2/2019 vi3_35_25_u2_mscs

44/50

44 VMware, Inc.

Table A2listsotherclusteringrequirements.

Clustereddisks,physical

compatibilitymode(passthroughRDM).

Notsupported. DevicetypemustbePhysical

compatibilitymode.Thisissetduringharddiskcreation.

SCSIbussharingmodemustbesettoPhysical(thedefault).

Asingle,sharedRDMmappingfileforeachclustereddiskisrequired.

Alltypes AllclusterednodesmustusethesametargetID(onthevirtualSCSIadapter)forthesameclustereddisk.

Aseparatevirtualadaptermustbeusedforclustereddisks.

Component Single-host Clustering Multihost Clustering

Table A-2. Other Clustering Requirements and Recommendations

Component Requirement

Disk Ifyou

place

the

boot

disk

on

avirtual

disk,

create

that

disk

using

vmkfstools,

specifyingtheeagerzeroedthickoption.

TheonlydisksthatyoushouldnotcreatewiththeeagerzeroedthickoptionareRDMfiles(bothphysicalandvirtualcompatibilitymode)andthebootdisksofnativeWindowshostsinstandbyclustering.

Windows UseWindowsServer2003SP2(32bit),WindowsServer2003(64bit)SP2,orWindows 2000ServerSP4.VMwarerecommendsWindowsServer2003.

Onlytwoclusternodes.

DiskI/Otimeoutissixtysecondsormore(HKEY_LOCAL_MACHINE\System\CurrentControlSet\Services\Disk\TimeOutValue).

Note:Ifyourecreatethecluster,thisvaluemightberesettoitsdefault,soyoumustchangeitagain.

Clusterservicemustrestartautomaticallyonfailure(first,second,andsubsequenttimes).

ESXServerconfiguration

VMwarerecommendsthatyoudontovercommitmemory,thatis,setMemoryReservation(minimummemory)tothesameasMemoryLimit(maximummemory).Ifyoumustovercommitmemory,theswapfilemustbelocal,notontheSAN.

Appendix: Setup Checklist

Table A-2. Other Clustering Requirements and Recommendations (Continued)

8/2/2019 vi3_35_25_u2_mscs

45/50

VMware, Inc. 45

Information

requiredbytechnicalsupporttoanalyzeclusteringrelatedissues

Verifythatthesetupcomplieswiththechecklist.

vmsupporttarball(vmkernellog,virtualmachineconfigurationfilesandlogs,)

Applicationandsystemeventlogsofallvirtualmachineswiththeproblem.

Clusterlogofallvirtualmachineswiththeproblem(thatis,%ClusterLog%,whichisusuallysetto%SystemRoot%\cluster\cluster.log).

DiskI/Otimeout(HKEY_LOCAL_MACHINE\System\CurrentControlSet\Services\Disk\TimeOutValue)

VIClientdisplaynamesandWindowsNETBIOSnamesofthevirtualmachinesexperiencingtheproblem.

Dateandtimeandtheproblemoccurred.

SANconfigurationoftheESXServersystem(LUNs,paths,andadapters).

Multipathing Runningthirdpartymultipathingsoftwareisnotsupported.

Component Requirement


8/2/2019 vi3_35_25_u2_mscs

46/50

46 VMware, Inc.

Index

8/2/2019 vi3_35_25_u2_mscs

47/50

VMware, Inc. 47VMware, Inc. 47

A

across boxes, clustering 25

introduction 11

prerequisites 14

C

caveats 16

cloning node1 21, 27

cluster across boxes

first node 25

introduction 11prerequisites 14

second node 27

upgrading 40, 41

cluster in a box

first node 19

introduction 10

prerequisites 14second node 20

upgrading 38, 39

clustering hardware 10

clustering physical and virtual machines 13,

33

first node 33

second node 34clustering software 10

clustering virtual machines across hosts 25

introduction 11

prerequisites 14

clustering virtual machines on one host 19

introduction 10

prerequisites 14

D

disks

adding to nodes (across boxes) 28

adding to nodes (in-a-box) 21quorum 22, 28, 35

shared 22, 28, 35

E

ESX Server 3i 14, 15

F

first node

creating (across boxes) 25

creating (in-a-box) 19

creating (standby host) 33

H

hardware 10

I

in-a-box, clustering 19

introduction 10

prerequisites 14

M

Microsoft Cluster Service (MSCS)

installing 24, 36

N

N+1, prerequisites 15

node1, cloning 21, 27


P

prerequisites for clustering 13

standby host 33

introduction 13

8/2/2019 vi3_35_25_u2_mscs

48/50

48 VMware, Inc.

prerequisites for clustering 13

Qquorum disk 22, 28, 35

R

requirements 16

S

second nodecreating (across boxes) 27

creating (in-a-box) 20

creating (standby host) 34

service console 14, 15

shared storage disk 22, 28, 35

shared storage summary 15

introduction 13

prerequisites 15

upgrading 42storage

quorum disk 22, 28, 35

shared 22, 28, 35

U

upgrading 38

cluster across boxes 40, 41cluster in a box 38, 39

standby-host cluster 42

Updates for Setup for Microsoft Cluster

8/2/2019 vi3_35_25_u2_mscs

49/50

VMware, Inc. Update1

Service

LastUpdated:August14,2009

Thisdocument

provides

updates

to

the

book,

Setup

for

Microsoft

Cluster

Service,

written

fortheUpdate 2releaseforESX Server 3.5,ESX Server 3iversion 3.5,and

VirtualCenter 2.5.Updateddescriptionsareorganizedbypagenumbersothatyoucan

easilylocatetheareaoftheguidethathaschanges.Ifthechangespansmultiple

sequentialpages,thisdocumentprovidesthestartingpagenumberonly.

ThefollowingareupdatestotheSetupforMicrosoftClusterService: UpdatesfortheCaveats,Restrictions,andRecommendationsSectiononPage 16

UpdatestotheRecommendations forUsingMSCSandBootfromSANSectionon

Page 17

Updates for the Caveats, Restrictions, andRecommendations Section on Page 16

Thefollowing

restriction

in

the

Caveats,

Restrictions,

and

Recommendations

section

is

nowinvalidandshouldberemoved:

ThebootdiskoftheESXServerhostshouldbeonlocalstorage.

Updates to the Recommendations for Using MSCS andBoot from SAN Section on Page 17

IntheRecommendationsforUsingMSCSandBootfromSANsection,thedescriptionofbootfromSANdoesnotindicatewhichversionoftheMicrosoftWindowsoperating

systemissupported.ThedocumentshouldstatethatbootfromSANisonlysupported

onWindows Server 2003,andisnotsupportedonWindows Server 2000operating

systems.

Thissectionshouldalsoincludethefollowingrecommendationwhenyouputtheboot

diskofavirtualmachineyouwishtouseinaclustersetuponaSAN.

Ifyourenvironmentissusceptibletoconditionsthatcauseclusternodeserverstolose

allpathstothestoragearray,orifyoursystemfailsanddisplaysabluescreenwhena

8/2/2019 vi3_35_25_u2_mscs

50/50

Update2 VMware, Inc.

p g y y y p y

newLSIdriverisinstalled(forallclusterconfigurations),setthelsilogic.iobar256

parametertoTrueforeachnode.

To set lsilogic.iobar256 to true

1 LogintoaVIClientandselectthevirtualmachinefromtheinventorypanel.

Theconfigurationpageforthisvirtualmachineappears.

2 IntheSummarytab,clickEditSettings.3 Click

Options>Advanced>General,andthenclickConfigurationParameterstoopentheConfigurationParametersdialogbox.

4 ClickAddRow.5 Enterlsilogic.iobar256intheNamecolumnandTrue intheValuecolumn.

6 ClickOKtoclosetheConfigurationParametersdialogbox.7 ClickOKtoclosetheVirtualMachinePropertiesdialogbox.

vi3_35_25_u2_mscs

Documents