how to install and configure a two 4.0 solaris 11

8/19/2019 How to Install and Configure a Two 4.0 Solaris 11

1/14

How to Install and Configure a Two-NodeCluster

Using Oracle Solaris Cluster 4.0 on Oracle Solaris 11by Subarna Ganguly and Jonathan Mellors, December 2011

How to quickl and easil install and configure Oracle Solaris Cluster software for two nodes! includingconfiguring a quoru" de#ice.

Introduction

This article provides a step-by-step process for using the

interactive scinstall utility to install and configure Oracle Solaris Cluster software for two nodes, including the configuration of a quorum device. It does

not cover the configuration of highly available services.

Note !or more details on how to install and configure other Oracle Solaris

Cluster software configurations, see the Oracle Solaris Cluster Software

Installation "uide.

The interactive scinstall utility is menu-driven. The menus help reduce the chance of mista#es and promote

best practices by using default values, prompting you for information specific to your cluster, and identifying

invalid entries.

The scinstall utility also eliminates the need to manually set up a quorum device by automating the

configuration of a quorum device for the new cluster.

Note This article refers to the Oracle Solaris Cluster $.% release. !or more information about the latest Oracle

Solaris Cluster release, see the release notes.$rerequisites! %ssu"&tions! and 'efaults

This section discusses several prerequisites, assumptions, and defaults for two-node clusters.

Configuration %ssu"&tionsThis article assumes the following conditions are met

• &ou are installing on Oracle Solaris '' and you have basic system administration s#ills.

• &ou are installing Oracle Solaris Cluster $.% software.

• The cluster hardware is supported with Oracle Solaris Cluster $.% software. (See Oracle Solaris Cluster

System )equirements.*

• + two-node cluster is installed. /owever, the installation procedure is applicable to S0+)C clustersas well.

• 1ach node has two spare networ# interfaces to be used as private interconnects, also #nown as

transports, and at least one networ# interface that is connected to the public networ#.

• SCSI shared storage is connected to the two nodes.

• &our setup loo#s li#e !igure ', although you might have fewer or more devices, depending on your

system or networ# configuration.

Note It is recommended, but not required, that you have console access to the nodes during cluster installation.

2ant technical articles li#e this

one delivered to yourinbo3 Subscribe to theSystems Community4ewsletter 5only technicalcontent for sysadmins anddevelopers.

http://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLISThttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLISThttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLISThttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLRELhttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLRELhttp://www.oracle.com/technetwork/server-storage/solaris-cluster/overview/sysreq-cluster-166689.pdfhttp://www.oracle.com/technetwork/server-storage/solaris-cluster/overview/sysreq-cluster-166689.pdfhttp://www.oracle.com/technetwork/server-storage/solaris-cluster/overview/sysreq-cluster-166689.pdfhttp://www.oracle.com/us/syndication/subscribe/index.html#newslettershttp://www.oracle.com/us/syndication/subscribe/index.html#newslettershttp://www.oracle.com/us/syndication/subscribe/index.html#newslettershttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLISThttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLISThttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLISThttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLISThttp://www.oracle.com/pls/topic/lookup?ctx=E23623&id=CLRELhttp://www.oracle.com/technetwork/server-storage/solaris-cluster/overview/sysreq-cluster-166689.pdfhttp://www.oracle.com/technetwork/server-storage/solaris-cluster/overview/sysreq-cluster-166689.pdfhttp://www.oracle.com/us/syndication/subscribe/index.html#newslettershttp://www.oracle.com/us/syndication/subscribe/index.html#newslettershttp://www.oracle.com/us/syndication/subscribe/index.html#newsletters


2/14

(igure 1. Oracle Solaris Cluster Hardware Configuration

$rerequisites for )ac* Sste"This article assumes that Oracle Solaris '' has been installed on both systems.

Initial $re&aration of $u+lic I$ %ddresses and ,ogical Host Na"es

&ou must have the logical names (host names* and I0 addresses of the nodes that are to be configured as a

cluster. +dd those entries to each node6s /etc/inet/hosts file or to a naming service if a naming service,

such as 74S, 4IS, or 4IS8 maps, is used.

The eample in this article uses the 4IS service and the configuration shown in Table '.

Ta+le 1. Configuration

CO$ON)NT

Cluster 4ame

4ode '

4ode 9

'efaultsThe scinstall interactive utility in Typical mode installs the Oracle Solaris Cluster software with the following

defaults

• 0rivate-networ# address ':9.'.%.%

• 0rivate-networ# netmas# 9;;.9;;.9$.%

• Cluster-transport switches switch1 and switch2

The eample in this article has no cluster-transport switches. Instead, the private networ#ing is resolved by using

bac#-to-bac# cables.

In the eample in this article, the interfaces of the private interconnects are nge1 and e1000g1 on both cluster

nodes.

$reinstallation C*ecks0erform the following steps.


3/14

'. Temporarily enable rsh or ssh access for root on the cluster nodes.

9.


4/14

o If the networ# interfaces are not configured as static I0 addresses, on each node, run the

command shown in


5/14

i. Hre-%lCster-s11 - - 174.0$ static 2011-04-27 03:1. s11 ( ).05 static 2011-04-25 03:0

Configuring t*e Oracle Solaris Cluster $u+lis*er

There are two main ways to access the Oracle Solaris Cluster pac#age repository, depending on whether the

cluster nodes have direct access (or access through a 2eb proy* to the Internet

• ?se a repository hosted on p#g.oracle.com.• ?se a local copy of the repository.

Using a e&ositor Hosted on &kg.oracle.co"To access either the Oracle Cluster Solaris )elease or Support repositories, obtain the SS< public and private

#eys, as follows

'. "o to http@@p#g-register.oracle.com (login required*.9. Choose the Oracle Solaris Cluster )elease or Support repository.

=. +ccept the license.

$. )equest a new certificate by choosing the Oracle Solaris Cluster software and submitting a request. (+certification page is displayed with download buttons for the #ey and certificate.*

;. 7ownload the #ey and certificate and install them, as described in the certification page.

. Configure the ha-cluster publisher with the downloaded SS< #eys to point to the selected repository

?)< on p#g.oracle.com. The following eample uses the release repository

7. # pkg set-publisher \ -k/var/pkg/ssl/#racle$%olaris$!luster$&.'.key.pem \ -c/var/pkg/ssl/#racle$%olaris$!luster$&.'.certificate.pem \ -ghttps://pkg.oracle.com/ha-cluster/release/ ha-cluster

Using a ,ocal Co& of t*e e&ositorTo access a local copy of the Oracle Solaris Cluster )elease or Support repository, download the repository

image, as follows.

'. 7ownload the repository image from one of the following sites

o Oracle Technology 4etwor#

o Oracle Software 7elivery Cloud (login required*

9. On the Aedia 0ac# Search page, select Oracle Solaris as the 0roduct 0ac# and clic# 3o.=. Choose Oracle Solaris Cluster 4.0 edia $ack and download the file.$. Aount the repository image and copy the data to a shared file system that all the cluster nodes can

access.

. # lofiadm -a /tmp/osc&.'-repo-full.iso5. delofi17. # mount -( hsfs /dev/lofi/ /mnt3. # rsync -a /mnt/repo /export4. # share /export/repo'%. Configure the ha-cluster publisher. The following eample uses node ' as the system that shared

the local copy of the repository

11. # pkg set-publisher -g file:///net/phys-schost-/export/repo ha-clusterInstalling t*e Oracle Solaris Cluster Software $ackages

'. On each node, ensure the correct Oracle Solaris pac#age repositories are published. If they are not,unset the incorrect publishers and set the correct ones. The installation of the ha-cluster pac#ages is li#ely to

fail if it cannot access the Oracle Solaris publisher.

http://www.oracle.com/technetwork/articles/servers-storage-admin/o11-147-install-2node-cluster-1395587.html#hostedhttp://www.oracle.com/technetwork/articles/servers-storage-admin/o11-147-install-2node-cluster-1395587.html#localhttp://pkg-register.oracle.com/http://pkg-register.oracle.com/http://pkg-register.oracle.com/http://www.oracle.com/technetwork/server-storage/solaris-cluster/downloads/index.htmlhttp://edelivery.oracle.com/http://edelivery.oracle.com/http://www.oracle.com/technetwork/articles/servers-storage-admin/o11-147-install-2node-cluster-1395587.html#hostedhttp://www.oracle.com/technetwork/articles/servers-storage-admin/o11-147-install-2node-cluster-1395587.html#localhttp://pkg-register.oracle.com/http://www.oracle.com/technetwork/server-storage/solaris-cluster/downloads/index.htmlhttp://edelivery.oracle.com/


6/14

2. # pkg publisher/.). H,!IS "VI%"net/ "thernet CnknoGn 0 CnknoGn e1000g1net0 "thernet Cp 1000 fCll nge0net) "thernet CnknoGn 0 CnknoGn e1000g2net2 "thernet CnknoGn 0 CnknoGn e1000g0net1 "thernet CnknoGn 0 CnknoGn nge1net "thernet CnknoGn 0 CnknoGn e1000g/

On node 9, run this command.

# dladm show-phys

I($ "IA S&A&" SH"" ,H"> "VI%"net/ "thernet CnknoGn 0 CnknoGn e1000g1net0 "thernet Cp 1000 fCll nge0net) "thernet CnknoGn 0 CnknoGn e1000g2net2 "thernet CnknoGn 0 CnknoGn e1000g0net1 "thernet CnknoGn 0 CnknoGn nge1net "thernet CnknoGn 0 CnknoGn e1000g/

In our eample, we will be using net1 and net3 on each node as private interconnects.

9. On both nodes, ensure that SA! services are not disabled.

/. # svcs -x


7/14

$. On each node, ensure that the service network/rpc/bind:default has

its local_only configuration set to false.

. # svcprop network/rpc/bind:default ) grep local$only5.

7. configlocal=only boolean falseIf it is not set to false, set it as follows

# svccfgsc:6 select network/rpc/bind sc:netGorkrpcbind6 setprop config/local$only=falsesc:netGorkrpcbind6 *uit

# svcadm refresh network/rpc/bind:default# svcprop network/rpc/bind:default ) grep local$onlyconfiglocal=only boolean false

. !rom one of the nodes, start the Oracle Solaris Cluster configuration utility by runningthe scinstall command, which will configure the software on the other node as well, and then type 1 from the

Aain menu to choose to create a new cluster or add a cluster node.

In the eample shown in


8/14

23. &his tool sCpports tGo odes of operation9 &ypical ode and%Csto

24. ode. +or ost clCsters9 yoC can Cse &ypical ode.


9/14

traffic on those interfaces, it will as# for confirmation to use them anyway. 1nsure that those interfaces are notconnected to any other networ#, and then confirm their use as transport adapters, as shown in


10/14

1. Attachent ?SA&A@ disks9 or if yoCr shared disks do not sCpport15. S%SI-29 yoC Cst disable this featCre.17.13. If yoC disable aCtoatic NCorC deice selection noG9 or if yoC

intend14. to Cse a NCorC deice that is not a shared disk9 yoC Cst

instead Cse20. clsetCp?1@ to anCally configCre NCorC once both nodes haeoined

21. the clCster for the first tie.22.2/. o yoC Gant to disable aCtoatic NCorC deice selection

?yesno@ EnoFM2).2. Is it okay to create the neG clCster ?yesno@ EyesFM25. Cring the clCster creation process9 clCster check is rCn on each

of the neG clCster nodes.27. If clCster check detects probles9 yoC can either interrCpt the

process or check the log

23. files after the clCster has been established.24./0. InterrCpt clCster creation for clCster check errors ?yesno@

EnoFM


11/14

available applications. These cluster components can include device groups, cluster file systems, highly availablelocal file systems, and individual data services and one clusters. To configure these components, consultthe documentation library.

c. On each node, verify that multi-user services for the Oracle Solaris Service Aanagement !acility (SA!* areonline. +lso ensure that the new services added by Oracle Solaris Cluster are all online.

d. # svcs -xe. # svcs multi-user-serverf. S&A&" S&I" +Ig. online 4:3:)) sc:ilestoneClti-Cser-serer:defaClth. !rom one of the nodes, verify that both nodes have Doined the cluster, as shown in


12/14

bd. ----------------- ----------- ----------------------------------

be.bf. --- Clti-oGner eice roCp StatCs ---bg.bh. eice roCp (ae (ode (ae StatCs

bi. ----------------- --------- ------b.bk. QQQ %lCster esoCrce roCps QQQbl.b. roCp (ae (ode (ae SCspended Statebn. ---------- --------- --------- -----bo.bp. QQQ %lCster esoCrces QQQbN.br. esoCrce (ae (ode (ae State StatCs essagebs. ------------- --------- ----- --------------bt.bC. QQQ %lCster I eices QQQ

b. eice Instance (ode StatCsbG. --------------- ---- ------bD. dedidrdskd1 phys-schost-1 'kby. phys-schost-2 'kbR. dedidrdskd2 phys-schost-1 'kca. phys-schost-2 'kcb. dedidrdskd/ phys-schost-1 'kcc. dedidrdskd) phys-schost-1 'kcd. dedidrdskd phys-schost-2 'kce. dedidrdskd5 phys-schost-2 'kcf.cg. QQQ one %lCsters QQQch.

ci. --- one %lCster StatCs ---c.ck. (ae (ode (ae one


13/14

1.2./. phys-schost-2 # %lCster (ode1.2./.5 schost-lh

9. !rom one of the nodes, create a pool with the two shared storagedis#s /dev/did/rdsk/d1s0 and /dev/did/rdsk/d2s0. In our eample, we have assigned the entire dis# to

slice % of the dis#s, using the format utility.

/. # pool create -m /fs pool mirror /dev/did/dsk/ds'/dev/did/dsk/ds'

).. # df -k /fs5. +ilesyste 102)-blocks ,sed Aailable %apacity

oCnted on7. pool1 201)315 /1 201)722 1T

Rfs1

The pool will now be placed in a highly available resource group as a resource of type SUNW.HAStoragePlus.

This resource type has to be registered before it is used for the first time.. Create a highly available resource group to house the resources by doing the following on one node

4. # /usr/cluster/bin/clrg create test-rg'%. Then add the networ# resource to the group

11. # /usr/cluster/bin/clrslh create -g test-rg -h schost-lh schost-lhres

'9. )egister the storage resource type

1/. # /usr/cluster/bin/clrt register %012.34%toragelus'$. +dd the pool to the group

1. # /usr/cluster/bin/clrs create -g test-rg -t %012.34%toragelus-p \ pools=pool hasp-res

'. >ring the group online

17. # /usr/cluster/bin/clrg online -e5 test-rg'. Chec# the status of the group and the resources, as shown in


14/14

/3./4. schost-lhres phys-schost-1 'nline 'nline -

ogical

how to install and configure a two 4.0 solaris 11

Documents