sun cluster 3.0 introduce

Yong Yan

Sun Support Engineer

Sun Services North China

Sun Cluster 3.0 Introduce

Sun Proprietary/Confidential: Internal Use Only

Pre-introduce

How long do you support Sun ? Do you have SunCluster experience ? Install cluster (2.2 or 3.0 or others)? What do you expect this session ?


Sun Cluster 3.0

Sun Cluster 3.0 Overview Sun Cluster 3.0 Basic Concept Sun Cluster 3.0 Install Sun Cluster 3.0 Admin command Difference between 3.0 & 3.1


Sun Cluster 3.0 Overview

SunCluster 3.0 Main Component SunCluster 3.0 Architecture Sun Cluster Application Support


SunCluster Main Component

Solaris 8 OE

HA Framework

Global Components

Userland Components


HA Framework Components Communication between domains Heartbeat / Data / Application level mesg

Persistence of cluster state Consistent view of cluster configuration

Cluster membership Quorum / Fencing of faulted members / Reconfiguration


Cluster Global ComponentsGlobal Devices

Cluster-wide namespace

Global File Service Cluster-wide file service

Global Network Service Single IP address for cluster Scalable service Load balancing


Cluster Userland Components

● Command line interfaces● SunPlex Manager – Adminstration tool● Sun Management Center module – Monitoring tool● Agents● Development libraries API● SunPlex Agent Builder – Development tool● Utilities – scvxinstall, diagnostic toolkit


Different with Other Cluster

● SunCluster 3.0 is tightly coupled cluster .

● It is different other cluster software over solaris , such as VCS , SunCluster2.2 VCS & SunCluster2.2 is userland software SunCluster3.0 is integrated with Solaris , is extendent of Solaris


Different with Other Cluster

● Interconnects – low latency , high-bandwidth links

Type of Interconnects technology Fast Ethernet, Gigabit Ethernet , SCI

Number of interconnects between nodes Sun Cluster 3.0 : (min 2 , max 6) Sun Cluster 2.2 : (min and max 2) VCS 1.x : (min 1 and max 2)


SunCluster3.0 ArchitectureAgents

Resource Group Mgr

APIPublic Network

Monitor

Global DeviceAccess

Cluster MembershipMonitor

Cluster ConfigurationRepository

Volume Mgt

Global File Service

Storage

Cluster Transport

OtherNodes

Global NetworkService

TCP/IPN/Wstack

HA Framework

Kernel

User


Cluster H/W Components

Redundant Servers / Domain Redundant Storage Redundant Public network access Redundant Private communications


Cluster H/W Components

host-Bhost-A

SW-A

Storage-A

SW-B

Storage-B

mirror

Public Network

Heart Beat

Channel

Channel

RAIDRAID


Sun Cluster Application SupportHighly Available Data Service Support

Oracle, Informix, and Sybase databases NFS SAP SunONE Proxy Server SunONE Directory Server SunONE Web Server Apache Web Server ….


Sun Cluster Application SupportScalable Data Service Support

SunONE Web Server Apache Web Server SAP Broadvision …Parallel Database Support● Oracle OPS/RAC , Sybase

General Data Service


Sun Cluster3.0 Basic Concepts

Resource Type C++ Class (RT)

Resource C++ Object (Instance of RT)

Resource Group C++ Structure (collection of Resources)Application Services C++ Program (collection of Resource Group: RG)



Data Service Agent (collection of Resource Type)

GFS/PxFS/CFS global file system , one new feature of sc3.0, mount with global option

Global Device unique name of one device in the cluster server



Device Group (Management for Disks , are independent of Resource group )


SunCluster 3.0 Install● SunCluster Server/Storage Matrix Server & Storage Matrix● Network(interconnect , public network) Network Matrix● SunCluster3.x S/W Matrix SunCluster 3.x S/W Matrix


SunCluster 3.0 Install

● SunCluster 3.x Install step

1. Install admin station

2. Install TC

3. Install Cluster node

4. Install Cluster Framework on the nodes


SunCluster 3.x Install (cont)

● SunCluster 3.x Install step

5. Install Vxvm

6. Install SDS or SVM

7. Install Data Service Agent

8. Config Data Service

9. encapsulate the root disk and mirror the root disk

SunCluster 3.x Install cookbook


SunCluster 3.x Admin Command

ScinstallScrgadm ScswitchScsetupScconf ScstatPnmsetscshutdown


SunCluster3.x Admin commandScinstall.

# scinstall -- Install Software # scinstall –pv -- display the release and

package versioning information for the SunCluster software installed on the node

Scrgadm Config and Manager the Resource and

Resource Group


SunCluster3.x Admin commandScsetup

interactive cluster configuration toolScconf

Update the SunCluster software configuration

# scconf –pvv # scconf –c –q reset # scconf –a –T .


SunCluster3.x Admin commandscswitch

# scswitch –n –j <resource-name>

# scswitch –e –j <resource-name>

# scswitch –n –M –j <resource-name>

# scswitch –e –M –j <resource-name>


SunCluster3.x Admin command

scswitch # scswitch –F –g <resource-group name>

# scswitch –Z –g <resource-group name>

# scswitch –z –g <resource-group name> -h <nodename>

# scswitch –S –h <nodename>


SunCluster3.x Admin commandScstat

Check the cluster status , run on any node

# scinstall-- Cluster Nodes -- 目前 cluster 中各节点状态 Node name Status --------- ------ Cluster node: erp-db1 Online Cluster node: erp-db2 Online online 状态为节点已加入集群 offline 的节点不在集群软件控制之下


SunCluster3.x Admin commandScstat (cont)

-- Cluster Transport Paths -- 心跳连接的状态 Endpoint Endpoint Status -------- -------- ------Transport path: erp-db1:hme1 erp-db2:hme1 Path

onlineTransport path: erp-db1:hme0 erp-db2:hme0 Path

online



-- Quorum Summary -- 仲裁设备的状态 Quorum votes possible: 3 Quorum votes needed: 2 Quorum votes present: 3-- Quorum Votes by Node -- Node Name Present Possible Status --------- ------- -------- ------ Node votes: erp-db1 1 1 Online Node votes: erp-db2 1 1 Online -- Quorum Votes by Device -- 已设置的仲裁设备信息 Device Name Present Possible Status ----------- ------- -------- ------ Device votes: /dev/did/rdsk/d9s2 1 1 Online------------------------------------------------------------------



--- Device Group Servers -- 磁盘组的状态 Device Group Primary Secondary ------------ ------- --------- Device group servers: rmt/1 - - Device group servers: rmt/2 - - Device group servers: rmt/3 - - Device group servers: erpora erp-db1 erp-db2 Device group servers: erpapp erp-db2 erp-db1 erpora目前在 erp-db1激活； erpapp目前在 erp-db2激活；



-- Device Group Status --

Device Group Status ------------ ------ Device group status: rmt/1 Offline Device group status: rmt/2 Offline Device group status: rmt/3 Offline Device group status: erpora Online Device group status: erpapp Online------------------------------------------------------------------



-- Resource Groups and Resources -- 资源和资源组设置信息 Group Name Resources ---------- --------- Resources: nfs-rg erp-db nfs-res oracle-listener oracle-prod hastorage applprod Resources: app-rg erp-app app-res hastorage-app 每个资源组包含的资源列表。-- Resource Groups -- 资源组状态 Group Name Node Name State ---------- --------- ----- Group: nfs-rg erp-db1 Online Group: nfs-rg erp-db2 Offline Group: app-rg erp-db2 Online Group: app-rg erp-db1 Offline------------------------------------------------------------------



--- Resources --

Resource Name Node Name State Status Message ------------- --------- ----- -------------- Resource: erp-db erp-db1 Online Online - LogicalH. Resource: erp-db erp-db2 Offline Offline - Logical. Resource: nfs-res erp-db1 Online Online - Service . Resource: nfs-res erp-db2 Offline Offline-Complete



Resource: oracle-listener erp-db1 Online Online

Resource: oracle-listener erp-db2 Offline Offline Resource: oracle-prod erp-db1 Online Online Resource: oracle-prod erp-db2 Offline Offline Resource: hastorage erp-db1 Online Online Resource: hastorage erp-db2 Offline Offline Resource: applprod erp-db1 Online Online Resource: applprod erp-db2 Offline Offline



Resource: erp-app erp-db2 Online Online - LogicalHost

Resource: erp-app erp-db1 Offline Offline - LogicalHost. Resource: app-res erp-db2 Online Online Resource: app-res erp-db1 Offline Offline Resource: hastorage-app erp-db2 Online Online Resource: hastorage-app erp-db1 Offline Offline ------------------------------------------------------------------


SunCluster3.x Admin commandPnmset / pnmstat.

# pnmset –c nafo0 –o switch .. # pnmset –c nafo0 –o add .. # pnmset –c nafo0 –o remove .. # pnmset –c nafo0 –o create .. # pnmset –c nafo0 –o delete .. # pnmstat -l


Sun Cluster 3.0 Admin Command scshutdown # scshutdown (run only on one node) shutdown all the nodes in the cluster Shutdown one node steps # scswitch –S –h <nodename> # shutdown –i0 –g0 -y


Sun Cluster 3.0 Admin Command SunCluster Boot SunCluster will auto run with OS boot up

Boot Node to Non-Cluster mode ok> boot -x


Difference Between 3.0 & 3.1

public network SC3.0 : nafo ( local-mac-address?=false) SC3.1 : ipmp ( local-mac-address?=true)

More Data Service Agent Expand Fuction of Scsetup More Feature of Agent


Related directory, file

/opt/SUNWcluster (client)

/etc/cluster/conf

/usr/lib/sc

/var/opt/cluster

…


References URLFor more information …

● SunCluster 3.0 Concepts Guide at :

● http://docs.sun.com● Architecture and API Whitepapers :

● http://www.sun.com/clusters● Solaris software information :● http://www.sun.com/Solaris● BluePrint : Desiging Enterprise Solutions with Sun [tm] Cluster 3.0 ISBN

● http://www.sun.com/blueprints

http://docs.sun.com/

http://www.sun.com/clusters

http://www.sun.com/Solaris

http://www.sun.com/blueprints


Q & A

Q & A

Yong [email protected]

Thank Thank You!You!

sun cluster 3.0 introduce

Technology