building an inexpensive oracle rac 11g r2 on linux - (rhel 5).doc

8/14/2019 Building an Inexpensive Oracle RAC 11g R2 on Linux - (RHEL 5).doc

1/71

DBA Tips Archive for Oracle

Building an Inexpensive Oracle RAC 11g R2 on Linux - (RHEL 5)

! "e## Hun$er% &r' a$aase Adinis$ra$or

Contents

In$roduc$ion Oracle RAC 11g Overvie*

&+ared-&$orage Overvie*

i&C&I ,ec+nolog!

Hard*are and Cos$s

Ins$all $+e Linux Opera$ing &!s$e

Ins$all Reuired Linux .ac/ages #or Oracle RAC

Ins$all Open#iler

0e$*or/ Con#igura$ion

Clus$er ,ie &!nc+ronia$ion &ervice

Con#igure i&C&I olues using Open#iler

Con#igure i&C&I olues on Oracle RAC 0odes

Crea$e "o Role &epara$ion Opera$ing &!s$e .rivileges 3roups% 4sers% and irec$ories

Logging In $o a Reo$e &!s$e 4sing ,erinal

Con#igure $+e Linux &ervers #or Oracle

Con#igure RAC 0odes #or Reo$e Access using &&H - (Op$ional)

Ins$all and Con#igure A&6Li 2'7

o*nload Oracle RAC 11g Release 2 &o#$*are
http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Introductionhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Oracle%20RAC%2011g%20Overviewhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Shared-Storage%20Overviewhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#iSCSI%20Technologyhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Hardware%20and%20Costshttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Install%20the%20Linux%20Operating%20Systemhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Install%20Required%20Linux%20Packages%20for%20Oracle%20RAChttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Install%20Openfilerhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Network%20Configurationhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Cluster%20Time%20Synchronization%20Servicehttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Configure%20iSCSI%20Volumes%20using%20Openfilerhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Configure%20iSCSI%20Volumes%20on%20Oracle%20RAC%20Nodeshttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Create%20Job%20Role%20Separation%20Operating%20System%20Privileges%20Groups,%20Users,%20and%20Directorieshttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Logging%20In%20to%20a%20Remote%20System%20Using%20X%20Terminalhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Configure%20the%20Linux%20Servers%20for%20Oraclehttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Configure%20RAC%20Nodes%20for%20Remote%20Access%20using%20SSH%20-%20(Optional)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Install%20and%20Configure%20ASMLib%202.0http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Download%20Oracle%20RAC%2011g%20Release%202%20Softwarehttp://www.idevelopment.info/http://window.history.back%28%29/http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Oracle%20RAC%2011g%20Overviewhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Shared-Storage%20Overviewhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#iSCSI%20Technologyhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Hardware%20and%20Costshttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Install%20the%20Linux%20Operating%20Systemhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Install%20Required%20Linux%20Packages%20for%20Oracle%20RAChttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Install%20Openfilerhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Network%20Configurationhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Cluster%20Time%20Synchronization%20Servicehttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Configure%20iSCSI%20Volumes%20using%20Openfilerhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Configure%20iSCSI%20Volumes%20on%20Oracle%20RAC%20Nodeshttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Create%20Job%20Role%20Separation%20Operating%20System%20Privileges%20Groups,%20Users,%20and%20Directorieshttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Logging%20In%20to%20a%20Remote%20System%20Using%20X%20Terminalhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Configure%20the%20Linux%20Servers%20for%20Oraclehttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Configure%20RAC%20Nodes%20for%20Remote%20Access%20using%20SSH%20-%20(Optional)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Install%20and%20Configure%20ASMLib%202.0http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Download%20Oracle%20RAC%2011g%20Release%202%20Softwarehttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Introduction


2/71

.re-ins$alla$ion ,as/s #or Oracle 3rid In#ras$ruc$ure #or a Clus$er

Ins$all Oracle 3rid In#ras$ruc$ure #or a Clus$er

.os$-ins$alla$ion ,as/s #or Oracle 3rid In#ras$ruc$ure #or a Clus$er

Crea$e A&6 is/ 3roups #or a$a and 8as$ Recover! Area

Ins$all Oracle a$aase 11g *i$+ Oracle Real Applica$ion Clus$ers

Ins$all Oracle a$aase 11g Exaples (#orerl! Copanion)

Crea$e $+e Oracle Clus$er a$aase

.os$ a$aase Crea$ion ,as/s - (Op$ional)

Crea$e 9 Al$er ,alespaces

eri#! Oracle 3rid In#ras$ruc$ure and a$aase Con#igura$ion

&$ar$ing 9 &$opping $+e Clus$er

,roules+oo$ing

Conclusion

Ac/no*ledgeen$s

Aou$ $+e Au$+or

IntroductionOracle RAC 11gRelease 2 allo*s BA:s $o con#igure a clus$er da$aase solu$ion *i$+ superior#aul$ $olerance% load alancing% and scalaili$!' Ho*ever% BA:s *+o *an$ $o ecoe ore#ailiar *i$+ $+e #ea$ures and ene#i$s o# da$aase clus$ering% *ill #ind $+e cos$s o# con#iguringeven a sall RAC clus$er cos$ing in $+e range o# 4&;17%777 $o 4&;27%777' ,+is cos$ *ould no$even include $+e +ear$ o# a produc$ion RAC con#igura$ion% $+e s+ared s$orage' In os$ cases% $+is*ould e a &$orage Area 0e$*or/ (&A0)% *+ic+ generall! s$ar$ a$ 4&;17%777'

4n#or$una$el!% #or an! s+ops% $+e price o# $+e +ard*are reuired #or a $!pical RACcon#igura$ion exceeds os$ $raining udge$s' 8or $+ose *+o *an$ $o ecoe #ailiar *i$+ Oracle

RAC 11g*i$+ou$ a a?>@)%Oracle RAC 11gRelease 2 #or Linux x=>?>@% and A&6Li 2'7' All s+ared dis/ s$orage #orOracle RAC *ill e ased on i&C&Iusing Open#iler release 2' x=>?>@ running on a $+ird node(/no*n in $+is ar$icle as $+eNetwork Storage Server)'
http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Pre-installation%20Tasks%20for%20Oracle%20Grid%20Infrastructure%20for%20a%20Clusterhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Install%20Oracle%20Grid%20Infrastructure%20for%20a%20Clusterhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Post-installation%20Tasks%20for%20Oracle%20Grid%20Infrastructure%20for%20a%20Clusterhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Create%20ASM%20Disk%20Groups%20for%20Data%20and%20Fast%20Recovery%20Areahttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Install%20Oracle%20Database%2011g%20with%20Oracle%20Real%20Application%20Clustershttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Install%20Oracle%20Database%2011g%20Examples%20(formerly%20Companion)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Create%20the%20Oracle%20Cluster%20Databasehttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Post%20Database%20Creation%20Tasks%20-%20(Optional)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Create%20/%20Alter%20Tablespaceshttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Verify%20Oracle%20Grid%20Infrastructure%20and%20Database%20Configurationhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Starting%20/%20Stopping%20the%20Clusterhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Troubleshootinghttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Conclusionhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Acknowledgementshttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#About%20the%20Authorhttp://en.wikipedia.org/wiki/ISCSIhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Pre-installation%20Tasks%20for%20Oracle%20Grid%20Infrastructure%20for%20a%20Clusterhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Install%20Oracle%20Grid%20Infrastructure%20for%20a%20Clusterhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Post-installation%20Tasks%20for%20Oracle%20Grid%20Infrastructure%20for%20a%20Clusterhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Create%20ASM%20Disk%20Groups%20for%20Data%20and%20Fast%20Recovery%20Areahttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Install%20Oracle%20Database%2011g%20with%20Oracle%20Real%20Application%20Clustershttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Install%20Oracle%20Database%2011g%20Examples%20(formerly%20Companion)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Create%20the%20Oracle%20Cluster%20Databasehttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Post%20Database%20Creation%20Tasks%20-%20(Optional)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Create%20/%20Alter%20Tablespaceshttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Verify%20Oracle%20Grid%20Infrastructure%20and%20Database%20Configurationhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Starting%20/%20Stopping%20the%20Clusterhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Troubleshootinghttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Conclusionhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Acknowledgementshttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#About%20the%20Authorhttp://en.wikipedia.org/wiki/ISCSI


3/71

,+is guide is provided #or educational purposes only% so $+e se$up is /ep$ siple $o deons$ra$eideas and concep$s' 8or exaple% $+e s+ared Oracle Clus$er*are #iles (OCR and vo$ing #iles) andall p+!sical da$aase #iles in $+is ar$icle *ill e se$ up on onl! one p+!sical dis/% *+ile in prac$ice$+a$ s+ould e s$ored on ul$iple p+!sical drives con#igured #or increased per#orance andredundanc! (i'e' RAI)' In addi$ion% eac+ Linux node *ill onl! e con#igured *i$+ $*o ne$*or/

in$er#aces one #or $+e pulic ne$*or/ (eth0) and one $+a$ *ill e used #or o$+ $+e OracleRAC priva$e in$erconnec$ and $+e ne$*or/ s$orage server #or s+ared i&C&I access (eth1)' 8or a

produc$ion RAC ipleen$a$ion% $+e priva$e in$erconnec$ s+ould e a$ leas$ 3igai$ (or ore)*i$+ redundan$ pa$+s and onl! e used ! Oracle $o $rans#er Clus$er 6anager and Cac+e8usion rela$ed da$a' A $+ird dedica$ed ne$*or/ in$er#ace (eth2% #or exaple) s+ould e

con#igured on ano$+er redundan$ 3igai$ ne$*or/ #or access $o $+e ne$*or/ s$orage server(Open#iler)'

In addi$ion $o $+is guide% please see $+e #ollo*ing ex$ensions $o $+is ar$icle $+a$ descrie +o* $oadd and reove nodes #ro $+e Oracle RAC'

Add a 0ode $o an Exis$ing Oracle RAC 11g R2 Clus$er on Linux - (RHEL 5) Reove a 0ode #ro an Exis$ing Oracle RAC 11g R2 Clus$er on Linux - (RHEL 5)

Oracle Documentation

D+ile $+is guide provides de$ailed ins$ruc$ions #or success#ull! ins$alling a cople$e Oracle RAC11gs!s$e% i$ is by no means a substitute for the official Oracle documentation(see lis$elo*)' In addi$ion $o $+is guide% users s+ould also consul$ $+e #ollo*ing Oracle docuen$s $ogain a #ull unders$anding o# al$erna$ive con#igura$ion op$ions% ins$alla$ion% and adinis$ra$ion*i$+ Oracle RAC 11g' Oracle:s o##icial docuen$a$ion si$e is docs'oracle'co'

3rid In#ras$ruc$ure Ins$alla$ion 3uide - 11g Release 2 (11.2) for Linux Clus$er*are Adinis$ra$ion and eplo!en$ 3uide - 11g Release 2 (11.2)

Oracle Real Applica$ion Clus$ers Ins$alla$ion 3uide - 11g Release 2 (11.2) for Linux and

UN!

Real Applica$ion Clus$ers Adinis$ra$ion and eplo!en$ 3uide - 11g Release 2 (11.2)

Oracle a$aase 2 a! Real Applica$ion Clus$ers 3uide - 11g Release 2 (11.2)

Oracle a$aase &$orage Adinis$ra$or:s 3uide - 11g Release 2 (11.2)

Network Storae Server

.o*ered ! r.a$+ Linux% Open#ileris a #ree ro*ser-ased ne$*or/ s$orage anageen$ u$ili$!$+a$ delivers #ile-ased 0e$*or/ A$$ac+ed &$orage (0A&) and loc/-ased &$orage Area0e$*or/ing (&A0) in a single #rae*or/' ,+e en$ire so#$*are s$ac/ in$er#aces *i$+ open sourceapplica$ions suc+ as Apac+e% &aa% L62% ex$% Linux 08& and i&C&I En$erprise ,arge$'
http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_22.shtmlhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_22.shtmlhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_22.shtmlhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_22.shtmlhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_22.shtmlhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_24.shtmlhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_24.shtmlhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_24.shtmlhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_24.shtmlhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_24.shtmlhttp://docs.oracle.com/http://download.oracle.com/docs/cd/E11882_01/install.112/e17212/toc.htmhttp://download.oracle.com/docs/cd/E11882_01/rac.112/e16794/toc.htmhttp://download.oracle.com/docs/cd/E11882_01/install.112/e17214/toc.htmhttp://download.oracle.com/docs/cd/E11882_01/rac.112/e16795/toc.htmhttp://download.oracle.com/docs/cd/E11882_01/rac.112/e17264/toc.htmhttp://download.oracle.com/docs/cd/E11882_01/server.112/e16102/toc.htmhttp://www.rpath.com/corp/http://www.openfiler.com/http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_22.shtmlhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_24.shtmlhttp://docs.oracle.com/http://download.oracle.com/docs/cd/E11882_01/install.112/e17212/toc.htmhttp://download.oracle.com/docs/cd/E11882_01/rac.112/e16794/toc.htmhttp://download.oracle.com/docs/cd/E11882_01/install.112/e17214/toc.htmhttp://download.oracle.com/docs/cd/E11882_01/rac.112/e16795/toc.htmhttp://download.oracle.com/docs/cd/E11882_01/rac.112/e17264/toc.htmhttp://download.oracle.com/docs/cd/E11882_01/server.112/e16102/toc.htmhttp://www.rpath.com/corp/http://www.openfiler.com/


4/71

Open#iler coines $+ese uiui$ous $ec+nologies in$o a sall% eas! $o anage solu$ion #ron$ed! a po*er#ul *e-ased anageen$ in$er#ace'

Open#iler suppor$s CI8&% 08&% H,,.9A% 8,.% +o*ever% *e *ill onl! e a/ing use o# i$si&C&I capaili$ies $o ipleen$ an inexpensive &A0 #or $+e s+ared s$orage coponen$s reuired

! Oracle RAC 11g' ,+e opera$ing s!s$e (r.a$+ Linux) and $+e Open#iler applica$ion *ill eins$alled on one in$ernal &A,A dis/' A second in$ernal F3B 15G &C&I +ard dis/ *ill econ#igured as a single volue group$+a$ *ill e used #or all s+ared dis/ s$orage reuireen$s',+e Open#iler server *ill e con#igured $o use $+is volue group #or i&C&I ased s$orage and*ill e used in our Oracle RAC 11gcon#igura$ion $o s$ore $+e s+ared #iles reuired ! Oracle3rid In#ras$ruc$ure and $+e Oracle RAC da$aase'

Oracle !rid Infrastructure ""g#elease $ %""&$'

Di$+ Oracle 3rid In#ras$ruc$ure 11gRelease 2 (11'2)% $+e Au$oa$ic &$orage 6anageen$(A&6) and Oracle Clus$er*are so#$*are is pac/aged $oge$+er in a single inar! dis$riu$ion and

ins$alled in$o a single +oe direc$or!% *+ic+ is re#erred $o as $+e 3rid In#ras$ruc$ure +oe' ouus$ ins$all $+e 3rid In#ras$ruc$ure in order $o use Oracle RAC 11gRelease 2' Con#igura$ionassis$an$s s$ar$ a#$er $+e ins$aller in$ervie* process $+a$ *ill e responsile #or con#iguring A&6and Oracle Clus$er*are' D+ile $+e ins$alla$ion o# $+e coined produc$s is called Oracle 3ridIn#ras$ruc$ure% Oracle Clus$er*are and Au$oa$ic &$orage 6anager reain separa$e produc$s'

A#$er Oracle 3rid In#ras$ruc$ure is ins$alled and con#igured on o$+ nodes in $+e clus$er% $+e nex$s$ep *ill e $o ins$all $+e Oracle Real Applica$ion Clus$ers (Oracle RAC) so#$*are on o$+Oracle RAC nodes'

In $+is ar$icle% $+e Oracle 3rid In#ras$ruc$ure and Oracle RAC so#$*are *ill e ins$alled on o$+

nodes using $+e op$ional"o# Role Se$arationcon#igura$ion' One O& user *ill e crea$ed $o o*neac+ Oracle so#$*are produc$ grid #or $+e Oracle 3rid In#ras$ruc$ure o*ner and oracle

#or $+e Oracle RAC so#$*are' ,+roug+ou$ $+is ar$icle% a user crea$ed $o o*n $+e Oracle 3ridIn#ras$ruc$ure inaries is called $+e griduser' ,+is user *ill o*n o$+ $+e Oracle Clus$er*are

and Oracle Au$oa$ic &$orage 6anageen$ inaries' ,+e user crea$ed $o o*n $+e Oracleda$aase inaries (Oracle RAC) *ill e called $+e oracleuser' Bo$+ Oracle so#$*are o*ners

us$ +ave $+e Oracle Inven$or! group (oinstall) as $+eir priar! group% so $+a$ eac+ Oracle

so#$*are ins$alla$ion o*ner can *ri$e $o $+e cen$ral inven$or! (oraInven$or!)% and so $+a$ OCRand Oracle Clus$er*are resource perissions are se$ correc$l!' ,+e Oracle RAC so#$*are o*nerus$ also +ave $+e O&BA group and $+e op$ional O&O.ER group as secondar! groups'

Assinin I( Address

.rior $o Oracle Clus$er*are 11gRelease 2% $+e onl! e$+od availale #or assigning I. addresses$o eac+ o# $+e Oracle RAC nodes *as $o +ave $+e ne$*or/ adinis$ra$or anuall! assign s$a$ic I.addresses in 0& never $o use HC.' ,+is *ould include $+e pulic I. address #or $+e node%$+e RAC in$erconnec$% vir$ual I. address (I.)% and ne* $o 11g Release 2% $+e&ingle Clien$Access 0ae(&CA0) vir$ual I. address(s)'
http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Volume%20Group%20Managementhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Single%20Client%20Access%20Name%20(SCAN)%20for%20the%20Clusterhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Single%20Client%20Access%20Name%20(SCAN)%20for%20the%20Clusterhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Single%20Client%20Access%20Name%20(SCAN)%20for%20the%20Clusterhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Volume%20Group%20Managementhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Single%20Client%20Access%20Name%20(SCAN)%20for%20the%20Clusterhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Single%20Client%20Access%20Name%20(SCAN)%20for%20the%20Cluster


5/71

Oracle Clus$er*are 11gRelease 2 no* provides $*o e$+ods #or assigning I. addresses $o allOracle RAC nodes

1. Assigning I. addresses d!naicall! using 3rid 0aing &ervice(30&) *+ic+ a/es useo# HC.

2' ,+e $radi$ional e$+od o# anuall! assigning s$a$ic I. addresses in oain 0ae&ervice(0&)

Assinin I( Addresses Dynamically usin !rid Namin Service %!NS'

A ne* e$+od #or assigning I. addresses *as in$roduced in Oracle Clus$er*are 11gRelease 2naed %rid Na&ing Servi'e(30&) *+ic+ allo*s all priva$e in$erconnec$ addresses% as *ell asos$ o# $+e I. addresses $o e d!naicall! assigned using HC.' 30& and HC. are /e!eleen$s $o Oracle:s ne* 3rid .lug and .la! (3.n.) #ea$ure $+a$% as Oracle s$a$es% eliina$esper-node con#igura$ion da$a and $+e need #or explici$ add and dele$e nodes s$eps' 30& enales adna&i'3rid In#ras$ruc$ure $+roug+ $+e sel#-anageen$ o# $+e ne$*or/ reuireen$s #or $+e

clus$er'

All nae resolu$ion reues$s #or $+e clus$er *i$+in a su-doain delega$ed ! $+e 0& are+anded o## $o 30& using ul$icas$ oain 0ae &ervice (0&) included *i$+in $+e OracleClus$er*are' 4sing 30& eliina$es $+e need #or anaging I. addresses and nae resolu$ion andis especiall! advan$ageous in a d!naic clus$er environen$ *+ere nodes are o#$en added orreoved'

D+ile assigning I. addresses using 30& cer$ainl! +as i$s ene#i$s and o##ers ore #lexiili$!over anuall! de#ining s$a$ic I. addresses% i$ does coe a$ $+e cos$ o# coplexi$! and reuirescoponen$s no$ de#ined in $+is guide' 8or exaple% ac$iva$ing 30& in a clus$er reuires a HC.

server on $+e pulic ne$*or/ *+ic+ #alls ou$side $+e scope o# uilding an inexpensive OracleRAC'

,+e exaple Oracle RAC con#igura$ion descried in $+is guide *ill use $+e $radi$ional e$+od o#anuall! assigning s$a$ic I. addresses in 0&'

,o learn ore aou$ $+e ene#i$s and +o* $o con#igure 30&% please see Oracle 3ridIn#ras$ruc$ure Ins$alla$ion 3uide 11g Release 2 (11'2) #or Linux'

Assinin I( Addresses )anually usin Static I( Address * %The DNS )ethod'

I# !ou c+oose no$ $o use 30&% anuall! de#ining s$a$ic I. addresses is s$ill availale *i$+ OracleClus$er*are 11gRelease 2 and *ill e $+e e$+od used in $+is ar$icle $o assign all reuiredOracle Clus$er*are ne$*or/ing coponen$s (pulic I. address #or $+e node% RAC in$erconnec$%vir$ual I. address% and &CA0vir$ual I.)'

I$ s+ould e poin$ed ou$ $+a$ previous $o Oracle 11gRelease 2% $+e need #or 0& in order $osuccess#ull! con#igure Oracle RAC *as no$ a s$ric$ reuireen$' I$ *as $ec+nicall! possile(al$+oug+ no$ recoended #or a produc$ion s!s$e) $o de#ine all I. addresses onl! in $+e +os$s
http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Assigning%20IP%20Addresses%20Dynamically%20using%20Grid%20Naming%20Service%20(GNS)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Assigning%20IP%20Addresses%20Dynamically%20using%20Grid%20Naming%20Service%20(GNS)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Assigning%20IP%20Addresses%20Manually%20using%20Static%20IP%20Address%20-%20(The%20DNS%20Method)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Assigning%20IP%20Addresses%20Manually%20using%20Static%20IP%20Address%20-%20(The%20DNS%20Method)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Assigning%20IP%20Addresses%20Manually%20using%20Static%20IP%20Address%20-%20(The%20DNS%20Method)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Assigning%20IP%20Addresses%20Manually%20using%20Static%20IP%20Address%20-%20(The%20DNS%20Method)http://download.oracle.com/docs/cd/E11882_01/install.112/e17212/toc.htmhttp://download.oracle.com/docs/cd/E11882_01/install.112/e17212/toc.htmhttp://download.oracle.com/docs/cd/E11882_01/install.112/e17212/toc.htmhttp://download.oracle.com/docs/cd/E11882_01/install.112/e17212/toc.htmhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Single%20Client%20Access%20Name%20(SCAN)%20for%20the%20Clusterhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Single%20Client%20Access%20Name%20(SCAN)%20for%20the%20Clusterhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Assigning%20IP%20Addresses%20Dynamically%20using%20Grid%20Naming%20Service%20(GNS)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Assigning%20IP%20Addresses%20Manually%20using%20Static%20IP%20Address%20-%20(The%20DNS%20Method)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Assigning%20IP%20Addresses%20Manually%20using%20Static%20IP%20Address%20-%20(The%20DNS%20Method)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Assigning%20IP%20Addresses%20Manually%20using%20Static%20IP%20Address%20-%20(The%20DNS%20Method)http://download.oracle.com/docs/cd/E11882_01/install.112/e17212/toc.htmhttp://download.oracle.com/docs/cd/E11882_01/install.112/e17212/toc.htmhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Single%20Client%20Access%20Name%20(SCAN)%20for%20the%20Cluster


6/71

#ile on all nodes in $+e clus$er (i'e' /etc/hosts)' ,+is ac$uall! *or/ed $o ! advan$age *i$+ an!

o# ! previous ar$icles on uilding an inexpensive RAC ecause i$ *as one less coponen$ $odocuen$ and con#igure'

&o% *+! is $+e use o# 0& no* a reuireen$ *+en anuall! assigning s$a$ic I. addressesJ ,+e

ans*er is &CA0' Oracle Clus$er*are 11g Release 2 reuires $+e use o# 0& in order $o s$ore $+e&CA0 vir$ual I. address(s)' In addi$ion $o $+e reuireen$ o# con#iguring $+e &CA0 vir$ual I.address in 0&% *e *ill also con#igure $+e pulic and vir$ual I. address #or all Oracle RACnodes in 0& #or nae resolu$ion' I# !ou do no$ +ave access $o a 0&% ins$ruc$ions *ill eincluded la$er in $+is guideon +o* $o ins$all a inial 0& server on $+e Open#iler ne$*or/s$orage server'

D+en using $+e 0& e$+od #or assigning I. addresses% Oracle recoends $+a$ alls$a$ic I. addresses e anuall! con#igured in 0& e#ore s$ar$ing $+e Oracle 3ridIn#ras$ruc$ure ins$alla$ion'

Sinle Client Access Name %SCAN' for the Cluster

I# !ou +ave ever een $as/ed *i$+ ex$ending an Oracle RAC clus$er ! adding a ne* node (ors+rin/ing a RAC clus$er ! reoving a node)% $+en !ou /no* $+e pain o# going $+roug+ a lis$ o#all clien$s and upda$ing $+eir &KL0e$ or "BC con#igura$ion $o re#lec$ $+e ne* or dele$ed node',o address $+is prole% Oracle 11gRelease 2 in$roduced a ne* #ea$ure /no*n as Single lient*''ess Na&eor &CA0 #or s+or$' &CA0 is a ne* #ea$ure $+a$ provides a single +os$ nae #orclien$s $o access an Oracle a$aase running in a clus$er' Clien$s using &CA0 do no$ need $oc+ange $+eir ,0& con#igura$ion i# !ou add or reove nodes in $+e clus$er' ,+e &CA0 resourceand i$s associa$ed I. address(s) provide a s$ale nae #or clien$s $o use #or connec$ions%independen$ o# $+e nodes $+a$ a/e up $+e clus$er' ou *ill e as/ed $o provide $+e +os$ nae(also called $+e &CA0 nae in $+is docuen$) and up $o $+ree I. addresses $o e used #or $+e&CA0 resource during $+e in$ervie* p+ase o# $+e Oracle 3rid In#ras$ruc$ure ins$alla$ion' 8or+ig+ availaili$! and scalaili$!% Oracle recoends $+a$ !ou con#igure $+e &CA0 nae #orround-roin resolu$ion $o $+ree I. addresses' A$ a iniu% $+e &CA0 us$ resolve $o a$ leas$one address'

,+e &CA0 vir$ual I. nae is siilar $o $+e naes used #or a node:s vir$ual I. address% suc+ asracnode1-vip' Ho*ever% unli/e a vir$ual I.% $+e &CA0 is associa$ed *i$+ $+e en$ire clus$er%

ra$+er $+an an individual node% and can e associa$ed *i$+ ul$iple I. addresses% no$


7/71

,+e &CA0 s+ould e con#igured so $+a$ i$ is resolvale ei$+er ! using 3rid 0aing &ervice(30&) *i$+in $+e clus$er or ! using $+e $radi$ional e$+od o# assigning s$a$ic I. addresses usingoain 0ae &ervice(0&) resolu$ion'

In $+is ar$icle% I *ill con#igure &CA0 #or round-roin resolu$ion $o $+ree% anuall! con#igured

s$a$ic I. address using $+e 0& e$+od'

racnode-cluster-scan IN A 192.168.1.187racnode-cluster-scan IN A 192.168.1.188racnode-cluster-scan IN A 192.168.1.189

8ur$+er de$ails regarding $+e con#igura$ion o# &CA0 *ill e provided in $+e sec$ion eri#!&CA0 Con#igura$ion during $+e ne$*or/ con#igura$ion p+ase o# $+is guide''

Automatic Storae )anaement and Oracle Clusterware

+iles

Au$oa$ic &$orage 6anageen$ (A&6) is no* #ull! in$egra$ed *i$+ Oracle Clus$er*are in $+eOracle 3rid In#ras$ruc$ure' Oracle A&6 and Oracle a$aase 11gRelease 2 provide a oreen+anced s$orage solu$ion #ro previous releases' .ar$ o# $+is solu$ion is $+e aili$! $o s$ore $+eOracle Clus$er*are #ilesM nael! $+e Oracle Clus$er Regis$r! (OCR) and $+e o$ing 8iles (8%also /no*n as $+e o$ing is/s) on A&6' ,+is #ea$ure enales A&6 $o provide a uni#ied s$oragesolu$ion% s$oring all $+e da$a #or $+e clus$er*are and $+e da$aase *i$+ou$ $+e need #or $+ird-par$!volue anagers or clus$er #ile s!s$es'

"us$ li/e da$aase #iles% Oracle Clus$er*are #iles are s$ored in an A&6 dis/ group and $+ere#ore

u$ilie $+e A&6 dis/ group con#igura$ion *i$+ respec$ $o redundanc!' 8or exaple% aNor&alRedundan'A&6 dis/ group *ill +old a $*o-*a!-irrored OCR' A #ailure o# one dis/ in $+edis/ group *ill no$ preven$ access $o $+e OCR' Di$+ aHig+ Redundan'A&6 dis/ group ($+ree-*a!-irrored)% $*o independen$ dis/s can #ail *i$+ou$ ipac$ing access $o $+e OCR' Di$+External Redundan'% no pro$ec$ion is provided ! Oracle'

Oracle onl! allo*s one OCR per dis/ group in order $o pro$ec$ agains$ p+!sical dis/ #ailures'D+en con#iguring Oracle Clus$er*are #iles on a produc$ion s!s$e% Oracle recoends usingei$+er noral or +ig+ redundanc! A&6 dis/ groups' I# dis/ irroring is alread! occurring a$ei$+er $+e O& or +ard*are level% !ou can use ex$ernal redundanc!'

,+e o$ing 8iles are anaged in a siilar *a! $o $+e OCR' ,+e! #ollo* $+e A&6 dis/ groupcon#igura$ion *i$+ respec$ $o redundanc!% u$ are no$ anaged as noral A&6 #iles in $+e dis/group' Ins$ead% eac+ vo$ing dis/ is placed on a speci#ic dis/ in $+e dis/ group' ,+e dis/ and $+eloca$ion o# $+e o$ing 8iles on $+e dis/s are s$ored in$ernall! *i$+in Oracle Clus$er*are'

,+e #ollo*ing exaple descries +o* $+e Oracle Clus$er*are #iles are s$ored in A&6 a#$erins$alling Oracle 3rid In#ras$ruc$ure using $+is guide' ,o vie* $+e OCR% use AS!"'
http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Assigning%20IP%20Addresses%20Dynamically%20using%20Grid%20Naming%20Service%20(GNS)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Assigning%20IP%20Addresses%20Manually%20using%20Static%20IP%20Address%20-%20(The%20DNS%20Method)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Assigning%20IP%20Addresses%20Manually%20using%20Static%20IP%20Address%20-%20(The%20DNS%20Method)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Verify%20SCAN%20Configurationhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Verify%20SCAN%20Configurationhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Assigning%20IP%20Addresses%20Dynamically%20using%20Grid%20Naming%20Service%20(GNS)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Assigning%20IP%20Addresses%20Manually%20using%20Static%20IP%20Address%20-%20(The%20DNS%20Method)http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Verify%20SCAN%20Configurationhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_12.shtml#Verify%20SCAN%20Configuration


8/71

#grid$racnode1 %&' asmcmdAS!"( ls -l +CRS/racnode-cluster/OCRFILE)*pe +edund Striped )i,e S*s Na,e!+I N+) !A+S N3 22 12400400 5 +IS)+5.2.70028

8ro $+e exaple aove% !ou can see $+a$ a#$er lis$ing all o# $+e A&6 #iles in $+e:!+S/racnode-cluster/!+Idirec$or!% i$ onl! s+o*s $+e OCR

(+IS)+5.2.70028)' ,+e lis$ing does no$ s+o* $+e o$ing 8ile(s) ecause $+e! are no$

anaged as noral A&6 #iles' ,o #ind $+e loca$ion o# all o$ing 8iles *i$+in OracleClus$er*are% use $+e crsctl ;uer* css votedis


9/71

Oracle &o#$*are Coponen$s

mponent OS -ser (rimary !roup Supplementary !roups .ome Directory Oracle Base / Oracle

ucture grid oins$all asadin% asda% asoper /ho,e/grid/u01/app/grid/u01/app/11.2.0/grid

oracle oins$all da% oper% asda /ho,e/oracle/u01/app/oracle/u01/app/oracle/product/1

&$orage Coponen$s

omponent +ile System ,olume Si0e AS) ,olume !roup Name AS) #edundancy Openfiler ,

Disk A&6 23B CR& Ex$ernal racd-crs1

es A&6 23B RACB?A,A Ex$ernal racd-da$a1

ry Area A&6 23B 8RA Ex$ernal racd-#ra1

,+is ar$icle is onl! designed $o *or/ as docuen$ed *i$+ asolu$el! no sus$i$u$ions' ,+e onl!excep$ion +ere is $+e c+oice o# vendor +ard*are (i'e' ac+ines% ne$*or/ing euipen$% andin$ernal 9 ex$ernal +ard drives)' Ensure $+a$ $+e +ard*are !ou purc+ase #ro $+e vendor issuppor$ed on Red Ha$ En$erprise Linux 5 and Open#iler 2' (8inal Release)'

I# !ou are loo/ing #or an exaple $+a$ $a/es advan$age o# Oracle RAC 17gRelease 2 *i$+ RHEL5' using i&C&I% clic/ +ere'

I# !ou are loo/ing #or an exaple $+a$ $a/es advan$age o# Oracle RAC 11grelease 1 *i$+ RHEL5'1 using i&C&I% clic/ +ere'

Oracle #AC "" Overview

Be#ore in$roducing $+e de$ails #or uilding a RAC clus$er% i$ ig+$ e +elp#ul $o #irs$ clari#! *+a$

a clus$er is' A clus$er is a group o# $*o or ore in$erconnec$ed copu$ers or servers $+a$ appearas i# $+e! are one server $o end users and applica$ions and generall! s+are $+e sae se$ o#p+!sical dis/s' ,+e /e! ene#i$ o# clus$ering is $o provide a +ig+l! availale #rae*or/ *+ere$+e #ailure o# one node (#or exaple a da$aase server running an ins$ance o# Oracle) does no$ring do*n an en$ire applica$ion' In $+e case o# #ailure *i$+ one o# $+e servers% $+e o$+ersurviving server (or servers) can $a/e over $+e *or/load #ro $+e #ailed server and $+eapplica$ion con$inues $o #unc$ion norall! as i# no$+ing +as +appened'

,+e concep$ o# clus$ering copu$ers ac$uall! s$ar$ed several decades ago' ,+e #irs$ success#ulclus$er produc$ *as developed ! a$a.oin$ in 1NFF naed ARCne$' ,+e ARCne$ produc$en #or $+e igi$al A clus$er produc$% Oracle *as $+e #irs$coercial da$aase $o suppor$ clus$ering a$ $+e da$aase level' I$ *asn:$ long% +o*ever% e#oreOracle realied $+e need #or a ore e##icien$ and scalale dis$riu$ed loc/ anager (L6) as $+eone included *i$+ $+e A96& clus$er produc$ *as no$ *ell sui$ed #or da$aase applica$ions'Oracle decided $o design and *ri$e $+eir o*n L6 #or $+e A96& clus$er produc$ *+ic+
http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle10gRAC/CLUSTER_12.shtmlhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_10.shtmlhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle10gRAC/CLUSTER_12.shtmlhttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/CLUSTER_10.shtml


10/71

provided $+e #ine-grain loc/ level loc/ing reuired ! $+e da$aase' Oracle:s o*n L6 *asincluded in Oracle >'2 *+ic+ gave ir$+ $o Oracle .arallel &erver (O.&) - $+e #irs$ da$aase $o run$+e parallel server'

B! Oracle F% O.& *as ex$ended $o included suppor$ #or no$ onl! $+e A96& clus$er produc$

u$ also *i$+ os$ #lavors o# 40I' ,+is #rae*or/ reuired vendor-supplied clus$er*are*+ic+ *or/ed *ell% u$ ade #or a coplex environen$ $o se$up and anage given $+e ul$iplela!ers involved' B! Oracle=% Oracle in$roduced a generic loc/ anager $+a$ *as in$egra$ed in$o$+e Oracle /ernel' In la$er releases o# Oracle% $+is ecae /no*n as $+e In$egra$ed is$riu$edLoc/ 6anager (IL6) and relied on an addi$ional la!er /no*n as $+e Opera$ing &!s$eependan$ (O&) la!er' ,+is ne* odel paved $+e *a! #or Oracle $o no$ onl! +ave $+eir o*nL6% u$ $o also crea$e $+eir o*n clus$er*are produc$ in #u$ure releases'

Oracle Real Applica$ion Clus$ers (RAC)% in$roduced *i$+ OracleNi% is $+e successor $o Oracle.arallel &erver' 4sing $+e sae IL6% OracleNicould s$ill rel! on ex$ernal clus$er*are u$ *as$+e #irs$ release $o include $+eir o*n clus$er*are produc$ naed Clus$er Read! &ervices (CR&)'

Di$+ OracleNi% CR& *as onl! availale #or Dindo*s and Linux' B! Oracle 17grelease 1%Oracle:s clus$er*are produc$ *as availale #or all opera$ing s!s$es and *as $+e reuired clus$er$ec+nolog! #or Oracle RAC' Di$+ $+e release o# Oracle a$aase 17gRelease 2 (17'2)% Clus$erRead! &ervices *as renaed $o Oracle Clus$er*are' D+en using Oracle 17gor +ig+er% OracleClus$er*are is $+e onl! clus$er*are $+a$ !ou need #or os$ pla$#ors on *+ic+ Oracle RACopera$es (excep$ #or ,ru clus$er% in *+ic+ case !ou need vendor clus$er*are)' ou can s$ill useclus$er*are #ro o$+er vendors i# $+e clus$er*are is cer$i#ied% u$ /eep in ind $+a$ Oracle RACs$ill reuires Oracle Clus$er*are as i$ is #ull! in$egra$ed *i$+ $+e da$aase so#$*are' ,+is guideuses Oracle Clus$er*are *+ic+ as o# 11gRelease 2 (11'2)% is no* a coponen$ o# Oracle 3ridIn#ras$ruc$ure'

Li/e O.&% Oracle RAC allo*s ul$iple ins$ances $o access $+e sae da$aase (s$orage)siul$aneousl!' RAC provides #aul$ $olerance% load alancing% and per#orance ene#i$s !allo*ing $+e s!s$e $o scale ou$% and a$ $+e sae $ie since all ins$ances access $+e saeda$aase% $+e #ailure o# one node *ill no$ cause $+e loss o# access $o $+e da$aase'

A$ $+e +ear$ o# Oracle RAC is a s+ared dis/ sus!s$e' Eac+ ins$ance in $+e clus$er us$ e ale$o access all o# $+e da$a% redo log #iles% con$rol #iles and parae$er #ile #or all o$+er ins$ances in$+e clus$er' ,+e da$a dis/s us$ e gloall! availale in order $o allo* all ins$ances $o access $+eda$aase' Eac+ ins$ance +as i$s o*n redo log #iles and 40O $alespace $+a$ are locall!read9*ri$ale' ,+e o$+er ins$ances in $+e clus$er us$ e ale $o access $+e (read-onl!) in order$o recover $+a$ ins$ance in $+e even$ o# a s!s$e #ailure' ,+e redo log #iles #or an ins$ance areonl! *ri$ale ! $+a$ ins$ance and *ill onl! e read #ro ano$+er ins$ance during s!s$e #ailure',+e 40O% on $+e o$+er +and% is read all $+e $ie during noral da$aase opera$ion (e'g' #or CR#arica$ion)'

A ig di##erence e$*een Oracle RAC and O.& is $+e addi$ion o# Cac+e 8usion' Di$+ O.& areues$ #or da$a #ro one ins$ance $o ano$+er reuired $+e da$a $o e *ri$$en $o dis/ #irs$% $+en $+ereues$ing ins$ance can read $+a$ da$a (a#$er acuiring $+e reuired loc/s)' ,+is process *as


11/71

called dis/ pinging' Di$+ cac+e #usion% da$a is passed along a +ig+-speed in$erconnec$ using asop+is$ica$ed loc/ing algori$+'

0o$ all da$aase clus$ering solu$ions use s+ared s$orage' &oe vendors use an approac+ /no*nas a 8edera$ed Clus$er% in *+ic+ da$a is spread across several ac+ines ra$+er $+an s+ared ! all'

Di$+ Oracle RAC% +o*ever% ul$iple ins$ances use $+e sae se$ o# dis/s #or s$oring da$a'Oracle:s approac+ $o clus$ering leverages $+e collec$ive processing po*er o# all $+e nodes in $+eclus$er and a$ $+e sae $ie provides #ailover securi$!'

.re-con#igured Oracle RAC solu$ions are availale #ro vendors suc+ as ell% IB6 and H. #orproduc$ion environen$s' ,+is ar$icle% +o*ever% #ocuses on pu$$ing $oge$+er !our o*n OracleRAC 11genvironen$ #or developen$ and $es$ing ! using Linux servers and a lo* cos$ s+areddis/ solu$ionM i&C&I'

8or ore ac/ground aou$ Oracle RAC% visi$ $+eOracle RAC .roduc$ Cen$eron O,0'

Shared*Storae Overview,oda!% #ire c+annel is one o# $+e os$ popular solu$ions #or s+ared s$orage' As en$ionedearlier% #ire c+annel is a +ig+-speed serial-$rans#er in$er#ace $+a$ is used $o connec$ s!s$es ands$orage devices in ei$+er poin$-$o-poin$ (8C-.2.)% ari$ra$ed loop (8C-AL)% or s*i$c+ed$opologies (8C-&D)' .ro$ocols suppor$ed ! 8ire C+annel include &C&I and I.' 8ire c+annelcon#igura$ions can suppor$ as an! as 12F nodes and +ave a $+roug+pu$ o# up $o 2'12 3igai$sper second in eac+ direc$ion% and @'25 3ps is expec$ed'

8ire c+annel% +o*ever% is ver! expensive' "us$ $+e #ire c+annel s*i$c+ alone can s$ar$ a$ around

4&;1%777' ,+is does no$ even include $+e #ire c+annel s$orage arra! and +ig+-end drives% *+ic+can reac+ prices o# aou$ 4&;77 #or a single >3B drive' A $!pical #ire c+annel se$up *+ic+includes #ire c+annel cards #or $+e servers is roug+l! 4&;17%777% *+ic+ does no$ include $+ecos$ o# $+e servers $+a$ a/e up $+e Oracle da$aase clus$er'

A less expensive al$erna$ive $o #ire c+annel is &C&I' &C&I $ec+nolog! provides accep$aleper#orance #or s+ared s$orage% u$ #or adinis$ra$ors and developers *+o are used $o 3.L-ased Linux prices% even &C&I can coe in over udge$% a$ around 4&;2%777 $o 4&;5%777 #or a$*o-node clus$er'

Ano$+er popular solu$ion is $+e &un 08& (0e$*or/ 8ile &!s$e) #ound on a 0A&' I$ can e used

#or s+ared s$orage u$ onl! i# !ou are using a ne$*or/ appliance or soe$+ing siilar'&peci#icall!% !ou need servers $+a$ guaran$ee direc$ I9O over 08&% ,C. as $+e $ranspor$ pro$ocol%and read9*ri$e loc/ sies o# 2G' &ee $+e Cer$i#! page on Oracle 6e$alin/ #or suppor$ed0e$*or/ A$$ac+ed &$orage (0A&) devices $+a$ can e used *i$+ Oracle RAC' One o# $+e /e!dra*ac/s $+a$ +as lii$ed $+e ene#i$s o# using 08& and 0A& #or da$aase s$orage +as eenper#orance degrada$ion and coplex con#igura$ion reuireen$s' &$andard 08& clien$ so#$*are(clien$ s!s$es $+a$ use $+e opera$ing s!s$e provided 08& driver) is no$ op$iied #or Oracleda$aase #ile I9O access pa$$erns' Di$+ $+e in$roduc$ion o# Oracle 11g% a ne* #ea$ure /no*n as
http://www.oracle.com/technetwork/database/clustering/overview/index-086583.htmlhttp://www.oracle.com/technetwork/database/clustering/overview/index-086583.htmlhttp://www.oracle.com/technetwork/database/clustering/overview/index-086583.html


12/71

,ire't N-S lientin$egra$es $+e 08& clien$ #unc$ionali$! direc$l! in $+e Oracle so#$*are',+roug+ $+is in$egra$ion% Oracle is ale $o op$iie $+e I9O pa$+ e$*een $+e Oracle so#$*are and$+e 08& server resul$ing in signi#ican$ per#orance gains' irec$ 08& Clien$ can sipli#!% and inan! cases au$oa$e% $+e per#orance op$iia$ion o# $+e 08& clien$ con#igura$ion #or da$aase*or/loads' ,o learn ore aou$ irec$ 08& Clien$% see $+e Oracle D+i$e .aper en$i$led Oracle

a$aase 11g irec$ 08& Clien$'

,+e s+ared s$orage $+a$ *ill e used #or $+is ar$icle is ased on i&C&I $ec+nolog! using a ne$*or/s$orage server ins$alled *i$+ Open#iler' ,+is solu$ion o##ers a lo*-cos$ al$erna$ive $o #irec+annel #or $es$ing and educa$ional purposes% u$ given $+e lo*-end +ard*are eing used% i$ isno$ o#$en used in a produc$ion environen$'

iSCSI Technoloy

8or an! !ears% $+e onl! $ec+nolog! $+a$ exis$ed #or uilding a ne$*or/ ased s$orage solu$ion

*as a 8ire C+annel &$orage Area 0e$*or/ (8C &A0)' Based on an earlier se$ o# A0&Ipro$ocols called-i#er ,istri#uted ,ata nterfa'e(8I)% 8ire C+annel *as developed $o ove&C&I coands over a s$orage ne$*or/'

&everal o# $+e advan$ages $o 8C &A0 include grea$er per#orance% increased dis/ u$ilia$ion%iproved availaili$!% e$$er scalaili$!% and os$ ipor$an$ $o us suppor$ #or serverclus$ering &$ill $oda!% +o*ever% 8C &A0s su##er #ro $+ree a


13/71

en$irel! $o s$orage% +o*ever% i$s coponen$s can e uc+ $+e sae as in a $!pical I. ne$*or/(LA0)'

D+ile i&C&I +as a proising #u$ure% an! o# i$s earl! cri$ics *ere uic/ $o poin$ ou$ soe o# i$sin+eren$ s+or$coings *i$+ regards $o per#orance' ,+e eau$! o# i&C&I is i$s aili$! $o u$ilie

an alread! #ailiar I. ne$*or/ as i$s $ranspor$ ec+anis' ,+e ,C.9I. pro$ocol% +o*ever% isver! coplex and C.4 in$ensive' Di$+ i&C&I% os$ o# $+e processing o# $+e da$a (o$+ ,C. andi&C&I) is +andled in so#$*are and is uc+ slo*er $+an 8ire C+annel *+ic+ is +andledcople$el! in +ard*are' ,+e over+ead incurred in apping ever! &C&I coand on$o aneuivalen$ i&C&I $ransac$ion is excessive' 8or an! $+e solu$ion is $o do a*a! *i$+ i&C&Iso#$*are ini$ia$ors and inves$ in specialied cards $+a$ can o##load ,C.9I. and i&C&I processing#ro a server:s C.4' ,+ese specialied cards are soe$ies re#erred $o as an i&C&I Hos$ BusAdap$or (HBA) or a ,C. O##load Engine (,OE) card' Also consider $+a$ 17-3igai$ E$+erne$ isa reali$! $oda!

&o *i$+ all o# $+is $al/ aou$ i&C&I% does $+is ean $+e dea$+ o# 8ire C+annel an!$ie soonJ

.roal! no$' 8ire C+annel +as clearl! deons$ra$ed i$s capaili$ies over $+e !ears *i$+ i$scapaci$! #or ex$reel! +ig+ speeds% #lexiili$!% and rous$ reliaili$!' Cus$oers *+o +ave s$ric$reuireen$s #or +ig+ per#orance s$orage% large coplex connec$ivi$!% and ission cri$icalreliaili$! *ill undou$edl! con$inue $o c+oose 8ire C+annel'

As *i$+ an! ne* $ec+nolog!% i&C&I coes *i$+ i$s o*n se$ o# acron!s and $erinolog!' 8or$+e purpose o# $+is ar$icle% i$ is onl! ipor$an$ $o unders$and $+e di##erence e$*een an i&C&Iini$ia$or and an i&C&I $arge$'

iSCSI Initiator

Basicall!% an i&C&I ini$ia$or is a clien$ device $+a$ connec$s and ini$ia$es reues$s $o soe serviceo##ered ! a server (in $+is case an i&C&I $arge$)' ,+e i&C&I ini$ia$or so#$*are *ill need $o exis$on eac+ o# $+e Oracle RAC nodes (racnode1and racnode2)'

An i&C&I ini$ia$or can e ipleen$ed using ei$+er so#$*are or +ard*are' &o#$*are i&C&Iini$ia$ors are availale #or os$ a


14/71

.ardware and Costs

,+e +ard*are used $o uild our exaple Oracle RAC 11genvironen$ consis$s o# $+ree Linuxservers ($*o Oracle RAC nodes and one 0e$*or/ &$orage &erver) and coponen$s $+a$ can e

purc+ased a$ an! local copu$er s$ores or over $+e In$erne$'


15/71

Oracle #AC Node " * %racnode"'

Dell (ower1de T"22ual Core In$el(R) eon(R) E117% '7 3H% >6B Cac+e%16H@3B% R2% =776H

1>73B F'2G R.6 &A,A 3ps Hard riveIn$egra$ed 3rap+ics - (A,I E&1777)In$egra$ed 3igai$ E$+erne$ - (Broadco(R) 0e$$ree II,65F22)1>x rive0o Ge!oard% 6oni$or% or 6ouse - (Connec$ed $o G6&*i$c+) 4&;577

" 3 1thernet 4AN Card4sed #or RAC in$erconnec$ $o racnode2 and Open#ilerne$*or/ed s$orage'Eac+ Linux server #or Oracle RAC s+ould con$ain a$ leas$ $*o

0IC adap$ers' ,+e ell .o*erEdge ,177 includes aneedded Broadco(R) 0e$$ree II,6 5F22 3igai$E$+erne$ 0IC $+a$ *ill e used $o connec$ $o $+e pulicne$*or/' A second 0IC adap$er *ill e used #or $+e priva$ene$*or/ (RAC in$erconnec$ and Open#iler ne$*or/eds$orage)' &elec$ $+e appropria$e 0IC adap$er $+a$ is copa$ile*i$+ $+e axiu da$a $ransission speed o# $+e ne$*or/s*i$c+ $o e used #or $+e priva$e ne$*or/' 8or $+e purpose o#$+is ar$icle% I used a 3igai$ E$+erne$ s*i$c+ (and a 13E$+erne$ card) #or $+e priva$e ne$*or/'In$el(R) .RO91777 ., &erver Adap$er - (E.IN@77.,) 4&;N7

Oracle #AC Node $ * %racnode$'Dell (ower1de T"22ual Core In$el(R) eon(R) E117% '7 3H% >6B Cac+e%16H@3B% R2% =776H1>73B F'2G R.6 &A,A 3ps Hard riveIn$egra$ed 3rap+ics - (A,I E&1777)In$egra$ed 3igai$ E$+erne$ - (Broadco(R) 0e$$ree II,65F22)1>x rive0o Ge!oard% 6oni$or% or 6ouse - (Connec$ed $o G6

&*i$c+) 4&;577" 3 1thernet 4AN Card4sed #or RAC in$erconnec$ $o racnode1 and Open#ilerne$*or/ed s$orage'Eac+ Linux server #or Oracle RAC s+ould con$ain a$ leas$ $*o0IC adap$ers' ,+e ell .o*erEdge ,177 includes aneedded Broadco(R) 0e$$ree II,6 5F22 3igai$E$+erne$ 0IC $+a$ *ill e used $o connec$ $o $+e pulic

4&;N7


16/71







&*i$c+) 4&;577ne$*or/' A second 0IC adap$er *ill e used #or $+e priva$ene$*or/ (RAC in$erconnec$ and Open#iler ne$*or/eds$orage)' &elec$ $+e appropria$e 0IC adap$er $+a$ is copa$ile*i$+ $+e axiu da$a $ransission speed o# $+e ne$*or/s*i$c+ $o e used #or $+e priva$e ne$*or/' 8or $+e purpose o#$+is ar$icle% I used a 3igai$ E$+erne$ s*i$c+ (and a 13E$+erne$ card) #or $+e priva$e ne$*or/'


17/71







&*i$c+) 4&;577In$el(R) .RO91777 ., &erver Adap$er - (E.IN@77.,)

Network Storae Server * %openfiler"'

Dell (ower1de "522ual '73H eon 9 16B Cac+e 9 =778&B (&LF.E)>3B o# ECC 6eor!5773B &A,A In$ernal Hard is/F3B 15G &C&I In$ernal Hard is/

4&;=77
http://www.buy.com/prod/intel-pro-1000-pt-server-adapter-pci-express-1-x-rj-45-10-100-1000base/q/loc/101/202007895.htmlhttp://www.buy.com/prod/intel-pro-1000-pt-server-adapter-pci-express-1-x-rj-45-10-100-1000base/q/loc/101/202007895.htmlhttp://www.buy.com/prod/intel-pro-1000-pt-server-adapter-pci-express-1-x-rj-45-10-100-1000base/q/loc/101/202007895.htmlhttp://www.buy.com/prod/intel-pro-1000-pt-server-adapter-pci-express-1-x-rj-45-10-100-1000base/q/loc/101/202007895.html


18/71







&*i$c+) 4&;577In$egra$ed 3rap+ics&ingle eedded In$el 17917791777 3igai$ 0IC1>x rive0o Ge!oard% 6oni$or% or 6ouse - (Connec$ed $o G6&*i$c+)Note6,+e r.a$+ Linux opera$ing s!s$e and Open#ilerapplica$ion *ill e ins$alled on $+e 5773B in$ernal &A,A


19/71







&*i$c+) 4&;577dis/' A second in$ernal F3B 15G &C&I +ard dis/ *ill econ#igured #or $+e s+ared da$aase s$orage' ,+e Open#ilerserver *ill e con#igured $o use $+is second +ard dis/ #ori&C&I ased s$orage and *ill e used in our Oracle RAC 11gcon#igura$ion $o s$ore $+e s+ared #iles reuired ! OracleClus$er*are as *ell as $+e clus$er da$aase #iles'.lease e a*are $+a$ any$!pe o# +ard dis/ (in$ernal or


20/71







&*i$c+) 4&;577ex$ernal) s+ould *or/ #or $+e s+ared dis/ s$orage as long as i$can e recognied ! $+e ne$*or/ s$orage server (Open#iler)and +as adeua$e space' 8or exaple% I could +ave ade anex$ra par$i$ion on $+e 5773B in$ernal &A,A dis/ #or $+ei&C&I $arge$% u$ decided $o a/e use o# $+e #as$er &C&I dis/#or $+is exaple'8inall!% al$+oug+ $+e Open#iler server used in $+is exaple


21/71







&*i$c+) 4&;577con#igura$ion con$ains >3B o# eor!% $+is is ! no eans areuireen$' ,+e Open#iler server could e con#igured *i$+ asli$$le as 23B #or a sall $es$ 9 evalua$ion ne$*or/ s$orageserver'

" 3 1thernet 4AN Card4sed #or ne$*or/ed s$orage on $+e priva$e ne$*or/',+e 0e$*or/ &$orage &erver (Open#iler server) s+ould con$ain

4&;125


22/71







&*i$c+) 4&;577$*o 0IC adap$ers' ,+e ell .o*erEdge 1=77 ac+ineincluded an in$egra$ed 17917791777 E$+erne$ adap$er $+a$ *ille used $o connec$ $o $+e pulic ne$*or/' ,+e second 0ICadap$er *ill e used #or $+e priva$e ne$*or/ (Open#ilerne$*or/ed s$orage)' &elec$ $+e appropria$e 0IC adap$er $+a$ iscopa$ile *i$+ $+e axiu da$a $ransission speed o# $+ene$*or/ s*i$c+ $o e used #or $+e priva$e ne$*or/' 8or $+e


23/71







&*i$c+) 4&;577purpose o# $+is ar$icle% I used a 3igai$ E$+erne$ s*i$c+ (and13 E$+erne$ card) #or $+e priva$e ne$*or/'In$el(R) .RO91777 6, &erver Adap$er - (.DLA=@N76,)

)iscellaneous Components

" 3 1thernet Switch4sed #or $+e in$erconnec$ e$*een racnode1-privand

racnode2-priv*+ic+ *ill e on $+e 192.168.2.0ne$*or/'

4&;57
http://www.buy.com/prod/intel-pro-1000-mt-network-adapter-pci-x-1-x-rj-45-10-100-1000base-t/q/loc/101/10322542.htmlhttp://www.buy.com/prod/intel-pro-1000-mt-network-adapter-pci-x-1-x-rj-45-10-100-1000base-t/q/loc/101/10322542.htmlhttp://www.buy.com/prod/intel-pro-1000-mt-network-adapter-pci-x-1-x-rj-45-10-100-1000base-t/q/loc/101/10322542.html


24/71







&*i$c+) 4&;577,+is s*i$c+ *ill also e used #or ne$*or/ s$orage $ra##ic #orOpen#iler' 8or $+e purpose o# $+is ar$icle% I used a 3igai$E$+erne$ s*i$c+ (and 13 E$+erne$ cards) #or $+e priva$ene$*or/'Note6,+is ar$icle assues !ou alread! +ave a s*i$c+ orLA0 in place *+a$ *ill e used #or $+e pulic ne$*or/'-Lin/ =-por$ 17917791777 es/$op &*i$c+ - (3&-227=)
http://www.buy.com/prod/d-link-dgs-2208-8-port-10-100-1000-desktop-switch-d-link-dgs-2208/q/loc/101/202593730.htmlhttp://www.buy.com/prod/d-link-dgs-2208-8-port-10-100-1000-desktop-switch-d-link-dgs-2208/q/loc/101/202593730.htmlhttp://www.buy.com/prod/d-link-dgs-2208-8-port-10-100-1000-desktop-switch-d-link-dgs-2208/q/loc/101/202593730.html


25/71







&*i$c+) 4&;5777 3 Network CablesCa$egor! > pa$c+ cale- (Connec$ racnode1 $o pulicne$*or/)Ca$egor! > pa$c+ cale- (Connec$ racnode2 $o pulicne$*or/)Ca$egor! > pa$c+ cale- (Connec$ open#iler1 $o pulicne$*or/)

4&;174&;174&;174&;174&;174&;17
http://www.buy.com/retail/product.asp?sku=10353998http://www.buy.com/retail/product.asp?sku=10353998http://www.buy.com/retail/product.asp?sku=10353998http://www.buy.com/retail/product.asp?sku=10353998http://www.buy.com/retail/product.asp?sku=10353998http://www.buy.com/retail/product.asp?sku=10353998


26/71







&*i$c+) 4&;577Ca$egor! > pa$c+ cale- (Connec$ racnode1 $o in$erconnec$E$+erne$ s*i$c+)Ca$egor! > pa$c+ cale- (Connec$ racnode2 $o in$erconnec$E$+erne$ s*i$c+)Ca$egor! > pa$c+ cale- (Connec$ open#iler1 $o in$erconnec$E$+erne$ s*i$c+)

Optional Components
http://www.buy.com/retail/product.asp?sku=10353998http://www.buy.com/retail/product.asp?sku=10353998http://www.buy.com/retail/product.asp?sku=10353998http://www.buy.com/retail/product.asp?sku=10353998http://www.buy.com/retail/product.asp?sku=10353998http://www.buy.com/retail/product.asp?sku=10353998


27/71







&*i$c+) 4&;5778,) Switch,+is guide reuires access $o $+e console o# all ac+ines inorder $o ins$all $+e opera$ing s!s$e and per#or several o#$+e con#igura$ion $as/s' D+en anaging a ver! sall nuero# servers% i$ ig+$ a/e sense $o connec$ eac+ server *i$+ i$so*n oni$or% /e!oard% and ouse in order $o access i$sconsole' Ho*ever% as $+e nuer o# servers $o anage

4&;57


28/71







&*i$c+) 4&;577increases% $+is solu$ion ecoes un#easile' A ore prac$icalsolu$ion *ould e $o con#igure a dedica$ed device *+ic+*ould include a single oni$or% /e!oard% and ouse $+a$*ould +ave direc$ access $o $+e console o# eac+ server' ,+issolu$ion is ade possile using a Ge!oard% ideo% 6ouse&*i$c+ e$$er /no*n as a G6 &*i$c+' A G6 s*i$c+ is a+ard*are device $+a$ allo*s a user $o con$rol ul$iple


29/71







&*i$c+) 4&;577copu$ers #ro a single /e!oard% video oni$or and ouse'Avocen$ provides a +ig+ uali$! and econoical @-por$ s*i$c+*+ic+ includes #our >: cales'Au$oie*(R) Analog G6 &*i$c+8or a de$ailed explana$ion and guide on $+e use and G6s*i$c+es% please see $+e ar$icle G6 &*i$c+es 8or $+e Hoeand $+e En$erprise'
http://www.avocent.com/Products/Category/KVM_Appliances/Analog_Appliances/AutoView_Analog_KVM_Appliance.aspxhttp://www.avocent.com/Products/Category/KVM_Appliances/Analog_Appliances/AutoView_Analog_KVM_Appliance.aspxhttp://www.idevelopment.info/data/Unix/General_UNIX/GENERAL_KVMSwitchesForTheHomeAndTheEnterprise.shtmlhttp://www.idevelopment.info/data/Unix/General_UNIX/GENERAL_KVMSwitchesForTheHomeAndTheEnterprise.shtmlhttp://www.avocent.com/Products/Category/KVM_Appliances/Analog_Appliances/AutoView_Analog_KVM_Appliance.aspxhttp://www.idevelopment.info/data/Unix/General_UNIX/GENERAL_KVMSwitchesForTheHomeAndTheEnterprise.shtmlhttp://www.idevelopment.info/data/Unix/General_UNIX/GENERAL_KVMSwitchesForTheHomeAndTheEnterprise.shtml


30/71







&*i$c+) 4&;577Total 4&;2%5>5

De are aou$ $o s$ar$ $+e ins$alla$ion process' 0o* $+a$ *e +ave $al/ed aou$ $+e +ard*are $+a$*ill e used in $+is exaple% le$:s $a/e a concep$ual loo/ a$ *+a$ $+e environen$ *ould loo/ li/ea#$er connec$ing all o# $+e +ard*are coponen$s ('li'k on t+e gra$+i' #elow to view largeri&age)'


31/71

+iure " Oracle RAC 11g Release 2 ,es$ Con#igura$ion

As *e s$ar$ $o go in$o $+e de$ails o# $+e ins$alla$ion% no$e $+a$ os$ o# $+e $as/s *i$+in $+isdocuen$ *ill need $o e per#ored on o$+ Oracle RAC nodes (racnode1and racnode2)' I

*ill indica$e a$ $+e eginning o# eac+ sec$ion *+e$+er or no$ $+e $as/(s) s+ould e per#ored ono$+ Oracle RAC nodes or on $+e ne$*or/ s$orage server (open?iler1)'

Install the 4inu3 Operatin System

.er#or $+e #ollo*ing ins$alla$ion on o$+ Oracle RAC nodes in $+e clus$er'

,+is sec$ion provides a suar! o# $+e screens used $o ins$all $+e Linux opera$ing s!s$e' ,+isguide is designed $o *or/ *i$+ Cen$O&release 5'5 #or x=>?>@ or Red Ha$ En$erprise Linux5'5#or x=>?>@ and #ollo*s Oracle:s sugges$ion o# per#oring a de#aul$ R.6s ins$alla$ion $!pe $oensure all expec$ed Linux O9& pac/ages are presen$ #or a success#ul Oracle RB6& ins$alla$ion'
http://www.centos.org/http://www.redhat.com/http://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/resources/Install11gR2RACOnRHEL55/f1_rac_11g_r2_linux_iSCSI_large.jpghttp://www.idevelopment.info/data/Oracle/DBA_tips/Oracle11gRAC/resources/Install11gR2RACOnRHEL55/f1_rac_11g_r2_linux_iSCSI_large.jpghttp://www.centos.org/http://www.redhat.com/


32/71

Al$+oug+ I +ave used Red Ha$ 8edora in $+e pas$% I *an$ed $o s*i$c+ $o a Linux environen$ $+a$*ould guaran$ee all o# $+e #unc$ionali$! con$ained *i$+ Oracle' ,+is is *+ere Cen$O& coes in',+e Cen$O& pro-in-1o#F'iso (>2 6B)

Cen$O&-5'5-i=>-in-2o#F'iso (>21 6B)

Cen$O&-5'5-i=>-in-o#F'iso (>7 6B)

Cen$O&-5'5-i=>-in-@o#F'iso (>1N 6B)

Cen$O&-5'5-i=>-in-5o#F'iso (>2N 6B)

Cen$O&-5'5-i=>-in->o#F'iso (>F 6B)

Cen$O&-5'5-i=>-in-Fo#F'iso (21 6B)

Note I# $+e Linux RAC nodes +ave a ins$alled% !ou a! #ind i$ ore convenien$ $o a/euse o# $+e single iage (reuires Bi$,orren$)'

Cen$O&-5'5-i=>-in-'$orren$ ('N 3B)

7:*bit %357;7:' Installations

Cen$O&-5'5-x=>?>@-in-1o#='iso (>2 6B)

Cen$O&-5'5-x=>?>@-in-2o#='iso (5=F 6B)

Cen$O&-5'5-x=>?>@-in-o#='iso (>@ 6B)

Cen$O&-5'5-x=>?>@-in-@o#='iso (> 6B)

Cen$O&-5'5-x=>?>@-in-5o#='iso (>@ 6B)

Cen$O&-5'5-x=>?>@-in->o#='iso (>2F 6B)
http://vault.centos.org/5.5/isos/i386/CentOS-5.5-i386-bin-1of7.isohttp://vault.centos.org/5.5/isos/i386/CentOS-5.5-i386-bin-2of7.isohttp://vault.centos.org/5.5/isos/i386/CentOS-5.5-i386-bin-3of7.isohttp://vault.centos.org/5.5/isos/i386/CentOS-5.5-i386-bin-4of7.isohttp://vault.centos.org/5.5/isos/i386/CentOS-5.5-i386-bin-5of7.isohttp://vault.centos.org/5.5/isos/i386/CentOS-5.5-i386-bin-6of7.isohttp://vault.centos.org/5.5/isos/i386/CentOS-5.5-i386-bin-7of7.isohttp://www.bittorrent.com/http://vault.centos.org/5.5/isos/i386/CentOS-5.5-i386-bin-DVD.torrenthttp://vault.centos.org/5.5/isos/x86_64/CentOS-5.5-x86_64-bin-1of8.isohttp://vault.centos.org/5.5/isos/x86_64/CentOS-5.5-x86_64-bin-2of8.isohttp://vault.centos.org/5.5/isos/x86_64/CentOS-5.5-x86_64-bin-3of8.isohttp://vault.centos.org/5.5/isos/x86_64/CentOS-5.5-x86_64-bin-4of8.isohttp://vault.centos.org/5.5/isos/x86_64/CentOS-5.5-x86_64-bin-5of8.isohttp://vault.centos.org/5.5/isos/x86_64/CentOS-5.5-x86_64-bin-6of8.isohttp://vault.centos.org/5.5/isos/i386/CentOS-5.5-i386-bin-1of7.isohttp://vault.centos.org/5.5/isos/i386/CentOS-5.5-i386-bin-2of7.isohttp://vault.centos.org/5.5/isos/i386/CentOS-5.5-i386-bin-3of7.isohttp://vault.centos.org/5.5/isos/i386/CentOS-5.5-i386-bin-4of7.isohttp://vault.centos.org/5.5/isos/i386/CentOS-5.5-i386-bin-5of7.isohttp://vault.centos.org/5.5/isos/i386/CentOS-5.5-i386-bin-6of7.isohttp://vault.centos.org/5.5/isos/i386/CentOS-5.5-i386-bin-7of7.isohttp://www.bittorrent.com/http://vault.centos.org/5.5/isos/i386/CentOS-5.5-i386-bin-DVD.torrenthttp://vault.centos.org/5.5/isos/x86_64/CentOS-5.5-x86_64-bin-1of8.isohttp://vault.centos.org/5.5/isos/x86_64/CentOS-5.5-x86_64-bin-2of8.isohttp://vault.centos.org/5.5/isos/x86_64/CentOS-5.5-x86_64-bin-3of8.isohttp://vault.centos.org/5.5/isos/x86_64/CentOS-5.5-x86_64-bin-4of8.isohttp://vault.centos.org/5.5/isos/x86_64/CentOS-5.5-x86_64-bin-5of8.isohttp://vault.centos.org/5.5/isos/x86_64/CentOS-5.5-x86_64-bin-6of8.iso


33/71

Cen$O&-5'5-x=>?>@-in-Fo#='iso (>2@ 6B)

Cen$O&-5'5-x=>?>@-in-=o#='iso (2@2 6B)

Note I# $+e Linux RAC nodes +ave a ins$alled% !ou a! #ind i$ ore convenien$ $o a/euse o# $+e $*o iages (reuires Bi$,orren$)'

Cen$O&-5'5-x=>?>@-in-'$orren$ (@'F 3B)

Burn Binary Imae to CD/D,D

I# !ou are do*nloading $+e aove I&O #iles $o a 6& Dindo*s ac+ine% $+ere are an! op$ions#or urning $+ese iages (I&O #iles) $o a C' ou a! alread! e #ailiar *i$+ and +ave $+eproper so#$*are $o urn iages $o C' I# !ou are no$ #ailiar *i$+ $+is process and do no$ +ave$+e reuired so#$*are $o urn iages $o C% +ere are


34/71

A$ $+e *elcoe screen% clic/ Q0ex$ $o con$inue'

4anuae / 8eyboard Selection

,+e nex$ $*o screens prop$ !ou #or $+e Language and Ge!oard se$$ings' 6a/e $+e appropria$e

selec$ion #or !our con#igura$ion and clic/ Q0ex$ $o con$inue'

Detect (revious Installation

I# $+e ins$aller de$ec$s a previous version o# RHEL 9 Cen$O&% i$ *ill as/ i# !ou *ould li/e $oIns$all Cen$O& or 4pgrade an exis$ing Ins$alla$ion' Al*a!s selec$ $o Install CentOS'

Disk (artitionin Setup

&elec$ Reove all par$i$ions on selec$ed drives and crea$e de#aul$ la!ou$ and c+ec/ $+e op$ion$o Revie* and odi#! par$i$ioning la!ou$' Clic/ Q0ex$ $o con$inue'

ou *ill $+en e prop$ed *i$+ a dialog *indo* as/ing i# !ou reall! *an$ $o reove all Linuxpar$i$ions' Clic/ Qes $o ac/no*ledge $+is *arning'

(artitionin

,+e ins$aller *ill $+en allo* !ou $o vie* (and odi#! i# needed) $+e dis/ par$i$ions i$au$oa$icall! selec$ed' 8or os$ au$oa$ic la!ou$s% $+e ins$aller *ill c+oose 1776B #or />oot%

doule $+e aoun$ o# RA6 (s!s$es *i$+ ST 2%7@=6B RA6) or an aoun$ eual $o RA6(s!s$es *i$+ U 2%7@=6B RA6) #or s*ap% and $+e res$ going $o $+e roo$ (/) par$i$ion' &$ar$ing

*i$+ RHEL @% $+e ins$aller *ill crea$e $+e sae dis/ con#igura$ion as


35/71

I# #or an! reason% $+e au$oa$ic la!ou$ does no$ con#igure an adeua$e aoun$ o# s*ap space%!ou can easil! c+ange $+a$ #ro $+is screen' ,o increase $+e sie o# $+e s*ap par$i$ion% QEdi$ $+evolue group ol3roup77' ,+is *ill ring up $+e Edi$ L6 olue 3roup ol3roup77dialog' 8irs$% QEdi$ and decrease $+e sie o# $+e roo$ #ile s!s$e (/) ! $+e aoun$ !ou *an$ $o

add $o $+e s*ap par$i$ion' 8or exaple% $o add ano$+er 5126B $o s*ap% !ou *ould decrease $+e

sie o# $+e roo$ #ile s!s$e ! 5126B (i'e' >%726B - 5126B T 5%5276B)' 0o* add $+espace !ou decreased #ro $+e roo$ #ile s!s$e (5126B) $o $+e s*ap par$i$ion' D+en cople$ed%clic/ QOG on $+e Edi$ L6 olue 3roup ol3roup77 dialog'

Once !ou are sa$is#ied *i$+ $+e dis/ la!ou$% clic/ Q0ex$ $o con$inue'

Boot 4oader Confiuration

,+e ins$aller *ill use $+e 3R4B oo$ loader ! de#aul$' ,o use $+e 3R4B oo$ loader% accep$all de#aul$ values and clic/ Q0ex$ $o con$inue'

Network Confiuration

I ade sure $o ins$all o$+ 0IC in$er#aces (cards) in eac+ o# $+e Linux ac+ines e#ore s$ar$ing$+e opera$ing s!s$e ins$alla$ion' ,+e ins$aller s+ould +ave success#ull! de$ec$ed eac+ o# $+ene$*or/ devices' &ince $+is guide *ill use $+e $radi$ional e$+od o# assigning s$a$ic I. addresses#or eac+ o# $+e Oracle RAC nodes% $+ere *ill e several c+anges $+a$ need $o e ade $o $+ene$*or/ con#igura$ion' ,+e se$$ings !ou a/e +ere *ill% o# course% depend on !our ne$*or/con#igura$ion' ,+e os$ ipor$an$ odi#ica$ion $+a$ *ill e reuired #or $+is guide is $o no$con#igure $+e Oracle RAC nodes *i$+ HC. since *e *ill e assigning s$a$ic I. addresses'Addi$ionall!% !ou *ill need $o con#igure $+e server *i$+ a real +os$ nae'

8irs$% a/e sure $+a$ eac+ o# $+e ne$*or/ devices are c+ec/ed $o Ac$ive on oo$' ,+e ins$allera! c+oose $o no$ ac$iva$e eth1! de#aul$'

&econd% QEdi$ o$+ eth0and eth1as #ollo*s' ou a! c+oose $o use di##eren$ I. addresses #or

o$+ eth0and eth1$+a$ I +ave docuen$ed in $+is guide and $+a$ is OG' 6a/e cer$ain $o pu$

eth1($+e in$erconnec$) on a di##eren$ sune$ $+an eth0($+e pulic ne$*or/)'

Oracle RAC 0ode 0e$*or/ Con#igura$ion

(racnode1)

eth2

Enale I.v@ suppor$ O0!naic I. con#igura$ion (HC.) - (selec$ 6anual con#igura$ion) O88

I.v@ Address 1N2'1>='1'151

.re#ix (0e$as/) 255'255'255'7

Enale I.v> suppor$ O88

eth"

Enale I.v@ suppor$ O0


36/71

Oracle RAC 0ode 0e$*or/ Con#igura$ion

(racnode1)

eth2

Enale I.v@ suppor$ O0

!naic I. con#igura$ion (HC.) - (selec$ 6anual con#igura$ion) O88I.v@ Address 1N2'1>='2'151

.re#ix (0e$as/) 255'255'255'7

Enale I.v> suppor$ O88

Con$inue ! anuall! se$$ing !our +os$nae' I used racnode1#or $+e #irs$ node and racnode2

building an inexpensive oracle rac 11g r2 on linux - (rhel 5).doc

Documents