release 11i and rac

© 2005 Solution Beacon, LLC. All Rights Reserved.

Release 11Release 11ii Workshops Workshops

Release 11Release 11ii … Please Add RAC… Please Add RAC

Session LeaderKevin Dahl, Solution Beacon

Release 11i WorkshopsSan Ramon, CA • Worthington, MA •

Los Angeles, CA • St. Louis, MO • Orlando, FLwww.solutionbeacon.com

TRAIL to TEXAS sm

2© 2005 Solution Beacon, LLC. All Rights Reserved.

Introduction

The ChallengeThe Challenge– Customer wanted to run Release Customer wanted to run Release

1111ii and could only afford to be and could only afford to be down 5 minutesdown 5 minutes

The 50,000 Foot Solution The 50,000 Foot Solution – Implement SUN Cluster 3.0 on 2 Implement SUN Cluster 3.0 on 2

nodesnodes– Implement 11Implement 11ii with 9i RAC with 9i RAC– Utilize 2 apps serversUtilize 2 apps servers


Introduction

Install 11i Install 9i Upgrade 8i to 9i

Configure RAC

Install SUN

Cluster 3.0

OVERVIEW


Choosing the Oracle Software 1111ii and RAC and RAC

– Customer decided Release 11Customer decided Release 11ii would would best meet their software needsbest meet their software needs

– Explained that Oracle9Explained that Oracle9ii Real Real Application Clusters (RAC) was an Application Clusters (RAC) was an architecture that allowed multiple architecture that allowed multiple instances to access a shared instances to access a shared database of datafilesdatabase of datafiles

– Customer was shown that Oracle9Customer was shown that Oracle9ii RAC would meet their 5 minutes RAC would meet their 5 minutes down time requirementdown time requirement


Choosing the Hardware

What was chosen?What was chosen?– SUN V880s. 2 clustered nodes for SUN V880s. 2 clustered nodes for

backend, and 2 non-clustered nodes for backend, and 2 non-clustered nodes for middle tiermiddle tier

– A T3 storage array is in the same storage A T3 storage array is in the same storage enclosure as the SunFire V880. That enclosure as the SunFire V880. That means there are two T3 storage arrays means there are two T3 storage arrays connected via an optical hub. The arrays connected via an optical hub. The arrays provide both storage that is local to a provide both storage that is local to a given database server and storage that given database server and storage that is shared between the two database is shared between the two database servers servers


Implementation – Hardware

Router

app1application server

Oracle9i

RAID-5, RAW Database Files onT-3 Shared Disk Array

(Real Application Cluster)

sundb2

Router

WAN

Desktop Web-Client Desktop Web-Client

LAN

The type of LAN shown just below thistext will be used at all client locations:

Los Angeles Louisville El Paso Taipai Korea Germany Mexico Canada

El Paso, TXData Center

FDDI EthernetBackbone 100 Mbps

TCP/IP

sundb1

app2application server


Implementation – SUN Cluster 3.0

Install SUN Cluster 3.0 (SUN did this)Install SUN Cluster 3.0 (SUN did this)– A cluster is a collection of loosely A cluster is a collection of loosely

coupled computing nodes that provides coupled computing nodes that provides a single client view of network services a single client view of network services or applications, including databases, or applications, including databases, web services, and file servicesweb services, and file services

– Each cluster node is a standalone Each cluster node is a standalone server that runs its own processes. server that runs its own processes. These processes can communicate These processes can communicate with one another to form a virtual with one another to form a virtual single systemsingle system


11i RACLeaving the Overview – The Detail


Implementation – Release 11i

Install Release 11Install Release 11ii via Rapidwiz via Rapidwiz– 2-tier2-tier– post install stepspost install steps– backed up databasebacked up database

10 © 2005 Solution Beacon, LLC. All Rights Reserved.

Get 11i Ready for 9i

Applied Interoperability PatchApplied Interoperability Patch– This patch is necessary for This patch is necessary for

Oracle9Oracle9ii to be used in place of to be used in place of Oracle8Oracle8ii when using Release 11 when using Release 11ii

– The patch number is 1833692The patch number is 1833692


Install Oracle9i (9.0.1)

runInstallerrunInstaller– chose enterprise installation typechose enterprise installation type– did NOT install a databasedid NOT install a database

Modify init.ora and iflecbo.oraModify init.ora and iflecbo.ora– copied init and ifilecbo and copied init and ifilecbo and

modified as follows:modified as follows: remove obsolete parmsremove obsolete parms set aq_tm_processes = 0set aq_tm_processes = 0 set job_queue_processes = 0set job_queue_processes = 0


Install Oracle9i (9.0.1)... Modify init.ora and iflecbo.ora... Modify init.ora and iflecbo.ora...

Set the parameter _SYSTEM_TRIG_ENABLED to Set the parameter _SYSTEM_TRIG_ENABLED to FALSE FALSE

change ifile entry in the init.ora to point to new change ifile entry in the init.ora to point to new locationlocation

db_block_buffers= (at least 2000) db_block_buffers= (at least 2000) shared_pool_size= (at least 150MB) shared_pool_size= (at least 150MB) java_pool_size= (at least 20MB) java_pool_size= (at least 20MB) cluster_database=falsecluster_database=false event="10619 trace name context forever, level 1"event="10619 trace name context forever, level 1" event=”10932 trace name context level 32768“event=”10932 trace name context level 32768“ event=”10933 trace name context level 512“event=”10933 trace name context level 512“ event=”10943 trace name context level 16384“event=”10943 trace name context level 16384“


Upgrade Oracle9i

9.0.1 db to 9.0.1.3 (1/03 upgraded to 9.0.1 db to 9.0.1.3 (1/03 upgraded to 9.0.1.4)9.0.1.4) note these are the Oracle9note these are the Oracle9ii binaries binaries

just installed -- not the Release11just installed -- not the Release11ii db db installed (it’s Oracle8installed (it’s Oracle8ii))

done via patch 2271678done via patch 2271678 DO NOTDO NOT PERFORM any sql scripts, PERFORM any sql scripts,

database update steps or POST database update steps or POST INSTALL STEPS NOW -- DO THOSE INSTALL STEPS NOW -- DO THOSE AFTER THE 8.1.7.3 DATABASE IS AFTER THE 8.1.7.3 DATABASE IS UPGRADEDUPGRADED


Upgrade Apps 8i to 9i

8.1.7.3 db to 9.0.1.3 8.1.7.3 db to 9.0.1.3 include 9.0.1.3 home in ORACLE_HOME, include 9.0.1.3 home in ORACLE_HOME,

PATH, LD_LIBRARY_PATH PATH, LD_LIBRARY_PATH start db restrict using modified init.orastart db restrict using modified init.ora run upgrade script u0801070.sql (runs run upgrade script u0801070.sql (runs

several hours)several hours) run $ORACLE_HOME/rdbms/admin/utlip.sql run $ORACLE_HOME/rdbms/admin/utlip.sql

because db was moving from 32 to 64 bitbecause db was moving from 32 to 64 bit shutdown Oracle9shutdown Oracle9ii db db



8.1.7.3 db to 9.0.1.3... 8.1.7.3 db to 9.0.1.3... Re-adjusted init.ora fileRe-adjusted init.ora file

Changed _system_trig_enabled = TUREChanged _system_trig_enabled = TURE O7_DICTIONARY_ACCESSIBILITY=TRUEO7_DICTIONARY_ACCESSIBILITY=TRUE Optimizer_features_enable = 9.0.1Optimizer_features_enable = 9.0.1 restarted dbrestarted db

ran relevant scripts per Oracle9ran relevant scripts per Oracle9ii migration manualmigration manual Jserver, XDK for java, Session Jserver, XDK for java, Session

Namespace, CORBA and OSE, jsp, Namespace, CORBA and OSE, jsp, oracle spatial, intermedia, oracle textoracle spatial, intermedia, oracle text

ran post install steps per patch 2271678ran post install steps per patch 2271678



8.1.7.3 db to 9.0.1.3... 8.1.7.3 db to 9.0.1.3... Copy/Modify the listener.ora Copy/Modify the listener.ora

and tnsnames.ora to reflect and tnsnames.ora to reflect Oracle9Oracle9ii locations locations

reset the following in init.orareset the following in init.ora•set aq_tm_processes set aq_tm_processes parameter = 1parameter = 1

•set job_queue_processes = 2set job_queue_processes = 2


More 11i Adjustments for 9i Remove from applora.txtRemove from applora.txt

_complex_view_merging_complex_view_merging_optimizer_mode_force_optimizer_mode_force_optimizer_undo_changes_optimizer_undo_changes_or_expand_nvl_predicate_or_expand_nvl_predicate_ordered_nested_loop_ordered_nested_loop_push_join_predicate_push_join_predicate_push_join_union_view_push_join_union_view_sort_elimination_cost_ratio_sort_elimination_cost_ratio_use_column_stats_for_function_use_column_stats_for_functionalways_anti_joinalways_anti_joinalways_semi_joinalways_semi_joinoptimizer_percent_paralleloptimizer_percent_parallel


More 11i Adjustments for 9i ... Perform object maintenancePerform object maintenance

– Compile all apps objectsCompile all apps objects– Recreate grants and synonyms Recreate grants and synonyms

(adadmin)(adadmin) Increase MAXINSTANCES parameterIncrease MAXINSTANCES parameter

– to change this parameter, the database to change this parameter, the database control file needs to be recreated, control file needs to be recreated, MAXINSTANCES parameter modified MAXINSTANCES parameter modified and the create control file sql executedand the create control file sql executed

shutdown/backup DBshutdown/backup DB


Add RAC Raw files are required Raw files are required

– shutdown dbshutdown db– cooked files must become rawcooked files must become raw– shared disk volumes must be configured shared disk volumes must be configured

for for database files database files redologsredologs control filescontrol files

existing cooked files copied to raw existing cooked files copied to raw locationslocations

the above was done with a combination the above was done with a combination veritas and dd commandsveritas and dd commands


Add RAC...

Modify init.ora…node 1Modify init.ora…node 1– modified init.ora for RACmodified init.ora for RAC

•maxinstances=2 (customer had 2 maxinstances=2 (customer had 2 nodes)nodes)

•cluster_database=truecluster_database=true•instance_name=mcprod1instance_name=mcprod1•instance_number=1instance_number=1•thread=1thread=1•local_listener = local_listener =

"(address=(port=1522)"(address=(port=1522)(protocol=tcp)(host=sundb1))"(protocol=tcp)(host=sundb1))"


Add RAC...

Change db file locations…node 1Change db file locations…node 1– create a sql script that will alter create a sql script that will alter

the location of the database files the location of the database files to reflect the new raw locationsto reflect the new raw locations

– startup the database mountstartup the database mount– run the alter sql created aboverun the alter sql created above


Add RAC...

Modify init.ora…node 2Modify init.ora…node 2– ensure instance is shutdownensure instance is shutdown– modified init.ora for RACmodified init.ora for RAC

•maxinstances=2 (customer had 2 maxinstances=2 (customer had 2 nodes)nodes)

•cluster_database=truecluster_database=true• instance_name=mcprod2instance_name=mcprod2• instance_number=2instance_number=2•thread=2thread=2• local_listener = local_listener =

"(address=(port=1522)"(address=(port=1522)(protocol=tcp)(host=sundb2))"(protocol=tcp)(host=sundb2))"


Add RAC...

Configure listener.ora on node 1Configure listener.ora on node 1mcprod1 =mcprod1 =

(DESCRIPTION =(DESCRIPTION =

(LOAD_BALANCE = OFF)(LOAD_BALANCE = OFF)

(ADDRESS = (PROTOCOL = TCP)(HOST = sundb1)(ADDRESS = (PROTOCOL = TCP)(HOST = sundb1)(PORT = 1522))(PORT = 1522))

))

SID_LIST_mcprod1 =SID_LIST_mcprod1 =

(SID_LIST =(SID_LIST =

(SID_DESC =(SID_DESC =

(ORACLE_HOME = /u20/oracle/mc11idb)(ORACLE_HOME = /u20/oracle/mc11idb)

(SID_NAME = mcprod1)))(SID_NAME = mcprod1)))


Add RAC...

Configure listener.ora on node 2Configure listener.ora on node 2mcprod2 =mcprod2 = (DESCRIPTION =(DESCRIPTION = (LOAD_BALANCE = OFF)(LOAD_BALANCE = OFF) (ADDRESS = (PROTOCOL = TCP)(HOST = (ADDRESS = (PROTOCOL = TCP)(HOST =

sundb2)(PORT = 1522))sundb2)(PORT = 1522)) ))SID_LIST_mcprod2 =SID_LIST_mcprod2 = (SID_LIST =(SID_LIST = (SID_DESC =(SID_DESC = (ORACLE_HOME = /u20/oracle/mc11idb)(ORACLE_HOME = /u20/oracle/mc11idb) (SID_NAME = mcprod2)))(SID_NAME = mcprod2)))


Add RAC... tnsnames.oratnsnames.ora

mcprod2=mcprod2=(description=(description= (address=(protocol=tcp)(host=sundb2)(address=(protocol=tcp)(host=sundb2)

(port=1522))(port=1522)) (connect_data=(service_name=mcprod)))(connect_data=(service_name=mcprod)))mcprod1=mcprod1= (description=(description= (address=(protocol=tcp)(host=sundb1)(address=(protocol=tcp)(host=sundb1)

(port=1522))(port=1522)) (connect_data=(service_name=mcprod)))(connect_data=(service_name=mcprod)))


Add RAC...

Tnsnames.ora…Tnsnames.ora…mcprod=mcprod= (description=(load_balance=off)(failover=on)(description=(load_balance=off)(failover=on) (address_list= (address=(protocol=tcp)(address_list= (address=(protocol=tcp)

(host=sundb1)(port=1522))(host=sundb1)(port=1522)) (address=(protocol=tcp)(host=sundb2)(address=(protocol=tcp)(host=sundb2)

(port=1522)) )(port=1522)) ) (connect_data=(service_name=mcprod) (connect_data=(service_name=mcprod)

(failover_mode=(type=select)(failover_mode=(type=select)(method=basic)(method=basic)

(backup=mcprod2))))(backup=mcprod2))))


Add RAC...

Start Instances and APPSStart Instances and APPS– started instance 1: startup parallelstarted instance 1: startup parallel– added redo thread for instance 2added redo thread for instance 2– started instance 2: startup parallelstarted instance 2: startup parallel– started relevant apps processes on db started relevant apps processes on db

tiertier– started relevant apps processes on started relevant apps processes on

app tierapp tier


Add RAC... A virtual middle tierA virtual middle tier

– Round robin dns was implemented Round robin dns was implemented because this customer had 2 apps boxes; because this customer had 2 apps boxes; Round robin dns requires adjustments to Round robin dns requires adjustments to dns entries resulting in the ability to dns entries resulting in the ability to access either apps server with the same access either apps server with the same name; Later, this was replaced with Big IPname; Later, this was replaced with Big IP

Parallel Concurrent ProcessingParallel Concurrent Processing– Concurrent processing was parallelized Concurrent processing was parallelized

according the instructions in the system according the instructions in the system administration guide for Release 11administration guide for Release 11ii and and MetaLink note 185489.1; In addition, a MetaLink note 185489.1; In addition, a transaction manager should be setup via transaction manager should be setup via MetaLink note 240818.1MetaLink note 240818.1


Conclusion The process is complexThe process is complex

– Release 11Release 11ii increases the complexity increases the complexity of implementing RACof implementing RAC

– RAC increases the complexity of RAC increases the complexity of managing Release 11managing Release 11ii (use oem and (use oem and veritas volume mgr)veritas volume mgr)

– Attention gettersAttention getters•Parallel concurrent processingParallel concurrent processing•Middle tier load balancingMiddle tier load balancing•Management of raw filesManagement of raw files


References Sources used for this presentationSources used for this presentation

metalink note 162091 – Interoperablility metalink note 162091 – Interoperablility Notes: Oracle Applications Release 11Notes: Oracle Applications Release 11ii with with Oracle9Oracle9ii Release 9.0.1 Release 9.0.1

metalink note 183649.1 – Database upgrade metalink note 183649.1 – Database upgrade from 32 to 64 bit (This note was written for from 32 to 64 bit (This note was written for Oracle8Oracle8ii - ensure you ignore items that no - ensure you ignore items that no longer apply to Oracle9longer apply to Oracle9ii

Oracle White paper by Ahmed Alomari of Oracle White paper by Ahmed Alomari of Oracle Corporation: Migrating Your E-Oracle Corporation: Migrating Your E-Business Suite Single Instance to Real Business Suite Single Instance to Real Application Clusters (RAC)Application Clusters (RAC)

Oracle9Oracle9ii Database Migration Manual, Part Database Migration Manual, Part Number A90191-02 (Manual upgrade section)Number A90191-02 (Manual upgrade section)

several tarsseveral tars


Kevin DahlKevin [email protected] www.solutionbeacon.com

Hope you enjoyed this Release 11i session! Hope you enjoyed this Release 11i session!

Remember:Remember:

KISSKISS

Keep It Simple and Keep It Simple and SupportableSupportablesmsm

Q&A

release 11i and rac

Documents

upgrade oracle9

oracle9 ito

nodes cluster

database servers

oracle9 irac

oracle9 i9

rac maxinstances

restarted db