oracle database rac installation and configuration the disk using format command creating raw disk:...

RAC Installation and

Configuration

Oracle Database 10g

-2-

Table of Content

1. INTRODUCTION ................................................................................. 3

1.1. PURPOSE OF DOCUMENT ........................................................................... 3 1.2. INTENDED AUDIENCE ............................................................................... 3 1.3. SCOPE OF THIS GUIDE.............................................................................. 3

2. DATABASE INSTALLATION ................................................................. 4

2.1. OPERATING SYSTEM PREPARATION ............................................................... 4 2.2. INSTALLING ORACLE CLUSTERWARE .............................................................. 8 2.3. PATCHING ORACLE CLUSTERWARE .............................................................. 24 2.4. INSTALLING ORACLE ASM ...................................................................... 28 2.5. PATCHING ORACLE ASM ........................................................................ 34 2.6. CONFIGURING ORACLE LISTENER ............................................................... 39 2.7. CREATING ORACLE ASM INSTANCE ............................................................ 43 2.8. INSTALLING ORACLE DATABASE ................................................................ 49 2.9. PATCHING ORACLE DATABASE .................................................................. 55 2.10. CREATING ORACLE DATABASE INSTANCE ...................................................... 60

-3-

1. INTRODUCTION

1.1. Purpose of Document

This document provides technical information about installing Oracle Database Server 10g.

1.2. Intended Audience

This manual is intended for

IT / Support department

Technical staffs that perform installation on Oracle Database.

1.3. Scope of this guide

This document consists of 2 parts:

- The first part is to list down the preparation to install Oracle Database server 10g. - The second part is to describe the steps to create and patch Oracle Database

server 10g.

-4-

2. Database Installation

2.1. Operating System Preparation

Use Solaris version 8 or more advanced version in order to install database oracle 10g.

The installer filename usually is 10gr2_db_sol.cpio.gz assume the Operating System is Solaris SPARC 64 bit.

Copy installers and patches into /opt/installer/oracle or any directory which you select for placing the oracle 10g installers.

Copy all required files from Oracle10g DVDs to install oracle 10g into installer directory.

Make link for /bin/scp /bin/ssh to /usr/loca/bin/scp and ssh using root.

Makes sure the server is using static IP address. Also the server must have at least three IP address, in this example four, one will be used for iSCSI, for SAN emulation. Here is the example for /etc/hosts contain on both nodes node 1 ::1 localhost 127.0.0.1 localhost 10.123.1.220 demo01 loghost 172.16.3.220 demo01-iscsi 192.168.1.220 demo01-priv 10.123.1.221 demo01-vip 10.123.1.150 demo02 172.16.3.150 demo02-iscsi 192.168.1.150 demo02-priv 10.123.1.151 demo02-vip node 2 ::1 localhost 127.0.0.1 localhost 10.123.1.150 demo02 loghost 172.16.3.150 demo02-iscsi 192.168.1.150 demo02-priv 10.123.1.151 demo02-vip 10.123.1.220 demo01 172.16.3.220 demo01-iscsi 192.168.1.220 demo01-priv 10.123.1.221 demo01-vip

Login as root and then create oracle’s user by following below commands:

groupadd oinstall groupadd dba useradd -d /export/home/oracle -g oinstall -G dba -m -s /bin/bash oracle passwd -r files oracle

-5-

Enter a new password for the user oracle. In this case, type: password as the oracle’s password.

Go to the directory /export/home/oracle and then type command:

vi .profile

Add some content. The content much more like the below picture, however refer to the Production Setup and Deployment Documentation for detail. umask 022 if [ -t 0 ]; then stty intr ^C fi PS1='['`hostname`:$LOGNAME']$ ' DISPLAY=10.122.1.136:0.0 TEMP=/tmp TMPDIR=$TEMP export PS1 DISPLAY TEMP TMPDIR ORACLE_SID=APRRAC ORACLE_BASE=/opt/oracle ORACLE_HOME=$ORACLE_BASE/10g ORACLE_ADMIN=$ORACLE_BASE/admin ORA_CRS_HOME=$ORACLE_BASE/crs ORA_ASM_HOME=$ORACLE_BASE/asm TNS_ADMIN=$ORACLE_HOME/network/admin LD_LIBRARY_PATH=$ORACLE_HOME/lib PATH=$ORACLE_HOME/bin:$ORACLE_HOME/OPatch:/usr/ccs/bin:/usr/bin:/usr/sbin:/usr/openwin/bin:/usr/local/bin:$PATH export ORACLE_SID ORACLE_BASE ORACLE_HOME ORACLE_ADMIN ORA_CRS_HOME ORA_ASM_HOME TNS_ADMIN LD_LIBRARY_PATH PATH

To check the result login as oracle user by typing

su - oracle env

Set the installation directory structure and refer to the Production Setup and

Configuration Documentation for the location, it can be done by following

below commands:

mkdir /opt/oracle. This is for setting up the ORACLE_BASE.

mkdir /opt/oracle/10g. It will become ORACLE_HOME.

mkdir /opt/oracle/crs. It will become ORA_CRS_HOME.

mkdir /opt/oracle/asm. It will become ORA_ASM_HOME.

chown –R oracle:oinstall /opt/oracle. The command will make the

installation tree to be possessed by oracle user.

chmod –R 775 /opt/oracle. By applying this command, Oracle Installer

can write what it needs into the directory.

-6-

At this instant, the next step is setting up the kernel parameters by doing below operations. To create the resource project that will be used by user oracle, type projadd oracle

Navigate to directory /etc and type edit user_attr. It will be viewed as below figure first. cd /etc vi user_attr

It will be viewed as this figure below

You need to add a new line to the end of this file that reads:

Append this line oracle::::project=oracle

That means the user oracle will be assigned to the new resource project called oracle whenever he logs on.

The shared memory segments must be upgraded into the specified size of project.max-shm-memory in the Production Setup and Deployment. So, open a new terminal session and login as root user. After that, perform following command (for example the value of project.max-shm-memory is 14GB):

prctl -n project.max-shm-memory -v 14gb -r -i project oracle

Using user oracle perform this command to check the value of project.max-shm-memory:

prctl -n project.max-shm-memory -i project oracle

Also, you have to make the value of shared memory becomes permanent by performing this command as root user:

projmod -s -K "project.max-sem-ids=(priv,100,deny)" oracle projmod -s -K "process.max-sem-nsems=(priv,256,deny)" oracle projmod -s -K "project.max-shm-memory=(priv,14gb,deny)" oracle projmod -s -K "project.max-shm-ids=(priv,100,deny)" oracle projmod -s -K "process.max-file-descriptor=(priv,65536,deny)" oracle

Oracle Clusterware requires every nodes to be able to communicate through SSH, RSH without using password. There are several settings need to be done:

# Copyright (c) 2003 by Sun Microsystems, Inc. All rights reserved. # /etc/user_attr # user attributes. see user_attr(4) #pragma ident "@(#)user_attr 1.1 03/07/09 SMI" adm::::profiles=Log Management lp::::profiles=Printer Management root::::auths=solaris.*,solaris.grant;profiles=Web Console Management,All;lock_after_retries=no

You need to add a new line to the end of this file that reads:

oracle::::project=oracle

-7-

login as oracle user, and execute these commands; cd mkdir .ssh chmod 755 .ssh ssh-keygen -t rsa ssh-keygen -t dsa copy id_rsa.pub and id_dsa.pub to another node as ~/.ssh/authorized_keys file cat ~/.ssh/id_rsa.pub | ssh oracle@node2 'cat >> .ssh/authorized_keys' cat ~/.ssh/id_dsa.pub | ssh oracle@node2 'cat >> .ssh/authorized_keys' chmod 644 ~/.ssh/authorized_keys also add rsa and dsa public key of their own node cat id_rsa.pub >> authorized_keys cat id_dsa.pub >> authorized_keys exec /usr/bin/ssh-agent $SHELL /usr/bin/ssh-add test ssh login to each node using three IP that configured from node1 ssh oracle@node1 ssh oracle@node2 from node2 ssh oracle@node2 ssh oracle@node1 make sure each node are added in their own known_hosts configure rsh and rlogin create file hosts.equiv in /etc with ownership root:root and mod 600, that contain (hostname) (oracle user) demo01 oracle demo02 oracle create file .rhosts in /etc using root and insert demo01,demo02 to prevent X11 Forwarding (optional) create file ~/.ssh/config and insert this line Host * ForwardX11 no

Oracle Clusterware also requires time synchronization between nodes, usually NTP is used. If not, make one of the node (node1) as the time server by enabling the feature using this command: svcadm enable time:stream svcadm enable time:dgram

-8-

To start syncing the time in the client (node2) server login as root and type: rdate ip-server-node1

Check Oracle Solaris Package dependancies using this command: pkginfo -i SUNWarc SUNWbtool SUNWhea SUNWlibm SUNWlibms SUNWsprot SUNWtoo SUNWi1of SUNWi1cs SUNWi15cs SUNWxwfnt if there are missing package add it using command: pkgadd –d /location/required/package

If SAN is replaced by iSCSI, use this command to mount it: login as root, and type iscsiadm add discovery-address ip-address-iscsi-server iscsiadm modify discovery --sendtargets enable devfsadm -i iscsi iscsiadm list target -S

check the disk using format command

Creating RAW disk: When creating partition using format command always start from cylinder 1 instead 0 Initialize the devices, with command, repeat for each partition that will be used at each disk dd if=/dev/zero of=/dev/rdsk/c*t*d*s* bs=8192 change ownership and mod chown root:dba /dev/rdsk/c*t*d*s* chmod 660 /dev/rdsk/c*t*d*s* create a link to a specified path that easily accessible /opt/oracle/disk with ownership oracle:dba # ln -s /dev/rdsk/c2t3d0s6 ocr1 # ln -s /dev/rdsk/c2t4d0s6 ocr2 # ln -s /dev/rdsk/c2t5d0s6 vote1 # ln -s /dev/rdsk/c2t6d0s6 vote2 # ln -s /dev/rdsk/c2t7d0s6 vote3 # ln -s /dev/rdsk/c2t8d0s6 asm # ln -s /dev/rdsk/c2t9d0s6 data1 # ln -s /dev/rdsk/c2t10d0s6 data2

2.2. Installing Oracle Clusterware

Before installing Oracle Clusterware (CRS) check the prerequiste by using this command.

-9-

./cluvfy stage -pre crsinst -n demo01,demo02 –verbose

The result of this test there must be no error, warning still acceptable.

Login as oracle user and navigate to the specific directory where Oracle CRS installer placed (10gr2_cluster_sol.cpio.gz).

Execute the installer by following this command: ./runInstaller Commonly, there will be an error like this:

This might happened because IP address is not correctly configured while setting up the environment display parameter. See below figure in detail.

Therefore, edit localhost to your ip address in .profile file or using this command for temporary solution:

bash export DISPLAY=your-pc-ip-address:0.0 Then the installer will showed up

-10-

Click Next to start the installation process

Specify oraInventory location and OS group name:

-11-

Specify Name and Path for Home detail:

Do prerequisite check, make sure there are nothing to be verified:

-12-

Specify Cluster configuration, make sure the name for node1 is the same like in the /etc/hosts:

If not the same edit it, make it like /etc/hosts for node1:

-13-

Add the hostname for node2 from /etc/hosts:

After all the hostname for each nodes is confirmed, click Next:

-14-

Specify Network interface that will be used for IP that will be accessed by client:

Change the desired interface type to public for the IP that will be accessed by client :

-15-

After the Interface type is confirmed, click Next:

Specify the raw disks for Oracle Cluster Registry:

-16-

Specify the raw disks for Voting Disk:

Review the summary, then click install:

-17-

Wait until the installation process is done:

-18-

The installation process will ask to execute some scripts using root, click OK after finish executing script in each nodes:

Script execution in node1:

-19-

Script execution in node2:

In the end of the node2 script execution there is error regarding VIPCA:

-20-

To fix the issue, open new terminal with X11 forwarding on. Go to ORA_CRS_HOME: cd /opt/oracle/crs/bin ./vipca

Choose the interface that will be used as Virtual IP, click next:

-21-

Make sure the Hostname and IP address for VIP is correct, click next:

Click Finish to configure:

-22-

Wait until the configuration process is done:

-23-

It will show the configuration result, the click exit:

Click retry to recheck the configuration:

-24-

Click Exit of there are no more error, then click exit:

2.3. Patching Oracle Clusterware

The patch for CRS, ASM, and Instance using the same patching file. Login as oracle user and then navigate to patch file location (p8202632_10205_SOLARIS64.zip).

bash cd /opt/installer/oracle/patch/patch10205/disk1 ./runInstaller

-25-

The welcome screen will appear, simply click next button.

Now, the menu for specifying Home Details appear. Fill the Path with Oracle Home Location just as below figure, then click next

-26-

If you want to use Oracle Support, in this case no:

Specify the Cluster installation option, check all nodes, click next:

-27-

Make sure that all the prerequisite is passed, then click Next.

View the summary then click Install.

-28-

Wait for the installation process until done.

The installer will ask to run a script for completing the patch installation. Open new console, login as user root and then run the script. Do this in order of each node demo01, demo02

login as root ,then shutdown crs daemon and script execution :

/opt/oracle/crs/bin/crsctl stop crs /opt/oracle/crs/install/root102.sh proceed to next node

Go back to the oracle installer and then click OK button, the end of installation screen will be shown. Click Exit button for completing the patch installation phase.

2.4. Installing Oracle ASM

Login as oracle user and navigate to the specific directory where Oracle CRS installer placed (10gr2_db_sol.cpio.gz).


-29-




-30-


Select the edition that will be installed, in this case Enterprise Edition, then click next.

-31-

Specify the Name of Home for ASM then the path also, after that click next.

Choose the Cluster Installation option and don’t forget to tick all nodes, then click next.

-32-

Make sure all the prerequisite check is passed, fix it if not. Click next.

Choose to install software only, click Next.

-33-

Review the summary then click Install to start the installation process.

Wait until the installation progess is completed.

-34-

Execute the requried script in all nodes in order then click OK to finish the installation process.

2.5. Patching Oracle ASM



-35-



-36-



-37-



-38-


Execute the requried script in all nodes in order then click OK to finish the installation process.

-39-

2.6. Configuring Oracle Listener

Usually Listener run from ASM Home, so go to /opt/oracle/asm/bin to execute netca, so the installer will appear. Choose cluster configuration and click next.

Choose all nodes then click Next.

-40-

Choose Listener configuration then click Next.

Choose Add then click Next.

-41-

Enter the name for Listener name, the default is ok, Click Next to continue.

Select the protocols, in this case TCP, click Next to continue.

-42-

Specify the port number, the dafault 1521 is ok, click Next.

Choose No, then click Next to start the configuration.

Click Next then Finish to stop netca tools.

Execute this command, to see that new resource has been added (Listener)

/opt/oracle/crs/bin/crs_stat -t

-43-

2.7. Creating Oracle ASM Instance

Go to ASM home /opt/oracle/asm then go to bin directory to execute dbca. This installer will appear and choose Oracle RAC database, then click Next.

Choose Automatic Storage Management, then click Next.

-44-

Select all nodes, then click Next to install it.

Insert the password for SYS and choose the type of parameter, in this case using PFILE, then click Next.

-45-

Click OK to start creation process.

Wait untill ASM creation process finished.

-46-

Click Create New to create Disk Groups.

Insert the Disk Group Name, choose redundancy, in this case Normal, that requries two disk (High = 3, External = 1). Choose the candidate disk, then OK

-47-

Wait until the Disk Group Creation is finished.

While the previous Disk Group creation will be used for datafiles, this one will be used for redo logs.

-48-

Wait until the process is done.

Review the created Disk Group, click Finish to end the installation process.

-49-

Choose Yes to end it.

2.8. Installing Oracle Database

Execute this command to do some prerequisite checking

./cluvfy stage -pre dbinst -n demo01,demo02 -r 10gR2 -verbose

Login as oracle user and navigate to the specific directory where Oracle CRS installer placed (10gr2_db_sol.cpio.gz).


-50-




-51-


Select the edition that will be installed, in this case Enterprise Edition, then click next.

-52-

Specify the Name of Home for Oracle Database and the path, then click next.

Choose the Cluster Installation option and don’t forget to tick all nodes, then click next.

-53-

Make sure all the prerequisite check is passed, fix it if not. Click next.

Choose no to not perform upgrade, click Next.

-54-

Choose to install software only, click Next.

Review the summary then click Install to start the installation process.

-55-

Wait until the installation progess is completed.

Execute the requried script in all nodes in order (using root) then click OK to finish the installation process.

2.9. Patching Oracle Database



-56-


-57-



-58-



-59-



-60-

Execute the requried script in all nodes in order (using root) then click OK to finish the installation process.

2.10. Creating Oracle Database Instance

When creating instance if there is error such as "Encountered file error when copying listeners from" then you need to unset TNS_ADMIN env var

echo $TNS_ADMIN unset TNS_ADMIN

Go to Oracle Database home /opt/oracle/10g then go to bin directory to execute dbca. This installer will appear and choose Oracle RAC database, then click Next.

-61-

Choose Create a Databasem then click Next.

Select All Nodes then click Next.

-62-

Choose the type of database, in this case is General Purpose, click Next.

Insert the desired SID, then click Next.

-63-

Choose to configure Enterprise Manager or not, in this case yes. Click Next.

Set the same password for the instance, then click Next.

-64-

Choose the storage mechanism for the instance, in this case ASM, click Next.

Choose the disk group that will be used as database storage, click Next.

-65-

Click Next to continue.

Specify the storage for Flash Recovery Area, click Next.

-66-

Choose Sample Schemas to be added in the instance, in this case is no, click Next.

Choose Add to add DB Services, in this case nothing to be added, click Next.

-67-

Specify the SGA and PGA that the instance will use, click All Initialization Parameters to add specific parameter to init file.

Change the desired parameters, then click Close when finished.

-68-

Choose Unicode for database character set, then click Next.

Please make the desired changes to Controlfiles, Datafiles, and Redo log Groups. When finish click Next to continue.

-69-

Choose create database then click Finish to start it.

Review the summary, then click OK.

-70-


The RAC database installation is completed to verify it use this command.

/opt/oracle/crs/bin/crs_stat -t

Also to finalize create a soft link from ASM TNS_ADMIN (/opt/oracle/asm/network/admin) to the Oracle Database TNS_ADMIN (/opt/oracle/10g/network/admin). Especially listener.ora and tnsnames.ora file.

oracle database rac installation and configuration the disk using format command creating raw disk:...

Documents