asm 11gr2 installation & configuration role separation complete nov-9-2011 new

1/87

ASM 11gR2 Installation & Configuration (Role Separation). Author: Esteban Bernal

ASM 11gR2 Installation & Configuration Using Job Role Separation (grid & oracle OS users).

A) This document explains, in detail, the steps required to install the Oracle Grid Infrastructure 11gR2 (11.2.0.X.X), setup & enable the OHAS services, create an ASM instance and diskgroups through the OUI (Oracle Universal Installer). B) This configuration explains in detail how to Create the OS Groups & OS Users for the Grid Infrastructure & Oracle Database installations (using Job Role Separation). C) Finally, it explains in detail the 11gR2 (11.2.0.X.X) or 11.1 or 10.2 RDBMS Oracle Database Software Installation and database creation (using ASM as storage option). D) VERY IMPORTANT!!!!!!!!! ==)> If you need to create an 11.1.0.X.X or 10.2.0.X.X database using 11.2 ASM (as storage option), then you need to set the ASM GID to the RDBMS oracle kernel (<10.2 or 11.1 RDBMS Oracle Home>/bin/oracle) before execute the DBCA (before the database creation), please see step # 26 (below) for exact instructions. E) Note: Before start with the installation, please check the required hardware & OS requirements in the next manuals: http://www.oracle.com/pls/db112/portal.portal_db?selected=11&frame= =)> Oracle® Grid Infrastructure Installation Guide 11g Release 2 (11.2) for <your specific platform> =)>Oracle® Database Installation Guide 11g Release 2 (11.2) for <your specific platform> http://www.oracle.com/pls/db111/portal.portal_db?selected=11&frame= =)>Oracle® Database Installation Guide 11g Release 1 (11.1) for <your specific platform> http://www.oracle.com/pls/db102/homepage =)>Oracle® Database Installation Guide 11g Release 1 (10.2) for <your specific platform>

2/87


11.2.0.X.0 Grid Infrastructure Oracle Home Installation steps: 1) Connect as root user to your Linux or UNIX host (Password: e.g. oracle):

2) Open a Terminal session:

3/87


3) Select the IP address associated with your Linux or UNIX host (for this example we will use: 192.168.187.128) provided by the host from the eth0 interface:

4/87


4) Using the IP address from the eth0 interface (for this example: 192.168.187.128) connect thru a putty or ssh session as follow (Login: root / Password: e.g. oracle):

5/87


5) Verify the RAM, swap & tmp in the system, the minimum required RAM is 1.5 GB for Oracle Grid Infrastructure for a cluster, or 2.5 GB for Grid Infrastructure for a cluster and Oracle Server RAC. The minimum required swap space is 1.5 GB. Oracle recommends that you set swap space to 1.5 times the amount of RAM for systems with 2 GB of RAM or less. For systems with 2 GB to 16 GB RAM, use swap space equal to RAM. For systems with more than 16 GB RAM, use 16 GB of RAM for swap space. Ensure that you have at least 1 GB of space in /tmp. If this space is not available, then increase the size, or delete unnecessary files in /tmp.

6) Ensure you have at least 4.5 GB of space for the grid infrastructure for a (Grid home):

6/87


7) Create the grid & oracle OS users and oinstall, asmadmin, asmdba, asmoper, dba & oracle groups and create base directories (connect as root user and execute the next commands): The next commands are required for RAC & Standalone Configurations: groupadd -g 1000 oinstall groupadd -g 1100 asmadmin groupadd -g 1200 dba groupadd -g 1201 oper groupadd -g 1300 asmdba groupadd -g 1301 asmoper grep oinstall /etc/group grep asmadmin /etc/group grep dba /etc/group grep oper /etc/group grep asmdba /etc/group grep asmoper /etc/group useradd -u 1100 -g oinstall -G asmadmin,asmdba,asmoper -d /home/grid -s /bin/bash -c "Oracle GI Software Owner" grid useradd -u 1101 -g oinstall -G dba,asmdba,oper -d /home/oracle -s /bin/bash -c "Oracle RDBMS Software Owner" oracle

7/87


The next section is only applicable to Standalone Configurations: ***Very important Note***: On 11.2 Grid Infrastructure Standalone (non-RAC) Configurations, the grid OS user needs to be included in the OSDBA (dba) OS group. This is because the grid infrastructure components must be able to connect to the database as SYSDBA to start and stop the database. For example, if the host user who installed the grid infrastructure home is named grid and the OSDBA group of the new database is named dba, then user grid must be a member of the dba group. This is clearly documented in the next manual: http://download.oracle.com/docs/cd/E11882_01/server.112/e17120/restart002.htm#BABCAFII =)> Oracle® Database Administrator's Guide 11g Release 2 (11.2) Part Number E17120-06 ==)> Configuring Oracle Restart ===)> Adding Components to the Oracle Restart Configuration Therefore, ONLY on 11.2 Grid Infrastructure Standalone Configurations (non-RAC), you need to execute (as root OS user) the next additional command to include the grid user in the dba (OSDBA) OS group: usermod -a -G dba grid If you omit the previous step, then DBCA will fail with the next error during the database creation: srvctl start db -d ASMDB PRCR-1079 : Failed to start resource ora.ASMDB.db ORA-01031: insufficient privileges ORA-01031: insufficient privileges CRS-2674: Start of 'ora.ASMDB.db' on 'siha1' failed

8/87


The next commands are required for RAC & Standalone Configurations:

Connect as root user and execute the next commands: id oracle id grid mkdir -p /u01/app/11.2.0/grid chown -R grid:oinstall /u01 mkdir -p /u01/app/oracle chown oracle:oinstall /u01/app/oracle chmod -R 775 /u01

9/87


8) Install the ASMLIB RPMs (Linux only): http://www.oracle.com/technetwork/topics/linux/index-101839.html 8.1) For this example we are using the next kernel release: [root@asmteam /]# uname -r 2.6.18-164.el5PAE 8.2) So the next 3 RPMs need to be downloaded: http://www.oracle.com/technetwork/server-storage/linux/downloads/rhel5-084877.html =)> Intel IA32 (x86) Architecture ==)> Library and Tools a) oracleasm-support-2.1.3-1.el5.i386.rpm b) oracleasmlib-2.0.4-1.el5.i386.rpm ==)> Drivers for kernel 2.6.18-164.el5 c) oracleasm-2.6.18-164.el5PAE-2.0.5-1.el5.i686.rpm 8.3) They can be installed as described in the next document: http://www.oracle.com/technetwork/server-storage/linux/install-082632.html 8.4) Validate oracleasm RPMs were installed: [root@asmteam asmlibRPMs]# rpm -qa | grep oracleasm-support-2.1.3-1.el5 oracleasm-support-2.1.3-1.el5 [root@asmteam asmlibRPMs]# rpm -qa | grep oracleasmlib-2.0.4-1.el5 oracleasmlib-2.0.4-1.el5 [root@asmteam asmlibRPMs]# rpm -qa | grep oracleasm-2.6.18-164.el5PAE-2.0.5-1.el5 oracleasm-2.6.18-164.el5PAE-2.0.5-1.el5

10/87


9) List the disks available for ASM/ASMLIB, for this example we will use 3 SCSI disks of 10 GB each:

10) Check if the partitions exist: # ls -l /dev/sdb1 /dev/sdc1 /dev/sdd1

11/87


11) If the partitions do not exists, then create one partition per disk:

12/87


13/87


14/87


12) Setup the Oracle ASMLIB API (Linux only): Note: Having we are doing an ASM Role Separation, the candidate ASMLIB disks or raw devices or block devices or LUNs or NAS devices, etc, which will be used for ASM disks, need to be owned by the Grid Infrastructure OS user (grid) and by the OSASM group (asmadmin). This applies for both Linux & Unix. “Non-role separation” configurations will use oracle:dba as the user:group for all the candidate/member disks. But using ASM Role Separation, the ownership for the ASM disks will be grid:asmadmin. Note that the Grid Infrastructure software owner must be same owner for all the ASM disks as well. The suggested name for the OS user is grid and the suggested name for the OS group is asmadmin (as follow):

15/87


13) Create the ASMLIB disks on the 3 SCSI disk partitions:

16/87


14) Download the “Oracle Database 11g Release 2 Grid Infrastructure (11.2.0.1.0) for Linux x86” from http://www.oracle.com/technology/software/products/database/index.html =)> linux_11gR2_grid.zip (980,831,749 bytes) (cksum - 3583041487) 15) Download the “Oracle Database 11g Release 2 (11.2.0.1.0) for Linux x86” from http://www.oracle.com/technology/software/products/database/index.html =)> linux_11gR2_database_1of2.zip (1,285,396,902 bytes) (cksum - 2237015228) =)> linux_11gR2_database_2of2.zip (995,359,177 bytes) (cksum - 2649514514) Note 1: For Grid Infrastructure & RDBMS software 11.2.0.2 release, you can download them using the next reference: =)> 11.2.0.2 Patchset Location For Grid Infrastructure And RDBMS. (Doc ID 1223673.1) Note 2: For Grid Infrastructure & RDBMS software 11.2.0.3 release, you can download them using the next reference: =)> 11.2.0.3 Patchset Location For Grid Infrastructure And RDBMS. (Doc ID 1362393.1)

17/87


16) FTP the “linux_11gR2_grid.zip, linux_11gR2_database_1of2.zip & linux_11gR2_database_2of2.zip ” to your Linux box: 16.1) Create a stage directory, for this example I am creating it at /u01 filesystem: # mkdir /u01/stage 16.2) Then upload the three *.zip files to your Linux box and place the files at your staging directory:

16.3) Uncompress the three zip files:

[root@asmteam /]# unzip linux_11gR2_grid.zip; unzip linux_11gR2_database_1of2.zip; unzip linux_11gR2_database_2of2.zip

18/87


16.4) You will see 2 new directories (grid & database) on the /u01/stage directory:

17) Switch to the grid OS user, setup & set the environment variables in the initialization file (for this example we are using bash shell (.bash_profile)): export ORACLE_BASE=/u01/app/grid # Grid Oracle Base export ORACLE_HOME=/u01/app/grid/product/11.2.0/grid # Grid Oracle Home export PATH=$ORACLE_HOME/bin:$PATH:. export ORACLE_SID=+ASM stty erase ^H umask 022

19/87


20/87


18) Install the Oracle Grid Infrastructure 11gR2 from a graphical session as “grid” OS user (for this example we will use VNCserver as graphical interface): 18.1) Start a vncserver as grid user & set the Password = “e.g. oracle”:

21/87


18.2) Connect to the vncserver using the IP address associated with the host:

22/87


18.3) Execute the OUI (Oracle Universal Installer) as “grid” OS user: $ /u01/stage/grid/runInstaller

18.4) Select: Install and Configure Grid Infrastructure for a Standalone Server.

23/87


18.5) Select the desired languages.

24/87


18.6) Create the desired diskgroups through the “Create ASM Disk Group” window, (for this Example we are creating the DATA diskgroup, as Normal redundancy diskgroup, using the ORCL:ASMDISK1 & ORCL:ASMDISK2 ASMLIB disks):

25/87


18.7) Set the desired password for the ASM & ASMSNMP users through the “Specify ASM Password” window:

18.8) If you password does not conform the Oracle recommended standards then you will receive the next warning, so you can just ignore it & press [Yes] or provide a stronger password.

26/87


18.9) Assign the OS groups for the ASM Database Administrator, ASM Instance Administration Operator & ASM Instance Administrator roles, through the “Privileged Operating System Groups” window, and set the groups to the respective roles as follow:

27/87


18.10) Specify the Oracle Home & Oracle Base directories through the “Specify Installation Location” window: Oracle Base: /u01/app/grid Oracle Grid Home: /u01/app/grid/product/11.2.0/grid

28/87


18.11) Accept the Oracle Inventory Location, by pressing the [Next] button through the “Create Inventory” window:

29/87


18.12) Some OS requirements (swap & kernel parameters) did not pass the OUI verification, please review each requirement, through the “Perform Prerequisites Checks” window (below):

30/87


18.13) Please press the [Fix & Check Again] button (above) to correct the prerequisites, then the “Execute Fixup Script” window will be displayed:

18.14) Then run the runfixup.sh script as root user to implement the fixes:

31/87


18.15) Press the [OK] button after execute the runfixup.sh script through the “Execute Fixup Script” window:

32/87


18.16) The required kernel parameters were adjusted but the swap area still needs to be increased:

33/87


18.17) You can ask your SA to resize the swap area as suggested by the OUI (see above), for this example we will add a 1GB swap file (on the ‘/’ directory) as described in the next document: http://www.redhat.com/docs/manuals/linux/RHL-8.0-Manual/custom-guide/s1-swap-adding.html

Note: Enable it at boot time, edit /etc/fstab and include the new swap device (/swapfile):

34/87


18.18) After the swap area was increased please press the [Check Again] button, through the “Perform Prerequisites Checks” window (below):

35/87


18.19) The “Summary” window will appear, so please review it and press the [Finish] button (below) to start with the Grid Infrastructure Installation & ASM instance creation:

36/87


18.20) Then just monitor the progress of this installation:

37/87


38/87


39/87


18.21) Execute the orainstRoot.sh & root.sh scripts as root user:

40/87


41/87


18.22) Then return to the “Execute Configuration Scripts” window and press the [OK] button:

42/87


18.23) Continue monitoring the Post Installation / Configuration steps (NETCA & ASMCA Assistants are being executed):

43/87


18.24) Confirm the 11gR2 Grid Infrastructure Installation completed successfully, then press the [Close] button:

44/87


19) Verify the OHAS & CSS services are up and running:

45/87


20) Verify the ASM instance is up and running:

46/87


21) Run the ASMCA through a graphical session and create the RECO diskgroup on the ORCL:ASMDISK3 (/dev/oracleasm/disks/ASMDISK3) ASMLIB disk: 21.1) Select the [Create] button (below):

47/87


21.2) Specify the Disk Group Name as RECO (as External redundancy diskgroup), select the ORCL:ASMDISK3 disk (below), press the [Show Advanced Options] button to display the AU & Compatibility attributes (these are modifiable but for this example we are using the default values):

48/87


21.3) And finally press the [OK] button to create the RECO diskgroup:

49/87


50/87


51/87


21.4) Review the diskgroup creation (below) and press the [Exit] button:

52/87


11.2.0.X.0 RDBMS Oracle Home Installation steps: 22) Connect as root user and uncompress the 11.2.0.1.0 RDBMS software (e.g. linux_11gR2_database_1of2.zip & linux_11gR2_database_2of2.zip):

. . . .

23) Switch to the oracle OS user, setup & set the environment variables in the initialization file (for this example we are using bash shell (.bash_profile)): export ORACLE_BASE=/u01/app/oracle # Oracle RDBMS BASE export ORACLE_HOME=/u01/app/oracle/product/11.2.0/dbhome_1 # DB RDBMS Oracle Home export PATH=$ORACLE_HOME/bin:$PATH:. export ORACLE_SID=ASMDB stty erase ^H umask 022

53/87


54/87


55/87


24) Install the Oracle Grid Infrastructure 11gR2 from a graphical session as “oracle” OS user (for this example we will use VNCserver): 24.1) Start a vncserver as oracle user & set the Password = “e.g. oracle”:

24.2) Connect to the vncserver using the IP address associated with the host:

56/87


24.3) Execute the OUI (Oracle Universal Installer) as “oracle” OS user: $ /u01/stage/database/runInstaller

57/87


24.4) At the “Configure Security Updates” page you have the option to enable “security issues notifications” by email (e.g. new PSU patches, etc.), this is optional, so you can skip this part by pressing the [Next] button:

58/87


24.5) At the “Select Installation Option” page, select “Create and configure a database”, then press the [Next] button:

59/87


24.6) At the “System Class” page, select “Server Class”, then press the [Next] button:

60/87


24.7) At the “Node Selection” page, select “Single instance database installation”, then press the [Next] button:

61/87


24.8) At the “Select Install Type” page, select “Advanced installation”, then press the [Next] button:

62/87


24.9) At the “Select Product Languages” page, select the desired language(s), then press the [Next] button:

63/87


24.10) At the “Select Database Edition” page, select “Enterprise Edition”, then press the [Next] button:

64/87


24.11) At the “Specify Installation Location” page, verify the Oracle Base & Oracle Home are correctly set, as follow: ORACLE_BASE=/u01/app/oracle ORACLE_HOME=/u01/app/oracle/product/11.2.0/dbhome_1 And then press the [Next] button:

65/87


24.12) At the “Select Configuration Type” page, select “General Purpose / Transaction Possessing”, then press the [Next] button:

66/87


24.13) At the “Specify Database Identifiers” page, provide the database & instance name, then press the [Next] button:

67/87


24.14) At the “Specify Configuration Options” page, specify the desired Memory settings (PGA & SGA), Character Set, etc, then press the [Next] button:

68/87


24.15) At the “Specify Management Options” page, depending of your business requirement, specify “Grid Control” or “Database Control”, then press the [Next] button:

69/87


24.16) At the “Specify Database Storage Options” page, select “Automatic Storage Management”, specify the password for the ASMSNMP user (same password used to create the ASM instance), for this example ‘oracle’ was used as password & then press the [Next] button:

70/87


24.17) At the “Specify Recovery Options” page, select “Do not enable automated backups” (optional), then press the [Next] button:

71/87


24.18) At the “Select ASM Disk Group” page, select “DATA” diskgroup, then press the [Next] button:

72/87


24.19) At the “Specify Schema Password” page, select “Use the same password for all accounts”, set “oracle” as password, then press the [Next] button:

73/87


24.20) At the “Privileged Operating System Groups” page, set the OSDBA & OSOPER groups/roles as follow: OSDBA = dba OSOPER = oper And then press the [Next] button:

74/87


24.21) At the “Summary” page, review the RDBMS installation & database options, then press the [Next] button:

75/87


24.22) Then just monitor the progress for this RDBMS 11.2.0.X.X installation & database creation:

76/87


77/87


78/87


24.23) After the database is created, the OUI/DBCA will display the Database Information (including the URL to access the Database Control), write down this information, then press the [OK] button:

79/87


24.24) Then the OUI will ask to run the “root.sh” script:

80/87


Therefore, please open a new shell session, connect as root user and execute the root.sh script:

81/87


24.25) At the “Finish” page, press the [Close] button to exit from the OUI:

82/87


25) Using the URL from step # “24.23”, validate the access to the database control and ASM section: Enterprise Manager Database Control URL - (ASMDB): https://asmteam:1158/em

83/87


84/87


85/87


26) VERY IMPORTANT!!!!!!!!! ==)> If you need to create an 11.1.0.X.X or 10.2.0.X.X database using ASM 11.2.0.X.X (as storage option), then you need to set the ASM GID to the oracle kernel (<10.2 or 11.1 RDBMS Oracle Home>/bin/oracle executable), this needs to be set before you execute the DBCA (before the database creation) as follow: 26.1) Apply the Patch 9575578, only if your Grid Infrastructure Oracle Home is on 11.2.0.1.0 or 11.2.0.1.2 release, this patch can be downloaded from MOS using the next reference: https://updates.oracle.com/download/9575578.html Note: In 11.2.0.2.X or 11.2.0.3.X Grid Infrastructure releases, the fix for Bug: 9575578 is already included, therefore you can skip this step and continue with the next steps. 26.2) Connect as grid user and set the ASM GID to the RDBMS Oracle Home (any 11.2.0.X.X Grid Infrastructure release) as follow: # su - grid $> id $> <Oracle Grid Home>/bin/setasmgidwrap o=<10.2 or 11.1 RDBMS DB Oracle Home >/bin/oracle $> ls –l <10.2 or 11.1 RDBMS DB Oracle Home>/bin/oracle 26.3) Example output (after complete these steps, you should see the “asmadmin” group associated to the RDBMS $ORACLE_HOME/bin/oracle binary): a) RDBMS session before the ASM GID change (connected as oracle OS user):

86/87


b) Grid Infrastructure session to implement the ASM GID change (connected as grid OS user):

c) RDBMS session after the ASM GID change (connected as oracle OS user):

Note: The “asmadmin” group is now associated to the RDBMS $ORACLE_HOME/bin/oracle kernel executable. 26.4) Then run the DBCA to create the database (either from your 10.2 or 11.1 Database Oracle Home): $> <10.2 or 11.1 RDBMS DB Oracle Home>/bin/dbca

87/87


Example: [oracle@asmgrid dbhome_2]$id uid=1101(oracle) gid=1000(oinstall) groups=1000(oinstall),1200(dba),1201(oper),1300(asmdba) [oracle@asmgrid dbhome_2]$ [oracle@asmgrid dbhome_2]$echo $ORACLE_HOME /u02/app/oracle/product/10.2.0/dbhome_2 [oracle@asmgrid dbhome_2]$ [oracle@asmgrid dbhome_2]$ls -l $ORACLE_HOME/bin/oracle -rwsr-s--x 1 oracle asmadmin 93362227 Nov 10 11:52 /u02/app/oracle/product/10.2.0/dbhome_2/bin/oracle [oracle@asmgrid dbhome_2]$ [oracle@asmgrid dbhome_2]$$ORACLE_HOME/bin/dbca [oracle@asmgrid dbhome_2]$

asm 11gr2 installation & configuration role separation complete nov-9-2011 new

Documents