oracle database 11gr2 rac install step by step on vsphere

108
Version ๋ณ€๊ฒฝ์ผ์ž ๋ณ€๊ฒฝ์ž(์ž‘์„ฑ์ž) ์ฃผ์š”๋‚ด์šฉ 1 2 Author ๋ฐ•์ฒ ํ˜„ Creation Date 2011.7.6 Last Updated Version 0.1 Copyright(C) 2004 Goodus Inc. All Rights Reserved Oracle Database 11gR2 RAC Install Step by Step on VSphere

Upload: others

Post on 05-Feb-2022

9 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Oracle Database 11gR2 RAC Install Step by Step on VSphere

Version ๋ณ€๊ฒฝ์ผ์ž ๋ณ€๊ฒฝ์ž(์ž‘์„ฑ์ž) ์ฃผ์š”๋‚ด์šฉ

1

2

Author ๋ฐ•์ฒ ํ˜„

Creation Date 2011.7.6

Last Updated

Version 0.1 Copyright(C) 2004 Goodus Inc.

All Rights Reserved

Oracle Database 11gR2 RAC

Install Step by Step on VSphere

Page 2: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 2 -

Contents

1. ๊ฐœ์š” ............................................................................................................. 3

2. vSphere server install .............................................................................. 3

3. vSphere client install ............................................................................. 12

4. vSphere Client Start ๋ฐ VSphere Configuration .............................. 18

5. ๊ฐ€์ƒ๋จธ์‹  ์ƒ์„ฑ ๋ฐ OS ์„ค์น˜ .................................................................... 23

1. ๊ฐ€์ƒ๋จธ์‹  ์ƒ์„ฑ .......................................................................................... 23

6. vSphere CLI ์„ค์น˜ ๋ฐ Virtual Storage Configuration ....................... 45

7. Oracle Pre-Installation Steps ............................................................... 54

7.1. Preparing the system .................................................................................................. 54

7.1.1. Host file Configuration ....................................................................................................................................54

7.1.2. Kernel Sysctl Configuration ...........................................................................................................................55

7.1.3. User resource limit ์„ค์ • .................................................................................................................................55

7.1.4. NTP ์„ค์ • ................................................................................................................................................................56

7.1.5. User Shell Configuration .................................................................................................................................56

7.1.6. SSH ์„ค์ • ................................................................................................................................................................58

7.2. Preparing Oracle ASM ................................................................................................ 58

7.2.1. ASM LIBRARY .......................................................................................................................................................58

7.2.2. ASM Configuration ............................................................................................................................................59

7.2.3. Create ASM VOLUME. ......................................................................................................................................59

7.3. Install requirement ํ™•์ธ ............................................................................................ 64

7.3.1. cluster verify utility ............................................................................................................................................64

8. Oracle RAC Installation step ................................................................ 77

8.1. Grid Infrastracture Install ........................................................................................... 77

8.2. Database Software Install .......................................................................................... 89

8.3. ACFS ๊ตฌ์„ฑ ...................................................................................................................... 96

8.4. Database ์ƒ์„ฑ ............................................................................................................ 101

Page 3: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 3 -

1. ๊ฐœ์š”

Oracle 11.2.0.2 ๋ถ€ํ„ฐ๋Š” Vmware์˜ ๊ฐ€์ƒํ™” ์‹œ์Šคํ…œ ๊ณต์‹์ ์œผ๋กœ Certified ๊ฐ€ ๋˜์—ˆ์Šต๋‹ˆ๋‹ค.

์š”์ฆ˜ ๋ณด์•ˆ ๋ฟ๋งŠ ์•„๋‹ˆ๋ผ ๊ฐ€์ƒํ™” ๊ตฌ์ถ•์ด ํฐ ์ด์Šˆ๊ฐ€ ๋˜๊ณ  ์žˆ๋Š”๋ฐ Oracle์—์„œ ๊ฐ€์ƒํ™”์—์„œ

์˜ ์ง€์›Ž์„ ๊ณต์‹์ ์œผ๋กœ ์ง€์›Žํ•จ์— ๋”ฐ๋ผ ๊ฐ€์ƒํ™” ์‹œ์Šคํ…œ์—์„œ Oracle ์ด ์–ผ๋งˆ๋‚˜ ์ž˜ ์„ค์น˜๊ฐ€

๋˜๊ณ  ๋™์ž‘ํ•˜๋Š”์ง€ ์•Œ์•„๋ณด๊ธฐ ์œ„ํ•˜์—ฌ ๊ฐ€์ƒํ™” ์‹œ์Šคํ…œ๋ถ€ํ„ฐ OS, Oracle RAC ์„ค์น˜๊นŒ์ง€ ๊ตฌ์ถ•

ํ•  ์ˆ˜ ์žˆ๋„๋ก Step by Step ํ˜•์‹์œผ๋กœ ์ž‘์„ฑํ•ด ๋ณด์•˜์Šต๋‹ˆ๋‹ค.

2. vSphere server install

์„ค์น˜ ๋ชจ๋“œ ์ค‘์—์„œ GUI ํ˜•ํƒœ์˜ ์„ค์น˜ ํ”„๋กœ๊ทธ๋žจ์„ ์ด์šฉํ•˜์—ฌ ์„ค์น˜ํ•˜๋Š” ๋ฐฉ๋ฒ•์ธ Install ESX in

graphical mode ๋ฉ”๋‰ด๋ฅผ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค.

Page 4: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 4 -

NEXT ๋ฒ„ํŠบ์„ ๋ˆ„๋ฅด๋ฉด ๋ผ์ด์„ผ์Šค ๋™์˜ ์ฐฝ์œผ๋กœ ์ด๋™๋ฉ๋‹ˆ๋‹ค.

์œ„์™€ ๊ฐ™์ด End User License ์— ๋™์˜ ํ•œํ›„ NEXT ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

Page 5: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 5 -

ํ‚ค๋ณด๋“œ ๋ ˆ์ด์•„์›ƒ์„ ์„ ํƒํ•˜๋Š” ํ™”๋ฉด์ด ๋‚˜์˜ค๋ฉด U.S. English ํƒ€์ž…์„ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค.

์„ค์น˜์— ํ•„์š”ํ•œ ํ•˜๋“œ์›จ์–ด ์žฅ์น˜ ๋“œ๋ผ์ด๋ฒ„ ์ •๋ณด๋ฅผ ์ถ”๊ฐ€๋กœ ๋กœ๋”ฉ ํ•  ๊ฒƒ์ธ์ง€ ํ™•์ธ ํ•ฉ๋‹ˆ๋‹ค.

NO ๋ฅผ ์„ ํƒ ํ•  ๊ฒฝ์šฐ ์„ค์น˜ ํŒŒ์ผ์— ์ด๋ฏธ ํ•˜๋“œ์›จ์–ด ์žฅ์น˜ ๋“œ๋ผ์ด๋ฒ„๊ฐ€ ๋ชจ๋‘ ํฌํ•จ๋˜์–ด ์žˆ์–ด ๋ณ„๋„๋กœ

๋กœ๋”ฉ ์‹œ์ผœ์•ผ ํ•  ๋“œ๋ผ์ด๋ฒ„๊ฐ€ ์—†๋‹ค๋Š” ๊ฒƒ์„ ๋‚˜ํƒ€๋ƒ…๋‹ˆ๋‹ค. NO ๋ฅผ ์„ ํƒ ํ›„ ๊ณ„์† ์ง‚ํ–‰ํ•˜๋„๋ก ํ•˜๊ฒ ์Šต๋‹ˆ

๋‹ค.

์„ค์น˜ํŒŒ์ผ์— ํฌํ•จ๋œ ์žฅ์น˜ ๋“œ๋ผ์ด๋ฒ„๋ฅผ ๋กœ๋”ฉ ํ•  ๊ฒƒ์ธ์ง€ ๋ฌป๋Š” ํ™”๋ฉด์œผ๋กœ YES ์„ ํƒ ํ›„ ์•„๋ž˜ ๊ทธ๋ฆผ๊ณผ

๊ฐ™์ด 100% complete ๋ฉ”์‹œ์ง€๊ฐ€ ๋‚˜์˜ค๋ฉด NEXT ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

Page 6: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 6 -

๋“œ๋ผ์ด๋ฒ„ ๋กœ๋”ฉ์ด ๋๋‚˜๋ฉด ๋ผ์ด์„ ์Šค ํ‚ค ๊ฐ’์„ ๋“ฑ๋ก ํ•˜๋Š” ํ™”๋ฉด์ด ๋‚˜ํƒ€๋‚ฉ๋‹ˆ๋‹ค. ๋ผ์ด์„ผ์Šค ๊ฐ’์„ ๋“ฑ๋ก

ํ•˜๊ฑฐ๋‚˜ Enter a serial number later ์˜ต์…˜์„ ์„ ํƒํ•œ ํ›„ NEXT ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

Page 7: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 7 -

์„œ๋ฒ„๋ฅผ ์‹ค์ œ๋กœ ๊ด€๋ฆฌํ•˜๊ฒŒ ๋˜๋Š” ๊ด€๋ฆฌ ๋„คํŠธ์›Œํฌ ํฌํŠธ, ์ฆ‰ ์šด์˜์ฒด์ œ์˜ ์„œ๋น„์Šค ์ฝ˜์†”์šฉ ๋„คํŠธ์›Œํฌ

ํฌํŠธ๋ฅผ ์ง€์ •ํ•˜๋Š” ํ™”๋ฉด์œผ๋กœ ์ œ์ผ ๋จผ์ € ์ธ์‹๋œ ์ฒซ ๋ฒˆ์งธ NIC ์–ด๋Œ‘ํ„ฐ๋ฅผ ๊ธฐ๋ณธ๊ฐ’์œผ๋กœ ์„ ํƒ ํ•  ์ˆ˜

์žˆ์Šต๋‹ˆ๋‹ค. ๋งŠ์ผ VLAN ํƒœ๊ทธ๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ํ™–๊ฒฝ์ด๋ผ๋ฉด VLAN ID ๋ฅผ ์ž…๋ ฅ ํ•  ์ˆ˜๋„ ์žˆ์Šต๋‹ˆ๋‹ค. ์ ์ ƒํ•œ

๋„คํŠธ์›Œํฌ ์–ด๋Œ‘ํ„ฐ๋ฅผ ์„ ํƒํ•œ ๋‹ค์Œ NEXT ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

์„œ๋น„์Šค ์ฝ˜์†”์šฉ ๊ด€๋ฆฌ ๋„คํŠธ์›Œํฌ์— IP ์ฃผ์†Œ๋ฅผ ํ• ๋‹นํ•˜๋Š” ํ™”๋ฉด์œผ๋กœ ํ•ด๋‹น ํ•ญ๋ชฉ์— ๋งž๋„๋ก IP ์ฃผ์†Œ,

์„œ๋ธŒ๋„ท ๋งˆ์Šคํฌ ๊ฐ’, ๊ฒŒ์ดํŠธ์›จ์ด ์ฃผ์†Œ ๊ทธ๋ฆฌ๊ณ  DNS ์„œ๋ฒ„ ์ฃผ์†Œ์™€ ํ˜ธ์ŠคํŠธ๋ช…์„ ์ž…๋ ฅํ•ฉ๋‹ˆ๋‹ค.

Page 8: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 8 -

.

ESX ์„œ๋ฒ„ ํŒŒํ‹ฐ์…˜ ์„ค์ •์— ๋Œ€ํ•œ ๋ถ€๋ถ„์œผ๋กœ Standard setup ์€ VMware๊ฐ€ ๊ถŒ์žฅํ•˜๋Š” ๊ธฐ๋ณธ๊ฐ’์œผ๋กœ

์ฒซ ๋ฒˆ์งธ LUN์„ ํŒŒํ‹ฐ์…”๋‹ํ•˜์—ฌ ์„ค์น˜๋ฅผ ์ง‚ํ–‰ ํ•˜๋Š” ๋ฐฉ๋ฒ•์ด๊ณ  Advanced setu์€ ์‚ฌ์šฉ์ž๊ฐ€ ํŒŒํ‹ฐ์…˜

์ •๋ณด๋ฅผ ์ˆ˜์ •ํ•˜์—ฌ ์„ค์น˜ํ•˜๋Š” ๋ฐฉ๋ฒ•์ž…๋‹ˆ๋‹ค.

์„ค์น˜ ํŒŒ์ผ์ด ์ €์žฅ๋  ๋Œ€์ƒ๋””์Šคํฌ๋ฅผ ์„ ํƒํ•˜๋Š” ํ™”๋ฉด์ž…๋‹ˆ๋‹ค. ์„ค์น˜ ๋Œ€์ƒ ๋””์Šคํฌ๋ฅผ ์„ ํƒํ•˜๊ณ  Next

๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

ํ•ด๋‹น ๋””์Šคํฌ์— ๋ฐ์ดํ„ฐ๊ฐ€ ์กฒ์žฌํ•  ๊ฒฝ์šฐ ๋ชจ๋‘ ์‚ฌ๋ผ์ง‚๋‹ค๋Š” ๊ฒฝ๊ณ  ๋ฉ”์‹œ์ง€๊ฐ€ ์ถœ๋ ฅ ๋ฉ๋‹ˆ๋‹ค. Ok ๋ฒ„ํŠบ์„

ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

Page 9: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 9 -

๊ฐ€์ƒ ๋จธ์‹ž์„ ๋‹ด์•„๋‘๊ธฐ ์œ„ํ•œ ์ €์žฅ์†Œ, ์ฆ‰ ๋ฐ์ดํ„ฐ์Šคํ† ์–ด์˜ ์ด๋ฆ„์„ ์ง€์ •ํ•˜๋Š” ํ™”๋ฉด์ž…๋‹ˆ๋‹ค.

์ ์ ƒํ•œ ์ด๋ฆ„์„ ์ž…๋ ฅ ํ›„ Next ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

ํŒŒํ‹ฐ์…˜ ํ™•์ธ ๋ฐ ์žฌ ์„ค์ •์„ ํ•ฉ๋‹ˆ๋‹ค.

Page 10: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 10 -

Time Zone ์„ค์ • ํ™”๋ฉด์œผ๋กœ ์‹œ์Šคํ…œ์ด ์šด์˜๋  ์œ„์น˜๋ฅผ ์„ ํƒ ํ›„ Next ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

Date and Time ์„ค์ • ํ™”๋ฉด์œผ๋กœ ์‹œ๊ฐ‚์„ ์„ค์ •ํ•ฉ๋‹ˆ๋‹ค.

Page 11: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 11 -

Root ๊ณ„์ •์˜ ์•”ํ˜ธ ๋ฐ ์‚ฌ์šฉ์ž๋ฅผ ์ถ”๊ฐ€ ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. Roo password ๋ฅผ ๋“ฑ๋กํ•˜๊ณ 

Next ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

์„ค์น˜ ์ง‚ํ–‰ ์ ‚ ์ตœ์ข…์ ์œผ๋กœ ์ž…๋ ฅ ์ •๋ณด๋ฅผ ํ™•์ธ ํ•˜๋Š” ํ™”๋ฉด ์ž…๋‹ˆ๋‹ค. ๊ฒ€ํ†  ํ›„ Next ๋ฒ„ํŠบ์„ ํด๋ฆญํ•˜๋ฉด

์„ค์น˜๊ฐ€ ์ง‚ํ–‰ ๋ฉ๋‹ˆ๋‹ค.

Page 12: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 12 -

์„ค์น˜ ์™„๋ฃŒ ํ™”๋ฉด์ž…๋‹ˆ๋‹ค. Finish ๋ฒ„ํŠบ์„ ํด๋ฆญํ•˜๋ฉด ์‹œ์Šคํ…œ์ด ์žฌ์‹œ์ž‘ ๋ฉ๋‹ˆ๋‹ค.

์‹œ์Šคํ…œ์ด ์ •์ƒ์ ์œผ๋กœ ์žฌ ์‹œ์ž‘๋œ๋‹ค๋ฉด ์ตœ์ข…์ ์œผ๋กœ ์œ„์™€ ๊ฐ™์€ ์ฝ˜์†” ํ™”๋ฉด์ด ์ถœ๋ ฅ๋ฉ๋‹ˆ๋‹ค

3. vSphere client install

ESX ์„œ๋ฒ„๋ฅผ ๊ด€๋ฆฌํ•˜๋Š” ๋ฐฉ๋ฒ•์—๋Š” ์—ฌ๋Ÿฌ๊ฐ€์ง€๊ฐ€ ์žˆ์ง€๋งŠ ๋ฐ˜๋“œ์‹œ ์‚ฌ์šฉํ•ด์•ผ ํ•˜๋Š” ๋„๊ตฌ๊ฐ€

vSphere client ์ž…๋‹ˆ๋‹ค. vSphere client ๋Š” ์œˆ๋„์šฐ ๊ธฐ๋ฐ˜์˜ GUI ์–ดํ”Œ๋ฆฌ์ผ€์ด์…˜์œผ๋กœ์จ

vSphere ์„œ๋ฒ„๋ฅผ ์‰ฝ๊ฒŒ ๊ด€๋ฆฌํ•  ์ˆ˜ ์žˆ๋„๋ก ํ•ด์ค๋‹ˆ๋‹ค.

1. Web ์„ ์ด์šฉํ•˜์—ฌ vSphere client ๋‚ด๋ ค ๋ฐ›๊ธฐ

Web ์„ ์ด์šฉํ•˜์—ฌ ESX ์„œ๋ฒ„ IP (192.168.0.100) ์ฃผ์†Œ๋กœ ์ ‘์† ํ•ด์„œ ํŽ˜์ด์ง€์— ์žˆ๋Š” Download

Page 13: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 13 -

vSphere Client ๋งํฌ๋ฅผ ํด๋ฆญํ•œ๋‹ค.

2. VSphere client ์„ค์น˜

ํŠน๋ณ„ํ•œ ๋ถ€๋ถ„์ด ์—†์œผ๋‹ˆ ๋‹ค์Œ ์„ค์น˜ ํ™”๋ฉด์„ ๋”ฐ๋ผ ์„ค์น˜ํ•ด๋ด…๋‹ˆ๋‹ค.

Page 14: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 14 -

Page 15: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 15 -

Page 16: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 16 -

Page 17: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 17 -

Page 18: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 18 -

4. vSphere Client Start ๋ฐ VSphere Configuration

VSphere Server IP ๋˜๋Š” Hostname , Username, password ๋ฅผ ์ž…๋ ฅํ•˜๊ณ  Login ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

Page 19: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 19 -

์™ผ์ชฝ์ฐฝ์˜ IP ๋˜๋Š” Hostname ์„ ์„ ํƒํ•˜๊ณ  ์˜ค๋ฅธ์ชฝ ์ฐฝ ์ƒ๋‹จ์˜ Configuration tab์„ ์„ ํƒํ•˜๋ฉด

์•„๋ž˜์™€ ๊ฐ™์ด VSphere ์„ค์ •ํ™”๋ฉด์ด ๋‚˜์˜ต๋‹ˆ๋‹ค. ๊ทธ ์ค‘ Networking ์„ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค.

๊ฐ๊ฐ์˜ RAC Node ๋Š” ์ตœ์†Œํ•œ 2๊ฐœ์˜ Network (Public, Cluster InterConnect) ์ด ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค.

๋ณ„๋„์˜ InterConnect ์šฉ Network ์„ ๊ตฌ์„ฑํ•˜๊ธฐ ์œ„ํ•ด Virtual Switch ๋ฅผ ๊ตฌ์„ฑํ•˜๋„๋ก ํ•ฉ๋‹ˆ๋‹ค.

Networking ๊ตฌ์„ฑ ํ™”๋ฉด ์œ—๋ถ€๋ถ„ (์˜ค๋ฅธ์ชฝ ์ƒ๋‹จ) ์˜ Add Networking ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

Page 20: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 20 -

Connection Type ์œผ๋กœ์จ Virtual Machine ๋ฅผ ์„ ํƒํ•˜๊ณ  Next ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

Create a virtual switch ์„ ์„ ํƒํ•˜๊ณ  Next ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

Page 21: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 21 -

Virtual Switch ์— ๋Œ€ํ•œ Network Lable ์›Žํ•˜๋Š” ์ด๋ฆ„์œผ๋กœ ์ง€์ •ํ•˜๊ณ  Next ๋ฒ„ํŠบ์„ ํด๋ฆฝํ•ฉ๋‹ˆ๋‹ค.

Summary ํ™”๋ฉด์ž…๋‹ˆ๋‹ค. ์›Žํ•˜๋Š” ๊ตฌ์„ฑ์ด ๋งž๋Š”์ง€ ํ™•์ธํ•˜๊ณ  ๋งž๋‹ค๋ฉด Finish ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค..

Page 22: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 22 -

Virtual Switch ๊ตฌ์„ฑ์ด ์™„๋ฃŒ๋œ ๊ตฌ์„ฑ ํ™”๋ฉด์ž…๋‹ˆ๋‹ค.

์—ฌ๊ธฐ์„œ๋Š” Oracle 11.2.0.2 RAC New Feature ์ค‘์— ํ•˜๋‚˜์ธ HAIP์— ๋Œ€ํ•ด ์•Œ์•„๋ณด๊ธฐ ์œ„ํ•ด

Cluster Interconnect ์šฉ VSwitch๋ฅผ ํ•˜๋‚˜ ๋” ์ƒ์„ฑํ•˜์˜€์Šต๋‹ˆ๋‹ค.

Page 23: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 23 -

5. ๊ฐ€์ƒ๋จธ์‹  ์ƒ์„ฑ ๋ฐ OS ์„ค์น˜

1. ๊ฐ€์ƒ๋จธ์‹ž ์ƒ์„ฑ

๊ฐ€์ƒ๋จธ์‹ž์€ ์˜ค๋ฅธ์ชฝ ์ฐฝ์˜ VSphere Host ๋ฐ IP ๋ฅผ ์„ ํƒํ•˜์‹œ๊ณ  ๋งˆ์šฐ์Šค ์˜ค๋ฅธ์ชฝ ๋ฒ„ํŠบ์„ ํด๋ฆญํ•œ ํ›„

New Virtual Machine ์„ ํด๋ฆญํ•˜์—ฌ ์ƒ์„ฑํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Page 24: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 24 -

๊ฐ€์ƒ๋จธ์‹ž์„ ์ž์‹ž์˜ ์ž…๋ง›์— ๋งž๊ฒŒ ํ•„์š”ํ•œ ๋‚ด์šฉ์„ ๊ตฌ์„ฑํ•˜๊ธฐ ์œ„ํ•˜์—ฌ Custom ์„ ์„ ํƒํ•œ ํ›„ Next ๋ฒ„

ํŠบ์„ ํด๋ฆฝํ•ฉ๋‹ˆ๋‹ค.

์›Žํ•˜๋Š” ๊ฐ€์ƒ๋จธ์‹ž์˜ ์ด๋ฆ„์„ ์ง€์ •ํ•ฉ๋‹ˆ๋‹ค.

Page 25: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 25 -

๊ฐ€์ƒ๋จธ์‹ž์ด ์ €์žฅ๋  Datastore ์˜ ์œ„์น˜๋ฅผ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค. ์—ฌ๊ธฐ์„œ๋Š” VSphere ์„œ๋ฒ„๋ฅผ ์„ค์น˜ ํ•  ๋•Œ ๋ฏธ

๋ฆฌ ์„ค์ •ํ•ด ๋†“์€ VMFS DataStore ๋ฐ–์— ์—†์œผ๋ฏ€๋กœ Next ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค

๊ฐ€์ƒ๋จธ์‹ž ๋ฒ„์ ‚์„ ์„ ํƒํ•˜๊ณ  Next ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

Page 26: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 26 -

์–ด๋– ํ•œ Guest OS ๋ฅผ ์„ค์น˜ํ•  ๊ฒƒ์ธ์ง€ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค ์—ฌ๊ธฐ์„œ๋Š” Oracle Linux 5.6 ๋ฅผ ์„ค์น˜ํ•  ๊ฒƒ์ด๊ธฐ ๋•Œ

๋ฌธ์— Oracle Linux 5 ๋ฅผ ์„ ํƒํ•œ ํ›„ Next ๋ฒ„ํŠบ์„ ํด๋ฆฝํ•ฉ๋‹ˆ๋‹ค.

๊ฐ€์ƒ CPU ๊ฐœ์ˆ˜๋ฅผ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค.

Page 27: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 27 -

๊ฐ€์ƒ ๋ฉ”๋ชจ๋ฆฌ๋ฅผ ์„ค์ • ํ•œ ํ›„ Next ๋ฅผ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค. 11g RAC ๋Š” ์ตœ์†Œ 1.5GB ์ด์ƒ์˜ ๋ฉ”๋ชจ๋ฆฌ๋ฅผ

์š”๊ตฌํ•ฉ๋‹ˆ๋‹ค.

Network ์„ค์ • ํ™”๋ฉด์ž…๋‹ˆ๋‹ค. ์œ„์™€ ๊ฐ™์ด ์„ ํƒํ•˜์‹ž ํ›„ Next ๋ฒ„ํŠบ์„ ํด๋ฆฝํ•ฉ๋‹ˆ๋‹ค.

Page 28: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 28 -

๊ฐ€์ƒ SCSI ์ปจํŠธ๋กค๋Ÿฌ ์„ ํƒํ™”๋ฉด์ž…๋‹ˆ๋‹ค. ๋ฒ”์šฉ์ ์œผ๋กœ ์“ฐ์ด๋Š” LSI logic Parallel ์„ ์„ ํƒํ•˜๊ณ  Next ๋ฒ„

ํŠบ์„ ํด๋ฆฝํ•ฉ๋‹ˆ๋‹ค.

Create a new virtual disk ๋ฅผ ์„ ํƒํ•œ ํ›„ Next ๋ฒ„ํŠบ์„ ํด๋ฆฝํ•ฉ๋‹ˆ๋‹ค.

Page 29: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 29 -

๊ฐ€์ƒ๋จธ์‹ž์—๊ฒŒ ํ• ๋‹นํ•œ Disk ํฌ๊ธฐ๋ฅผ ์ง€์ •ํ•ฉ๋‹ˆ๋‹ค.

๊ฐ€์ƒ๋จธ์‹ž์˜ SCSI ID ์„ ํƒํ™”๋ฉด์ž…๋‹ˆ๋‹ค Default๋กœ ์„ ํƒํ•˜๊ณ  Next ๋ฒ„ํŠบ์„ ํด๋ฆฝ๋‹ˆ๋‹ค.

Page 30: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 30 -

์ตœ์ข… Review ํ™”๋ฉด์ž…๋‹ˆ๋‹ค.

2. OS ์„ค์น˜

OS ์„ค์น˜๋Š” ์•„๋ž˜ ์„ค์น˜ ๊ณผ์ •์„ ๋”ฐ๋ผ ์„ค์น˜ํ•ด๋ณด์‹œ๊ธธ ๋ฐ”๋ž๋‹ˆ๋‹ค.

OS ๋ฅผ Oracle Linux ๋กœ ์„ ํƒํ•œ ์ด์œ ๋Š” Oracle ์„ ์„ค์น˜ ํ•˜๊ธฐ ์œ„ํ•œ ํ•„์š”ํ•œ ์กฐ๊ฑด๋“ค์ด ๊ฑฐ์˜ ์„ค

์น˜ ๋ฐ ์…‹ํŒ…๋˜์–ด ์žˆ์–ด์„œ ๋ณ„๋„์˜ ์ž‘์—…์ด ํ•„์š”ํ•˜์ง€ ์•Š๊ธฐ ๋•Œ๋ฌธ์ž…๋‹ˆ๋‹ค.

Page 31: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 31 -

Page 32: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 32 -

Page 33: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 33 -

Page 34: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 34 -

ํŒŒํ‹ฐ์…˜ ์„ค์ •์ž…๋‹ˆ๋‹ค.

Page 35: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 35 -

๋„คํŠธ์› ์„ค์ •์ž…๋‹ˆ๋‹ค.

Page 36: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 36 -

Page 37: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 37 -

ํŒจํ‚ค์ง€ ์„ค์น˜ ์ž…๋‹ˆ๋‹ค.

Page 38: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 38 -

Page 39: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 39 -

Page 40: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 40 -

Page 41: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 41 -

Page 42: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 42 -

Page 43: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 43 -

Page 44: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 44 -

RAC๋ฅผ ๊ตฌ์„ฑํ•˜๊ธฐ ์œ„ํ•œ 2๋ฒˆ์งธ ๊ฐ€์ƒ ๋จธ์‹ž ์ƒ์„ฑ๋„ ์ด์™€ ๊ฐ™์€ ๋ฐฉ๋ฒ•์œผ๋กœ ๋ฐ˜๋ณตํ•ฉ๋‹ˆ๋‹ค.

Page 45: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 45 -

6. vSphere CLI ์„ค์น˜ ๋ฐ Virtual Storage Configuration

vSphere CLI ๋Š” Linux ๋˜๋Š” Windows ์— ์„ค์น˜๋ฅผ ํ•˜์—ฌ ์›Ž๊ฒฉ์œผ๋กœ CLI ๋ช…๋ น์„ ์‹คํ–‰ ํ•  ์ˆ˜ ์žˆ๋Š”

ํ”„๋กœ๊ทธ๋žจ์ž…๋‹ˆ๋‹ค.

RAC ๋ฅผ ๊ตฌ์„ฑํ•˜๊ธฐ ์œ„ํ•ด์„œ๋Š” ์–‘์ชฝ ๋…ธ๋“œ๊ฐ‚์— Datfile์ด ๋ฐ˜๋“ฏ์ด ๊ณต์œ  ๋˜์–ด์•ผ ํ•ฉ๋‹ˆ๋‹ค

์—ฌ๊ธฐ์„œ๋Š” ๊ฐ€์ƒ๋จธ์‹ž๊ฐ‚์˜ ๊ณต์œ  ๋””์Šคํฌ (VMFS)๋ฅผ ์„ค์ •ํ•˜๊ธฐ ์œ„ํ•˜์—ฌ vSphere CLI ๋ฅผ ์‚ฌ์šฉํ•˜๋„๋ก ํ•ฉ๋‹ˆ๋‹ค.

1. vSphere CLI ์„ค์น˜

vSphere CLI๋Š” vmware ํ™ˆํŽ˜์ด์ง€์—์„œ ๋ฌด๋ฃŒ๋กœ ๋‹ค์šด ๋ฐ›์„ ์ˆ˜ ์žˆ์œผ๋ฏ€๋กœ ๋‹ค์šด ๋ฐ›์€ ํ›„ ์„ค์น˜ํ•ฉ๋‹ˆ๋‹ค.

Page 46: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 46 -

Page 47: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 47 -

Page 48: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 48 -

Page 49: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 49 -

2. Virtual Machine Storage ๊ตฌ์„ฑ

์œ„์™€ ๊ฐ™์ด ์œˆ๋„์šฐ ์‹œ์ž‘๋ฉ”๋‰ด์—์„œ CLI Command Prompt ๋ฅผ ์‹คํ–‰ํ•ฉ๋‹ˆ๋‹ค.

RAC ๋ฅผ ๊ตฌ์„ฑํ•˜๊ธฐ ์œ„ํ•ด์„œ๋Š” OCR, VOTE, DATA File ์ด ์–‘์ชฝ ๋…ธ๋“œ๊ฐ‚์— ๊ณต์œ  ๋ ์ˆ˜ ์žˆ์–ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.

๋‹ค์Œ๊ณผ ๊ฐ™์€ Vmfkstools.pl ๋ช…๋ น์–ด๋กœ OCR, VOTE ๋ฅผ ์ €์žฅํ•  ์ˆ˜ ์žˆ๋Š” CRS์™€ Oracle Datafile๋“ค์„

์ €์žฅํ•  ์ˆ˜ ์žˆ๋Š” DATA ASM์šฉ ๋””์Šคํฌ๋ฅผ ์ƒ์„ฑํ•ด๋ณด๋„๋ก ํ•ฉ๋‹ˆ๋‹ค.

Vmfkstools.pl โ€“server 192.168.0.100 โ€“c 5g โ€“d eagerzeroedthick โ€“a lsilogic

/vmfs/volumes/datastore1/ordata/crs.vmdk

Vmfkstools.pl โ€“server 192.168.0.100 โ€“c 20g โ€“d eagerzeroedthick โ€“a lsilogic

/vmfs/volumes/datastore1/ordata/data.vmdk

Page 50: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 50 -

๊ฐ€์ƒ๋จธ์‹ž์— ๋””์Šคํฌ๋ฅผ ์ถ”๊ฐ€ ํ•˜๊ธฐ ์œ„ํ•˜์—ฌ ๊ฐ€์ƒ๋จธ์‹ž์„ shutdown ํ•œ ํ›„ vSphere Client ์—์„œ

์˜ค๋ฅธ์ชฝ ํ™”๋ฉด์˜ ๊ฐ€์ƒ๋จธ์‹ž์„ ์„ ํƒํ•œ ํ›„ ๋งˆ์šฐ์Šค ์˜ค๋ฅธ์ชฝ ๋ฒ„ํŠบ์„ ํด๋ฆญํ•˜์—ฌ Edit Settin์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

๊ทธ๋Ÿฌ๋ฉด ์•„๋ž˜์™€ ๊ฐ™์€ Virtual Machine Properties ํ™”๋ฉด์ด ๋‚˜์˜ต๋‹ˆ๋‹ค.

Virtual Machine Properties ์˜ Add ๋ฒ„ํŠบ์„ ํด๋ฆฝํ•ฉ๋‹ˆ๋‹ค.

Page 51: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 51 -

Hard Disk ๋ฅผ ์„ ํƒํ•˜๊ณ  Next ๋ฒ„ํŠบ์„ ํด๋ฆฝํ•ฉ๋‹ˆ๋‹ค.

Use an existing virtual disk ๋ฅผ ์„ ํƒํ•œ ํ›„ Next ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

Page 52: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 52 -

vSphere CLI ์—์„œ ์ƒ์„ฑํ•œ crs.vmdk ์ฐพ์•„์„œ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค.

๊ฐ€์ƒ๋จธ์‹ž์˜ SCSI ID ๋ฅผ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค. System ์˜์—ญ๊ณผ ๋ถ„๋ฆฌํ•˜๊ธฐ ์œ„ํ•˜์—ฌ SCSI 1:0 ์„ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค.

Page 53: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 53 -

Disk ์ƒ์„ฑ์ด ์™„๋ฃŒ๋˜์—ˆ์œผ๋ฉด New SCSI Controller ์„ ์„ ํƒํ•œ ํ›„ Physical ๋กœ ๋ณ€๊ฒฝํ•ด์ค๋‹ˆ๋‹ค.

Page 54: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 54 -

๋‚˜๋จธ์ง€ DATA Disk ๋„ ๋ฐ˜๋ณตํ•ด์„œ ์ถ”๊ฐ€ ํ•ฉ๋‹ˆ๋‹ค.

7. Oracle Pre-Installation Steps

7.1. Preparing the system

7.1.1. Host file Configuration

/etc/hosts ํŒŒ์ผ์— ๊ฐ ๋…ธ๋“œ์˜ Pulic IP ์ฃผ์†Œ ๋ฐ VIP, Interconnect ์ฃผ์†Œ๋ฅผ ๋“ฑ๋กํ•จ

(root ์‚ฌ์šฉ์ž๋กœ ์–‘์ชฝ ๋…ธ๋“œ ๋ชจ๋‘ ์ˆ˜ํ–‰ํ•จ.)

[root@rac1]# cat /etc/hosts

# Do not remove the following line, or various programs

# that require network functionality will fail.

127.0.0.1 localhost.localdomain localhost

192.168.0.110 rac1.pchyun.com rac1

192.168.0.120 rac2.pchyun.com rac2

# Private LAN For Oracle RAC Interconnection

10.1.1.10 rac1-priv1.pchyun.com rac1-priv1

10.1.1.11 rac1-priv2.pchyun.com rac1-priv2

10.1.1.20 rac2-priv1.pchyun.com rac2-priv1

10.1.1.21 rac2-priv2.pchyun.com rac2-priv2

Page 55: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 55 -

# Public Oracle Virtual IP -(VIP)

192.168.0.111 rac1-vip.pchyun.com rac1-vip

192.168.0.121 rac2-vip.pchyun.com rac2-vip

# Public Oracle Scan IP

# 192.168.0.160 rac-scan.pchyun.com rac-scan

โ— Oracle Grid infrastructure ๋ฅผ ์œ„ํ•ด์„œ๋Š” DNS ์— 3๊ฐœ์˜ scan IP ๊ฐ€ ํ•„์š”์ง€๋งŠ DNS ์—†์ด hosts file

์„ ์ด์šฉํ•˜ scan IP 1๊ฐœ๋กœ ๊ตฌ์„ฑํ•˜์—ฌ ์‚ฌ์šฉํ•  ์ˆ˜๋„ ์žˆ๋‹ค ์—ฌ๊ธฐ์„œ๋Š” DNS ์„œ๋ฒ„์—

โ€œ192.168.0.151, 192.168.0.152. 192.168.0.153โ€ 3๊ฐœ์˜ IP๋ฅผ rac-scan.pchyun.com ์œผ๋กœ ๋“ฑ๋กํ•˜์˜€์Šต

๋‹ˆ๋‹ค.

scan ์—†์ด ์ด์ ‚ ๋ฒ„์ ‚ ๋ฐฉ์‹์œผ๋กœ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์ง€๋งŠ EM(Enterprise Manager)๋ฅผ ์‚ฌ์šฉํ•˜๊ธฐ ์œ„ํ•ด์„œ๋Š”

๋ฐ˜๋“ฏ์ด SCAN ์„ค์ •์ด ํ•„์š”ํ•จ.

7.1.2. Kernel Sysctl Configuration

/etc/sysctl.conf ํŒŒ์ผ์— Orcle์„ ๊ธฐ์ข…ํ•˜๊ธฐ ์œ„ํ•œ OS Kernel ๊ฐ’์„ ๊ฐ ๋…ธ๋“œ์— ์ˆ˜์ • ํ•œ ํ›„

์ ์šฉํ•˜์—ฌ์•ผ ํ•˜์ง€๋งŠ Oracle Linux๋Š” ๊ธฐ๋ณธ์ ์œผ๋กœ Oracle DB์— ํ•„์š”ํ•œ ๊ฐ’์ด ์…‹ํŒ…์ด ๋˜์–ด

์žˆ์Šต๋‹ˆ๋‹ค. ๋ณ€๊ฒฝ ํ•  ๋‚ด์šฉ์ด ์žˆ์œผ๋ฉด ๋ณ€๊ฒฝ์„ ํ•œ ํ›„ sysctl โ€“p ๋ช…๋ น์–ด๋กœ ๋ณ€๊ฒฝ๋œ ์„ค์ • ์‚ฌํ•ญ

์„ ์ ์šฉํ•ฉ๋‹ˆ๋‹ค.

fs.aio-max-nr = 1048576

fs.file-max = 6815744

kernel.shmall = 2097152

kernel.shmmni = 4096

kernel.sem = 2700 32000 100 128

net.ipv4.ip_local_port_range = 9000 65500

net.core.rmem_default = 262144

net.core.rmem_max = 4194304

net.core.wmem_default = 262144

net.core.wmem_max = 1048586

kernel.shmmax = 8589934592

7.1.3. User resource limit ์„ค์ •

/.etc/security/limits.conf ์— OS User ์— ์„ค์ •๋  Limit ๊ฐ’์„ ์กฐ์ •ํ•ฉ๋‹ˆ๋‹ค. Oracle Linux ๋Š”

oracle User์— ๋Œ€ํ•ด์„œ๋งŠ ์…‹ํŒ…์ด ๋˜์–ด ์žˆ์œผ๋ฏ€๋กœ grid User ์— ๋Œ€ํ•ด ๊ฐ’์„ ์„ค์ • ํ•ด์ค๋‹ˆ๋‹ค.

(root ์‚ฌ์šฉ์ž๋กœ ์–‘์ชฝ๋…ธ๋“œ ๋ชจ๋‘ ์ˆ˜ํ–‰ํ•จ.)

oracle soft nofile 131072

oracle hard nofile 131072

oracle soft nproc 131072

Page 56: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 56 -

limit ์„ค์ •์ด user login ํ›„์— ์ ์šฉ ๋  ์ˆ˜ ์žˆ๋„๋ก pam ์— ๋“ฑ๋ก ํ•จ.

/etc/pam.d/login ์— ์•„๋ž˜ ํ•ญ๋ชฉ์„ ์ถ”๊ฐ€ ํ•ฉ๋‹ˆ๋‹ค.

(root ์‚ฌ์šฉ์ž๋กœ ์–‘์ชฝ๋…ธ๋“œ ๋ชจ๋‘ ์ˆ˜ํ–‰ํ•จ.)

session required /lib/security/pam_limits.so

7.1.4. NTP ์„ค์ •

11g r2 RAC ๋ถ€ํ„ฐ Time ๋™๊ธฐํ™”๋ฅผ ์œ„ํ•ด ๋‘๊ฐ€์ง€ ์ข…๋ฅ˜์˜ ์„ค์ •๋ฒ•์ด ์กฒ์žฌํ•ฉ๋‹ˆ๋‹ค.

โ— NTP ๋ฅผ ์ด์šฉํ•  ๊ฒฝ์šฐ

NTP ๋ฅผ ์ด์šฉํ•˜์—ฌ cluster node ๊ฐ‚ Time ๋™๊ธฐํ™”๋ฅผ ์ˆ˜ํ–‰ํ•˜๋Š” ๊ฒƒ์œผ๋กœ ๋ฐ˜๋“ฏ์ด โ€“x ์˜ต์…˜์œผ๋กœ ntp ๋ฅผ

์‚ฌ์šฉํ•ด์•ผํ•จ.

/etc/sysconfig/ntpd ์— ์•„๋ž˜์™€ ๊ฐ™์ด โ€œ-xโ€ ์˜ต์…˜์„ ์ถ”๊ฐ€ํ•œ ํ›„ ntp service ๋ฅผ restart ํ•จ

โ— NTP ๋ฅผ ์ด์šฉํ•˜์ง€ ์•Š๋Š” ๊ฒฝ์šฐ

NTP ๋ฅผ ์ด์šฉํ•˜์ง€ ์•Š๋Š” ๊ฒฝ์šฐ Grid Infrastructure ์—์„œ๋Š” CTSSD daemon ์„ ํ†ตํ•ด ์ž์ฒด์ ์œผ๋กœ ๋™

๊ธฐํ™”๋ฅผ ์ˆ˜ํ–‰ํ•จ. ๋”ฐ๋กœ ์„ค์ •์ด ํ•„์š”์—†์Œ.

์—ฌ๊ธฐ์„œ๋Š” NTP ์ด์šฉํ•˜์ง€ ์•Š๊ณ  CTSSD ์ด์šฉํ•˜๊ธฐ๋กœ ํ•ฉ๋‹ˆ๋‹ค.

7.1.5. User Shell Configuration

grid , oracle ์‚ฌ์šฉ์ž์˜ shell ํ™–๊ฒฝ์„ ์„ค์ •ํ•จ.

( ๊ฐ ์‚ฌ์šฉ์ž๋กœ ์•„๋ž˜์™€ ๊ฐ™์ด ๊ฐ๊ฐ ์„ค์ •ํ•จ.)

oracle hard nproc 131072

oracle soft core unlimited

oracle hard core unlimited

oracle soft memlock 3500000

oracle hard memlock 3500000

grid soft nofile 131072

grid hard nofile 131072

grid soft nproc 131072

grid hard nproc 131072

grid soft core unlimited

grid hard core unlimited

grid soft memlock 3500000

grid hard memlock 3500000

Page 57: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 57 -

grid user

rac1 rac2

# .bash_profile

# Get the aliases and functions

if [ -f ~/.bashrc ]; then

. ~/.bashrc

fi

# User specific environment and startup programs

PATH=$PATH:$HOME/bin:/bin:/sbin:/usr/bin:/usr/sbin:/us

r/local/bin:/usr/local/sbin

export PATH

export GRID_HOME=/app/grid/ 11.2.0.2

export ORACLE_SID=+ASM1

export

PATH=$GRID_HOME/bin:$GRID_HOME/OPatch:$PATH

export ORACLE_HOME=/app/grid/ 11.2.0.2

export DISPLAY=192.168.*.*:0.0

if [ $USER = "oracle" ] || [ $USER = "grid" ]; then

if [ $SHELL = "/bin/ksh" ]; then

ulimit -p 16384

ulimit -n 65536

else

ulimit -u 16384 -n 65536

fi

umask 022

fi

# .bash_profile

# Get the aliases and functions

if [ -f ~/.bashrc ]; then

. ~/.bashrc

fi

# User specific environment and startup programs

PATH=$PATH:$HOME/bin:/bin:/sbin:/usr/bin:/usr/sbin:/us

r/local/bin:/usr/local/sbin

export PATH

export GRID_HOME=/app/grid/ 11.2.0.2

export ORACLE_SID=+ASM2

export

PATH=$GRID_HOME/bin:$GRID_HOME/OPatch:$PATH

export ORACLE_HOME=/app/grid/ 11.2.0.2

export DISPLAY=192.168.*.*:0.0

if [ $USER = "oracle" ] || [ $USER = "grid" ]; then

if [ $SHELL = "/bin/ksh" ]; then

ulimit -p 16384

ulimit -n 65536

else

ulimit -u 16384 -n 65536

fi

umask 022

fi

oracle user

rac1 rac2

# .bash_profile

# Get the aliases and functions

if [ -f ~/.bashrc ]; then

. ~/.bashrc

fi

# User specific environment and startup programs

PATH=$PATH:$HOME/bin

export PATH

stty erase ^H

export ORACLE_BASE=/app/oracle

# .bash_profile

# Get the aliases and functions

if [ -f ~/.bashrc ]; then

. ~/.bashrc

fi

# User specific environment and startup programs

PATH=$PATH:$HOME/bin

export PATH

stty erase ^H

export ORACLE_BASE=/app/oracle

Page 58: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 58 -

export ORACLE_HOME=$ORACLE_BASE/11.2.0.2

export ORACLE_SID=RAC1

export ORACLE_UNQNAME=RAC

export ORACLE_TERM=xterm

export PATH=/usr/sbin:$PATH

export

PATH=$ORACLE_HOME/bin:$ORACLE_HOME/OPatch:$PA

TH

export

LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib

export

CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$

ORACLE_HOME/rdbms/jlib

export DISPLAY=192.168.6.17:0.0

if [ $USER = "oracle" ] || [ $USER = "grid" ]; then

if [ $SHELL = "/bin/ksh" ]; then

ulimit -p 16384

ulimit -n 65536

else

ulimit -u 16384 -n 65536

fi

umask 022

fi

export ORACLE_HOME=$ORACLE_BASE/11.2.0.2

export ORACLE_SID=RAC2

export ORACLE_UNQNAME=RAC

export ORACLE_TERM=xterm

export PATH=/usr/sbin:$PATH

export

PATH=$ORACLE_HOME/bin:$ORACLE_HOME/OPatch:$PA

TH

export

LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib

export

CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$

ORACLE_HOME/rdbms/jlib

export DISPLAY=192.168.6.40:0.0

if [ $USER = "oracle" ] || [ $USER = "grid" ]; then

if [ $SHELL = "/bin/ksh" ]; then

ulimit -p 16384

ulimit -n 65536

else

ulimit -u 16384 -n 65536

fi

umask 022

fi

7.1.6. SSH ์„ค์ •

RAC ์„ค์น˜๋ฅผ ์œ„ํ•ด์„œ๋Š” ์–‘ ๋…ธ๋“œ๊ฐ‚ ์„ค์น˜ ํŒŒ์ผ ์ ‚์†ก ๋ฐ ์‹คํ–‰์„ ์œ„ํ•œ password ์—†์ด ์ ‘์†์ด ๊ฐ€๋Šฅํ•ด์•ผ ํ•จ.

โ— ์–‘์ชฝ ๋…ธ๋“œ , grid , oracle user ์—์„œ ssh nodename date ๋ช…๋ น์–ด๋ฅผ ์ž…๋ ฅํ•˜์—ฌ password ์ž…๋ ฅ ์—†์ด

์ž๋™ ์‹คํ–‰ ๊ฐ€๋Šฅํ•œ์ง€ ํ™•์ธ ํ•จ.

7.2. Preparing Oracle ASM

7.2.1. ASM LIBRARY

Linux ์—์„œ ASM ๊ตฌ์„ฑ์—๋Š” ํฌ๊ฒŒ ๋‘๊ฐ€์ง€ ๋ฐฉ์‹์ด ์žˆ์Šต๋‹ˆ๋‹ค.

1) ASM with ASMLIB I/O : ASM ์ด raw block devices ๋ฅผ ASMLib ๋ฅผ ํ†ตํ•ด ์šด์˜. Raw device

์„ค์ •์ด ๋”ฐ๋กœ ํ•„์š” ์—†์Œ.

2) ASM with Standard Linux I/O : ASM์ด raw block devices ๋ฅผ Linux system I/O call ๋ฅผ ์ด์šฉ.

ASM ์ด ์‚ฌ์šฉํ•ด์•ผํ•˜๋Š” ๋ชจ๋“  partition ์— ๋Œ€ํ•ด raw device ๋ฅผ ์ƒ์„ฑ ์‹œ์ผœ ์ฃผ์–ด์•ผ ํ•จ.

โ— ์—ฌ๊ธฐ์„œ๋Š” ASMLIB ๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ๋ฐฉ์‹์œผ๋กœ ํ•ฉ๋‹ˆ๋‹ค.

Page 59: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 59 -

7.2.2. ASM Configuration

Oracle ASM Module์„ ์‚ฌ์šฉํ•˜๊ธฐ ์œ„ํ•ด์„œ๋Š” ๋ฐ˜๋“œ์‹œ configuration ์„ ํ•ด์•ผํ•จ.

์•„๋ž˜์™€ ๊ฐ™์ด asm module ์„ ์„ค์ •ํ•จ.

(root ์‚ฌ์šฉ์ž๋กœ ์–‘์ชฝ ๋…ธ๋“œ ๋ชจ๋‘ ์ˆ˜ํ–‰ํ•จ.)

rac1, rac2

[root@rac1 ~]#

[root@rac1 ~]# cd /etc/init.d

[root@rac1 init.d]# ./oracleasm configure

Configuring the Oracle ASM library driver.

This will configure the on-boot properties of the Oracle ASM library

driver. The following questions will determine whether the driver is

loaded on boot and what permissions it will have. The current values

will be shown in brackets ('[]'). Hitting <ENTER> without typing an

answer will keep that current value. Ctrl-C will abort.

Default user to own the driver interface []: grid

Default group to own the driver interface []: dba

Start Oracle ASM library driver on boot (y/n) [n]: y

Scan for Oracle ASM disks on boot (y/n) [y]: y

Writing Oracle ASM library driver configuration: done

Initializing the Oracle ASMLib driver: [ OK ]

Scanning the system for Oracle ASMLib disks: [ OK ]

[root@rac1 init.d]#

7.2.3. Create ASM VOLUME.

ASM ์„ ๊ตฌ์„ฑํ•  VOLUME DISK๋ฅผ ์ƒ์„ฑํ•˜๊ณ  ํ™•์ธํ•ฉ๋‹ˆ๋‹ค.

.

(root ์‚ฌ์šฉ์ž๋กœ rac1 ์—์„œ ์ˆ˜ํ–‰ํ•จ.)

[root@rac1 init.d]# fdisk -l

Disk /dev/sda: 55.8 GB, 55834574848 bytes

255 heads, 63 sectors/track, 6788 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

/dev/sda1 * 1 13 104391 83 Linux

/dev/sda2 14 6788 54420187+ 8e Linux LVM

Disk /dev/sdb: 5368 MB, 5368709120 bytes

255 heads, 63 sectors/track, 652 cylinders

Page 60: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 60 -

Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/sdb doesn't contain a valid partition table

Disk /dev/sdc: 21.4 GB, 21474836480 bytes

255 heads, 63 sectors/track, 2610 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/sdc doesn't contain a valid partition table

Disk /dev/dm-0: 10.7 GB, 10737418240 bytes

255 heads, 63 sectors/track, 1305 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/dm-0 doesn't contain a valid partition table

Disk /dev/dm-1: 34.2 GB, 34225520640 bytes

255 heads, 63 sectors/track, 4161 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/dm-1 doesn't contain a valid partition table

Disk /dev/dm-2: 10.7 GB, 10737418240 bytes

255 heads, 63 sectors/track, 1305 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/dm-2 doesn't contain a valid partition table

[root@rac1 init.d]#

[root@rac1 init.d]# fdisk /dev/sdb

Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel

Building a new DOS disklabel. Changes will remain in memory only,

until you decide to write them. After that, of course, the previous

content won't be recoverable.

Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

Command (m for help): p

Disk /dev/sdb: 5368 MB, 5368709120 bytes

255 heads, 63 sectors/track, 652 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

Page 61: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 61 -

Command (m for help): n

Command action

e extended

p primary partition (1-4)

p

Partition number (1-4): 1

First cylinder (1-652, default 1):

Using default value 1

Last cylinder or +size or +sizeM or +sizeK (1-652, default 652):

Using default value 652

Command (m for help): w

The partition table has been altered!

Calling ioctl() to re-read partition table.

Syncing disks.

[root@rac1 init.d]# fdisk /dev/sdc

Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel

Building a new DOS disklabel. Changes will remain in memory only,

until you decide to write them. After that, of course, the previous

content won't be recoverable.

The number of cylinders for this disk is set to 2610.

There is nothing wrong with that, but this is larger than 1024,

and could in certain setups cause problems with:

1) software that runs at boot time (e.g., old versions of LILO)

2) booting and partitioning software from other OSs

(e.g., DOS FDISK, OS/2 FDISK)

Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

Command (m for help): p

Disk /dev/sdc: 21.4 GB, 21474836480 bytes

255 heads, 63 sectors/track, 2610 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

Command (m for help): n

Command action

e extended

p primary partition (1-4)

p

Page 62: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 62 -

Partition number (1-4): 1

First cylinder (1-2610, default 1):

Using default value 1

Last cylinder or +size or +sizeM or +sizeK (1-2610, default 2610):

Using default value 2610

Command (m for help): w

The partition table has been altered!

Calling ioctl() to re-read partition table.

Syncing disks.

[root@rac1 init.d]#

[root@rac1 init.d]# fdisk -l

Disk /dev/sda: 55.8 GB, 55834574848 bytes

255 heads, 63 sectors/track, 6788 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

/dev/sda1 * 1 13 104391 83 Linux

/dev/sda2 14 6788 54420187+ 8e Linux LVM

Disk /dev/sdb: 5368 MB, 5368709120 bytes

255 heads, 63 sectors/track, 652 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

/dev/sdb1 1 652 5237158+ 83 Linux

Disk /dev/sdc: 21.4 GB, 21474836480 bytes

255 heads, 63 sectors/track, 2610 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System

/dev/sdc1 1 2610 20964793+ 83 Linux

Disk /dev/dm-0: 10.7 GB, 10737418240 bytes

255 heads, 63 sectors/track, 1305 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/dm-0 doesn't contain a valid partition table

Disk /dev/dm-1: 34.2 GB, 34225520640 bytes

255 heads, 63 sectors/track, 4161 cylinders

Page 63: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 63 -

Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/dm-1 doesn't contain a valid partition table

Disk /dev/dm-2: 10.7 GB, 10737418240 bytes

255 heads, 63 sectors/track, 1305 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/dm-2 doesn't contain a valid partition table

[root@rac1 init.d]#

[root@rac1 init.d]# cd

[root@rac1 ~]#

[root@rac1 ~]#

[root@rac1 ~]# oracleasm createdisk CRS /dev/sdb1

Writing disk header: done

Instantiating disk: done

[root@rac1 ~]# oracleasm createdisk DATA /dev/sdc1

Writing disk header: done

Instantiating disk: done

[root@rac1 ~]# oracleasm listdisks

CRS

DATA

[root@rac1 ~]#

[root@rac1 ~]#

[root@rac1 ~]# cd /dev/oracleasm/disks/

[root@rac1 disks]# ls -alrt

total 0

drwxr-xr-x 4 root root 0 Jul 3 04:09 ..

drwxr-xr-x 1 root root 0 Jul 3 04:09 .

brw-rw---- 1 grid dba 8, 17 Jul 3 04:13 CRS

brw-rw---- 1 grid dba 8, 33 Jul 3 04:13 DATA

[root@rac1 disks]#

โ— ๋ฐ˜๋Œ€ํŽธ ๋…ธ๋“œ์—์„œ ASM VOL Disk๋ฅผ ์ธ์‹์‹œํ‚ค๊ณ  ์กฐํšŒํ•ฉ๋‹ˆ๋‹ค.

(root ์‚ฌ์šฉ์ž๋กœ rac2 ์—์„œ ์ˆ˜ํ–‰ํ•จ.)

[root@rac2 ~]# oracleasm scandisks

Reloading disk partitions: done

Cleaning any stale ASM disks...

Scanning system for ASM disks...

Instantiating disk "CRS"

Instantiating disk "DATA"

[root@rac2 ~]# oracleasm listdisks

Page 64: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 64 -

CRS

DATA

[root@rac2 ~]#

[root@rac2 ~]# cd /dev/oracleasm/disks

[root@rac2 disks]# ls -alrt

total 0

drwxr-xr-x 4 root root 0 Jul 3 04:09 ..

drwxr-xr-x 1 root root 0 Jul 3 04:09 .

brw-rw---- 1 grid dba 8, 17 Jul 3 04:14 CRS

brw-rw---- 1 grid dba 8, 33 Jul 3 04:14 DATA

7.3. Install requirement ํ™•์ธ

7.3.1. cluster verify utility

์„ค์น˜ ์ ‚ ๋งˆ์ง€๋ง‰์œผ๋กœ ์–‘์ชฝ ๋…ธ๋“œ์—์„œ ์„ค์น˜์— ํ•„์š”ํ•œ ๋ชจ๋“  ์„ค์ •์ด ์™„๋ฃŒ ๋˜์—ˆ๋Š”์ง€ ํ™•์ธํ•ฉ๋‹ˆ๋‹ค.

์•„๋ž˜ ๋ช…๋ น์–ด์˜ ๊ฒฐ๊ณผ๋Š” ๋ฐ˜๋“ฏ์ด ๋ชจ๋‘ ํ†ต๊ณผํ•ด์•ผ๋งŠ ์„ค์น˜ ํ•  ์ˆ˜ ์žˆ๋Š” ๊ฒƒ์€ ์•„๋‹ˆ์ง€๋งŠ ๊ถŒ๊ณ ์‚ฌํ•ญ์œผ๋กœ

๋ชจ๋‘ ํ†ต๊ณผ ํ•  ์ˆ˜ ์žˆ๋„๋ก ์ค€๋น„ํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.

(grid ์‚ฌ์šฉ์ž๋กœ rac1 ์—์„œ ์ˆ˜ํ–‰ํ•ฉ๋‹ˆ๋‹ค.).

Grid Infrastructure Media ์œ„์น˜๋กœ ์ด๋™.

[grid@rac1 grid]$ ./runcluvfy.sh stage -pre crsinst -n rac1,rac2 -verbose

Performing pre-checks for cluster services setup

Checking node reachability...

Check: Node reachability from node "rac1"

Destination Node Reachable?

------------------------------------ ------------------------

rac2 yes

rac1 yes

Result: Node reachability check passed from node "rac1"

Checking user equivalence...

Check: User equivalence for user "grid"

Node Name Comment

------------------------------------ ------------------------

rac2 passed

rac1 passed

Result: User equivalence check passed for user "grid"

Page 65: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 65 -

Checking node connectivity...

Checking hosts config file...

Node Name Status Comment

------------ ------------------------ ------------------------

rac2 passed

rac1 passed

Verification of the hosts config file successful

Interface information for node "rac2"

Name IP Address Subnet Gateway Def. Gateway HW Address MTU

------ --------------- --------------- --------------- --------------- ----------------- ------

eth0 192.168.0.120 192.168.0.0 0.0.0.0 192.168.0.1 00:0C:29:7C:99:99 1500

eth1 10.1.1.20 10.1.1.0 0.0.0.0 192.168.0.1 00:0C:29:7C:99:A3 1500

eth2 10.1.1.21 10.1.1.0 0.0.0.0 192.168.0.1 00:0C:29:7C:99:AD 1500

Interface information for node "rac1"

Name IP Address Subnet Gateway Def. Gateway HW Address MTU

------ --------------- --------------- --------------- --------------- ----------------- ------

eth0 192.168.0.110 192.168.0.0 0.0.0.0 192.168.0.1 00:0C:29:64:BF:F1 1500

eth1 10.1.1.10 10.1.1.0 0.0.0.0 192.168.0.1 00:0C:29:64:BF:FB 1500

eth2 10.1.1.11 10.1.1.0 0.0.0.0 192.168.0.1 00:0C:29:64:BF:05 1500

Check: Node connectivity of subnet "192.168.0.0"

Source Destination Connected?

------------------------------ ------------------------------ ----------------

rac2[192.168.0.120] rac1[192.168.0.110] yes

Result: Node connectivity passed for subnet "192.168.0.0" with node(s) rac2,rac1

Check: TCP connectivity of subnet "192.168.0.0"

Source Destination Connected?

------------------------------ ------------------------------ ----------------

rac1:192.168.0.110 rac2:192.168.0.120 passed

Result: TCP connectivity check passed for subnet "192.168.0.0"

Check: Node connectivity of subnet "10.1.1.0"

Source Destination Connected?

------------------------------ ------------------------------ ----------------

rac2[10.1.1.20] rac2[10.1.1.21] yes

Page 66: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 66 -

rac2[10.1.1.20] rac1[10.1.1.10] yes

rac2[10.1.1.20] rac1[10.1.1.11] yes

rac2[10.1.1.21] rac1[10.1.1.10] yes

rac2[10.1.1.21] rac1[10.1.1.11] yes

rac1[10.1.1.10] rac1[10.1.1.11] yes

Result: Node connectivity passed for subnet "10.1.1.0" with node(s) rac2,rac1

Check: TCP connectivity of subnet "10.1.1.0"

Source Destination Connected?

------------------------------ ------------------------------ ----------------

rac1:10.1.1.10 rac2:10.1.1.20 passed

rac1:10.1.1.10 rac2:10.1.1.21 passed

rac1:10.1.1.10 rac1:10.1.1.11 passed

Result: TCP connectivity check passed for subnet "10.1.1.0"

Interfaces found on subnet "192.168.0.0" that are likely candidates for VIP are:

rac2 eth0:192.168.0.120

rac1 eth0:192.168.0.110

Interfaces found on subnet "10.1.1.0" that are likely candidates for a private interconnect are:

rac2 eth1:10.1.1.20

rac1 eth1:10.1.1.10

Interfaces found on subnet "10.1.1.0" that are likely candidates for a private interconnect are:

rac2 eth2:10.1.1.21

rac1 eth2:10.1.1.11

Result: Node connectivity check passed

Checking ASMLib configuration.

Node Name Comment

------------------------------------ ------------------------

rac2 passed

rac1 passed

Result: Check for ASMLib configuration passed.

Check: Total memory

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 2.9711GB (3115400.0KB) 1.5GB (1572864.0KB) passed

rac1 2.9711GB (3115400.0KB) 1.5GB (1572864.0KB) passed

Result: Total memory check passed

Page 67: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 67 -

Check: Available memory

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 2.8517GB (2990212.0KB) 50MB (51200.0KB) passed

rac1 2.764GB (2898224.0KB) 50MB (51200.0KB) passed

Result: Available memory check passed

Check: Swap space

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 10GB (1.0485752E7KB) 2.9711GB (3115400.0KB) passed

rac1 10GB (1.0485752E7KB) 2.9711GB (3115400.0KB) passed

Result: Swap space check passed

Check: Free disk space for "rac2:/tmp"

Path Node Name Mount point Available Required Comment

---------------- ------------ ------------ ------------ ------------ ------------

/tmp rac2 / 5.3994GB 1GB passed

Result: Free disk space check passed for "rac2:/tmp"

Check: Free disk space for "rac1:/tmp"

Path Node Name Mount point Available Required Comment

---------------- ------------ ------------ ------------ ------------ ------------

/tmp rac1 / 5.3742GB 1GB passed

Result: Free disk space check passed for "rac1:/tmp"

Check: User existence for "grid"

Node Name Status Comment

------------ ------------------------ ------------------------

rac2 exists(1000) passed

rac1 exists(1000) passed

Checking for multiple users with UID value 1000

Result: Check for multiple users with UID value 1000 passed

Result: User existence check passed for "grid"

Check: Group existence for "oinstall"

Node Name Status Comment

------------ ------------------------ ------------------------

rac2 exists passed

rac1 exists passed

Result: Group existence check passed for "oinstall"

Check: Group existence for "dba"

Page 68: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 68 -

Node Name Status Comment

------------ ------------------------ ------------------------

rac2 exists passed

rac1 exists passed

Result: Group existence check passed for "dba"

Check: Membership of user "grid" in group "oinstall" [as Primary]

Node Name User Exists Group Exists User in Group Primary Comment

---------------- ------------ ------------ ------------ ------------ ------------

rac2 yes yes no N/A failed

rac1 yes yes no N/A failed

Result: Membership check for user "grid" in group "oinstall" [as Primary] failed

Check: Membership of user "grid" in group "dba"

Node Name User Exists Group Exists User in Group Comment

---------------- ------------ ------------ ------------ ----------------

rac2 yes yes yes passed

rac1 yes yes yes passed

Result: Membership check for user "grid" in group "dba" passed

Check: Run level

Node Name run level Required Comment

------------ ------------------------ ------------------------ ----------

rac2 5 3,5 passed

rac1 5 3,5 passed

Result: Run level check passed

Check: Hard limits for "maximum open file descriptors"

Node Name Type Available Required Comment

---------------- ------------ ------------ ------------ ----------------

rac2 hard 131072 65536 passed

rac1 hard 131072 65536 passed

Result: Hard limits check passed for "maximum open file descriptors"

Check: Soft limits for "maximum open file descriptors"

Node Name Type Available Required Comment

---------------- ------------ ------------ ------------ ----------------

rac2 soft 131072 1024 passed

rac1 soft 131072 1024 passed

Result: Soft limits check passed for "maximum open file descriptors"

Check: Hard limits for "maximum user processes"

Node Name Type Available Required Comment

---------------- ------------ ------------ ------------ ----------------

rac2 hard 131072 16384 passed

Page 69: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 69 -

rac1 hard 131072 16384 passed

Result: Hard limits check passed for "maximum user processes"

Check: Soft limits for "maximum user processes"

Node Name Type Available Required Comment

---------------- ------------ ------------ ------------ ----------------

rac2 soft 131072 2047 passed

rac1 soft 131072 2047 passed

Result: Soft limits check passed for "maximum user processes"

Check: System architecture

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 i686 x86 passed

rac1 i686 x86 passed

Result: System architecture check passed

Check: Kernel version

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 2.6.18-238.el5PAE 2.6.18 passed

rac1 2.6.18-238.el5PAE 2.6.18 passed

Result: Kernel version check passed

Check: Kernel parameter for "semmsl"

Node Name Configured Required Comment

------------ ------------------------ ------------------------ ----------

rac2 250 250 passed

rac1 250 250 passed

Result: Kernel parameter check passed for "semmsl"

Check: Kernel parameter for "semmns"

Node Name Configured Required Comment

------------ ------------------------ ------------------------ ----------

rac2 32000 32000 passed

rac1 32000 32000 passed

Result: Kernel parameter check passed for "semmns"

Check: Kernel parameter for "semopm"

Node Name Configured Required Comment

------------ ------------------------ ------------------------ ----------

rac2 100 100 passed

rac1 100 100 passed

Result: Kernel parameter check passed for "semopm"

Page 70: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 70 -

Check: Kernel parameter for "semmni"

Node Name Configured Required Comment

------------ ------------------------ ------------------------ ----------

rac2 142 128 passed

rac1 142 128 passed

Result: Kernel parameter check passed for "semmni"

Check: Kernel parameter for "shmmax"

Node Name Configured Required Comment

------------ ------------------------ ------------------------ ----------

rac2 4294967295 1595084800 passed

rac1 4294967295 1595084800 passed

Result: Kernel parameter check passed for "shmmax"

Check: Kernel parameter for "shmmni"

Node Name Configured Required Comment

------------ ------------------------ ------------------------ ----------

rac2 4096 4096 passed

rac1 4096 4096 passed

Result: Kernel parameter check passed for "shmmni"

Check: Kernel parameter for "shmall"

Node Name Configured Required Comment

------------ ------------------------ ------------------------ ----------

rac2 1073741824 2097152 passed

rac1 1073741824 2097152 passed

Result: Kernel parameter check passed for "shmall"

Check: Kernel parameter for "file-max"

Node Name Configured Required Comment

------------ ------------------------ ------------------------ ----------

rac2 6815744 6815744 passed

rac1 6815744 6815744 passed

Result: Kernel parameter check passed for "file-max"

Check: Kernel parameter for "ip_local_port_range"

Node Name Configured Required Comment

------------ ------------------------ ------------------------ ----------

rac2 between 9000 & 65500 between 9000 & 65500 passed

rac1 between 9000 & 65500 between 9000 & 65500 passed

Result: Kernel parameter check passed for "ip_local_port_range"

Check: Kernel parameter for "rmem_default"

Node Name Configured Required Comment

------------ ------------------------ ------------------------ ----------

Page 71: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 71 -

rac2 262144 262144 passed

rac1 262144 262144 passed

Result: Kernel parameter check passed for "rmem_default"

Check: Kernel parameter for "rmem_max"

Node Name Configured Required Comment

------------ ------------------------ ------------------------ ----------

rac2 4194304 4194304 passed

rac1 4194304 4194304 passed

Result: Kernel parameter check passed for "rmem_max"

Check: Kernel parameter for "wmem_default"

Node Name Configured Required Comment

------------ ------------------------ ------------------------ ----------

rac2 262144 262144 passed

rac1 262144 262144 passed

Result: Kernel parameter check passed for "wmem_default"

Check: Kernel parameter for "wmem_max"

Node Name Configured Required Comment

------------ ------------------------ ------------------------ ----------

rac2 1048576 1048576 passed

rac1 1048576 1048576 passed

Result: Kernel parameter check passed for "wmem_max"

Check: Kernel parameter for "aio-max-nr"

Node Name Configured Required Comment

------------ ------------------------ ------------------------ ----------

rac2 3145728 1048576 passed

rac1 3145728 1048576 passed

Result: Kernel parameter check passed for "aio-max-nr"

Check: Package existence for "make-3.81( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 make-3.81-3.el5 make-3.81( i686) passed

rac1 make-3.81-3.el5 make-3.81( i686) passed

Result: Package existence check passed for "make-3.81( i686)"

Check: Package existence for "binutils-2.17.50.0.6( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 binutils-2.17.50.0.6-14.el5 binutils-2.17.50.0.6( i686) passed

rac1 binutils-2.17.50.0.6-14.el5 binutils-2.17.50.0.6( i686) passed

Result: Package existence check passed for "binutils-2.17.50.0.6( i686)"

Page 72: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 72 -

Check: Package existence for "gcc-4.1.2( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 gcc-4.1.2-50.el5 gcc-4.1.2( i686) passed

rac1 gcc-4.1.2-50.el5 gcc-4.1.2( i686) passed

Result: Package existence check passed for "gcc-4.1.2( i686)"

Check: Package existence for "gcc-c++-4.1.2( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 gcc-c++-4.1.2-50.el5 gcc-c++-4.1.2( i686) passed

rac1 gcc-c++-4.1.2-50.el5 gcc-c++-4.1.2( i686) passed

Result: Package existence check passed for "gcc-c++-4.1.2( i686)"

Check: Package existence for "libgomp-4.1.2( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 libgomp-4.4.4-13.el5 libgomp-4.1.2( i686) passed

rac1 libgomp-4.4.4-13.el5 libgomp-4.1.2( i686) passed

Result: Package existence check passed for "libgomp-4.1.2( i686)"

Check: Package existence for "libaio-0.3.106( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 libaio-0.3.106-5 libaio-0.3.106( i686) passed

rac1 libaio-0.3.106-5 libaio-0.3.106( i686) passed

Result: Package existence check passed for "libaio-0.3.106( i686)"

Check: Package existence for "glibc-2.5-24( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 glibc-2.5-58 glibc-2.5-24( i686) passed

rac1 glibc-2.5-58 glibc-2.5-24( i686) passed

Result: Package existence check passed for "glibc-2.5-24( i686)"

Check: Package existence for "compat-libstdc++-33-3.2.3( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 compat-libstdc++-33-3.2.3-61 compat-libstdc++-33-3.2.3( i686) passed

rac1 compat-libstdc++-33-3.2.3-61 compat-libstdc++-33-3.2.3( i686) passed

Result: Package existence check passed for "compat-libstdc++-33-3.2.3( i686)"

Check: Package existence for "elfutils-libelf-0.125( i686)"

Node Name Available Required Comment

Page 73: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 73 -

------------ ------------------------ ------------------------ ----------

rac2 elfutils-libelf-0.137-3.el5 elfutils-libelf-0.125( i686) passed

rac1 elfutils-libelf-0.137-3.el5 elfutils-libelf-0.125( i686) passed

Result: Package existence check passed for "elfutils-libelf-0.125( i686)"

Check: Package existence for "elfutils-libelf-devel-0.125( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 elfutils-libelf-devel-0.137-3.el5 elfutils-libelf-devel-0.125( i686) passed

rac1 elfutils-libelf-devel-0.137-3.el5 elfutils-libelf-devel-0.125( i686) passed

Result: Package existence check passed for "elfutils-libelf-devel-0.125( i686)"

Check: Package existence for "glibc-common-2.5( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 glibc-common-2.5-58 glibc-common-2.5( i686) passed

rac1 glibc-common-2.5-58 glibc-common-2.5( i686) passed

Result: Package existence check passed for "glibc-common-2.5( i686)"

Check: Package existence for "glibc-devel-2.5( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 glibc-devel-2.5-58 glibc-devel-2.5( i686) passed

rac1 glibc-devel-2.5-58 glibc-devel-2.5( i686) passed

Result: Package existence check passed for "glibc-devel-2.5( i686)"

Check: Package existence for "glibc-headers-2.5( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 glibc-headers-2.5-58 glibc-headers-2.5( i686) passed

rac1 glibc-headers-2.5-58 glibc-headers-2.5( i686) passed

Result: Package existence check passed for "glibc-headers-2.5( i686)"

Check: Package existence for "libaio-devel-0.3.106( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 libaio-devel-0.3.106-5 libaio-devel-0.3.106( i686) passed

rac1 libaio-devel-0.3.106-5 libaio-devel-0.3.106( i686) passed

Result: Package existence check passed for "libaio-devel-0.3.106( i686)"

Check: Package existence for "libgcc-4.1.2( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 libgcc-4.1.2-50.el5 libgcc-4.1.2( i686) passed

rac1 libgcc-4.1.2-50.el5 libgcc-4.1.2( i686) passed

Page 74: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 74 -

Result: Package existence check passed for "libgcc-4.1.2( i686)"

Check: Package existence for "libstdc++-4.1.2( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 libstdc++-4.1.2-50.el5 libstdc++-4.1.2( i686) passed

rac1 libstdc++-4.1.2-50.el5 libstdc++-4.1.2( i686) passed

Result: Package existence check passed for "libstdc++-4.1.2( i686)"

Check: Package existence for "libstdc++-devel-4.1.2( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 libstdc++-devel-4.1.2-50.el5 libstdc++-devel-4.1.2( i686) passed

rac1 libstdc++-devel-4.1.2-50.el5 libstdc++-devel-4.1.2( i686) passed

Result: Package existence check passed for "libstdc++-devel-4.1.2( i686)"

Check: Package existence for "sysstat-7.0.2( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 sysstat-7.0.2-3.el5_5.1 sysstat-7.0.2( i686) passed

rac1 sysstat-7.0.2-3.el5_5.1 sysstat-7.0.2( i686) passed

Result: Package existence check passed for "sysstat-7.0.2( i686)"

Check: Package existence for "ksh-20060214( i686)"

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 ksh-20100202-1.el5_5.1 ksh-20060214( i686) passed

rac1 ksh-20100202-1.el5_5.1 ksh-20060214( i686) passed

Result: Package existence check passed for "ksh-20060214( i686)"

Checking for multiple users with UID value 0

Result: Check for multiple users with UID value 0 passed

Check: Current group ID

Result: Current group ID check passed

Starting Clock synchronization checks using Network Time Protocol(NTP)...

NTP Configuration file check started...

The NTP configuration file "/etc/ntp.conf" is available on all nodes

NTP Configuration file check passed

No NTP Daemons or Services were found to be running

PRVF-5507 : NTP daemon or service is not running on any node but NTP configuration file exists on the following

node(s):

rac2,rac1

Page 75: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 75 -

Result: Clock synchronization check using Network Time Protocol(NTP) failed

Checking Core file name pattern consistency...

Core file name pattern consistency check passed.

Checking to make sure user "grid" is not in "root" group

Node Name Status Comment

------------ ------------------------ ------------------------

rac2 does not exist passed

rac1 does not exist passed

Result: User "grid" is not part of "root" group. Check passed

Check default user file creation mask

Node Name Available Required Comment

------------ ------------------------ ------------------------ ----------

rac2 0022 0022 passed

rac1 0022 0022 passed

Result: Default user file creation mask check passed

Checking consistency of file "/etc/resolv.conf" across nodes

Checking the file "/etc/resolv.conf" to make sure only one of domain and search entries is defined

File "/etc/resolv.conf" does not have both domain and search entries defined

Checking if domain entry in file "/etc/resolv.conf" is consistent across the nodes...

domain entry in file "/etc/resolv.conf" is consistent across nodes

Checking if search entry in file "/etc/resolv.conf" is consistent across the nodes...

search entry in file "/etc/resolv.conf" is consistent across nodes

Checking file "/etc/resolv.conf" to make sure that only one search entry is defined

All nodes have one search entry defined in file "/etc/resolv.conf"

Checking all nodes to make sure that search entry is "pchyun.com rac.pchyun.com" as found on node "rac2"

All nodes of the cluster have same value for 'search'

Checking DNS response time for an unreachable node

Node Name Status

------------------------------------ ------------------------

rac2 passed

rac1 passed

The DNS response time for an unreachable node is within acceptable limit on all nodes

File "/etc/resolv.conf" is consistent across nodes

Check: Time zone consistency

Result: Time zone consistency check passed

Starting check for Huge Pages Existence ...

Check for Huge Pages Existence passed

Page 76: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 76 -

Starting check for Hardware Clock synchronization at shutdown ...

Check for Hardware Clock synchronization at shutdown passed

Pre-check for cluster services setup was unsuccessful on all the nodes.

Page 77: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 77 -

8. Oracle RAC Installation step

8.1. Grid Infrastracture Install

Grid Infrastructure ์„ค์น˜๋ฅผ ์œ„ํ•ด rac1 Node ์—์„œ grid user ๋กœ ๋กœ๊ทธ์ธ ํ›„ Grid Infrastructure

binary directory์—์„œ runInstaller ๋ฅผ ์‹คํ–‰ํ•˜์—ฌ GUI ๋ฅผ ์ด์šฉํ•˜์—ฌ ์„ค์น˜๋ฅผ ์ˆ˜ํ–‰ํ•ฉ๋‹ˆ๋‹ค.

Skip software updates ๋ฅผ ์„ ํƒํ•˜๊ณ  Next ๋ฒ„ํŠบ์„ ํด๋ฆฝ๋‹ˆ๋‹ค.

Install and Configure Oracle Grid Infrastructure for a Cluster ์„ ํƒํ•˜๊ณ  Next ๋ฒ„ํŠบ์„ ํด๋ฆฝํ•ฉ๋‹ˆ๋‹ค.

Page 78: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 78 -

Advanced Installation ์„ ํƒํ•˜๊ณ  Next ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

Korean ์ถ”๊ฐ€

Page 79: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 79 -

์•„๋ž˜์™€ ๊ฐ™์€ ๋‚ด์šฉ์„ ์ž…๋ ฅํ•œ ํ›„ Next ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

- Cluster Name : rac-scan - SCAN Name : rac-scan.pchyun.com

SCAN Port : 1521 - Configure GNS check ํ•ด์ œ

Add ๋ฒ„ํŠบ์„ ํด๋ฆญํ•˜์—ฌ ๋‹ค์Œ ์‚ฌํ•ญ์„ ์ถ”๊ฐ€ํ•ฉ๋‹ˆ๋‹ค.

- Hostname : rac1.pchyun.com , Virtual IP Name : rac1-vip.pchyun.com

Hostname : rac2.pchyun.com , Virtual IP Name : rac2-vip.pchyun.com

Page 80: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 80 -

eth0 : Public ์„ ํƒ

eth1, eth2 : Private ์„ ํƒ (11.2.0.2 ๋ถ€ํ„ฐ private interface ์˜ bonding ์„ Oracle ์ด ๊ด€์žฅ -

Redundant Interconnect Usage)

Redundant Interconnect Usage

11.2.0.2 ์ด์ ‚ ๋ฒ„์ ‚๊นŒ์ง€๋Š” Network Interface ์—์„œ ์ง์ ‘์ ์œผ๋กœ Bonding, Teaming ๋“ฑ๊ณผ ๊ฐ™์ด

์ด์ค‘ํ™”๋ฅผ ๊ด€์žฅํ–ˆ๋‹ค. 11.2.0.2 ๋ถ€ํ„ฐ๋Š” Oracle Clusterware ๋Š” Redundant Interconnect Usage

๋ผ๋Š” ๊ธฐ๋Šฅ์„ ์ œ๊ณตํ•จ์œผ๋กœ์จ multiple-listening-endpoint ๋ผ๋Š” ์•„ํ‚คํ…์ณ์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ HAIP

(Highly Available Virtual IP) ๋ผ ๋ถˆ๋ฆฌ๋Š” ๊ฐ€์ƒ์˜ IP ๋“ค์ด ๊ฐ๊ฐ์˜ private network Interface ์—

ํ• ๋‹น๋˜์–ด ๋กœ๋“œ ๋ฐœ๋ž€์‹ฑ ๋ฐ FailOver๋ฅผ ํ•ฉ๋‹ˆ๋‹ค.

Oracle Automatic Storage Management(Oracle ASM) ์„ ํƒํ•œ ํ›„ Next ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

Page 81: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 81 -

OCR, VOTE์šฉ ASM Disk Group ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค.

- Disk Group Name : CRS

Redundancy : External ( OCR, VOTE์šฉ Disk ๊ณต๊ฐ‚์œผ๋กœ Redundancy๊ฐ€ External์ธ ๊ฒฝ์šฐ

1๊ฐœ์˜ ASM Disk ํ•„์š”,

Redundancy๊ฐ€ Normal์ธ ๊ฒฝ์šฐ 3๊ฐœ์˜ ASM Disk ํ•„์š”)

ํ™”๋ฉด์— ASM Disk๊ฐ€ ๋ณด์ด์ง€ ์•Š์œผ๋ฉด โ€œChange Discovery Pathโ€ ํด๋ฆญ

Disk Discovery Path : /dev/oracleasm/disks ๋กœ ๋ณ€๊ฒฝ

Page 82: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 82 -

SYS, ASMSNMP password ์ž…๋ ฅ

Password๊ฐ€ ๊ธฐ๋ณธ ๋ณด์•ˆ์„ฑ์„ ์ถฉ์กฑ์‹œํ‚ค์ง€ ๋ชปํ•˜๋ฉด Warning ๋ฉ”์‹œ์ง€ : Yes ํด๋ฆญ

Page 83: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 83 -

IPMI๋ฅผ ์‚ฌ์šฉํ•  ๊ฒƒ์ธ์ง€ ์„ ํƒ : ์‚ฌ์šฉํ•˜์ง€ ์•Š์Œ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค.

OSDBA : dba / OSOPER : dba / OSASM : dba

Page 84: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 84 -

๊ธฐ๋ณธ group ๊ณผ ๋‹ค๋ฅธ ์„ค์ •์œผ๋กœ ๋ฐœ์ƒํ•˜๋Š” Warning ๋ฉ”์‹œ์ง€๋กœ Yes ๋ฅผ ์„ ํƒํ•œ ํ›„ ๋‹ค์Œ์œผ๋กœ ๋„˜์–ด๊ฐ‘๋‹ˆ

๋‹ค.

์„ค์น˜๋  Directory ์ •๋ณด๋ฅผ ์ž…๋ ฅํ•ฉ๋‹ˆ๋‹ค. (grid ๋Š” base ์™€ home ์œ„์น˜๋ฅผ ๋ถ„๋ฆฌํ•  ๊ฒƒ์„ ๊ถŒ๊ณ ํ•ฉ๋‹ˆ๋‹ค.)

- Oracle Base : /app/grid/base

Software Location : /app/grid/11.2.0.2

Page 85: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 85 -

์„ค์น˜ ์ ‚ requirements check

์„œ๋ฒ„๊ฐ‚ NTP ์„ค์ •์ด ์•ˆ๋˜์–ด Warning ๋ฐœ์ƒ : Ignore All ์ฒดํฌํ›„ ๋„˜์–ด๊ฐ‘๋‹ˆ๋‹ค.

Page 86: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 86 -

Summary ์ž…๋‹ˆ๋‹ค. ๋‚ด์šฉ์„ ๋ณด๊ณ  ์ž˜๋ชป๋œ ๊ตฌ์„ฑ์ด ์žˆ๋‚˜ ๋‹ค์‹œ ํ•œ๋ฒˆ ํ™•์ธํ•˜๊ณ  ๊ตฌ์„ฑ์ด ์ •์ƒ์ ์ด๋ผ๋ฉด

์„ค์น˜๋ฅผ ์‹œ์ž‘ํ•ฉ๋‹ˆ๋‹ค.

Page 87: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 87 -

์‹คํ–‰ ์ˆœ์„œ์— ์ฃผ์˜ํ•˜์—ฌ orainstRoot.sh ์™€ root.sh ๋ฅผ ์ˆ˜ํ–‰ํ•ฉ๋‹ˆ๋‹ค.

orainstRoot.sh ์ˆ˜ํ–‰

rac1:

[root@rac1 ~]# /app/grid/oraInventory/orainstRoot.sh

Changing permissions of /app/grid/oraInventory.

Adding read,write permissions for group.

Removing read,write,execute permissions for world.

Changing groupname of /app/grid/oraInventory to dba.

The execution of the script is complete.

[root@rac1 ~]#

rac2:

[root@rac2 ~]# /app/grid/oraInventory/orainstRoot.sh

Changing permissions of /app/grid/oraInventory.

Adding read,write permissions for group.

Removing read,write,execute permissions for world.

Changing groupname of /app/grid/oraInventory to dba.

The execution of the script is complete.

[root@rac1db2 oracle]#

root.sh ์ˆ˜ํ–‰

rac1:

[root@rac1 ~]# /app/grid /11.2.0.2/root.sh

Page 88: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 88 -

Running Oracle 11g root.sh script...

The following environment variables are set as:

ORACLE_OWNER= grid

ORACLE_HOME= /app/grid/11.2.0.2

Enter the full pathname of the local bin directory: [/usr/local/bin]:

Copying dbhome to /usr/local/bin ...

Copying oraenv to /usr/local/bin ...

Copying coraenv to /usr/local/bin ...

Creating /etc/oratab file...

Entries will be added to the /etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root.sh script.

โ€ฆโ€ฆ.. ์ค‘๊ฐ‚์ƒ๋žต

The inventory pointer is located at /etc/oraInst.loc

The inventory is located at /app/grid/oraInventory

'UpdateNodeList' was successful.

[root@rac1 ~]#

:rac2

[root@rac2 ~]# /app/grid/ 11.2.0.2/root.sh

Running Oracle 11g root.sh script...

The following environment variables are set as:

ORACLE_OWNER= grid

ORACLE_HOME= /app/grid/11.2.0.2

Enter the full pathname of the local bin directory: [/usr/local/bin]:

Copying dbhome to /usr/local/bin ...

Copying oraenv to /usr/local/bin ...

Copying coraenv to /usr/local/bin ...

Creating /etc/oratab file...

Entries will be added to the /etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root.sh script.

โ€ฆโ€ฆ ์ค‘๊ฐ‚์ƒ๋žต

Page 89: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 89 -

The inventory pointer is located at /etc/oraInst.loc

The inventory is located at /rac/grid/oraInventory

'UpdateNodeList' was successful.

[root@rac2 ~]#

8.2. Database Software Install

Database ์—”์ง‚ ์„ค์น˜๋ฅผ ์œ„ํ•ด rac1 Node ์—์„œ oracle user ๋กœ ๋กœ๊ทธ์ธ ํ›„ Oracle binary

directory์—์„œ runInstaller ๋ฅผ ์‹คํ–‰ํ•˜์—ฌ GUI ๋ฅผ ์ด์šฉํ•˜์—ฌ ์„ค์น˜๋ฅผ ์ˆ˜ํ–‰ํ•ฉ๋‹ˆ๋‹ค.

Page 90: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 90 -

์œ„์™€ ๊ฐ™์ด ์ฒดํฌ๋ฅผ ํ—ค์ œ ํ•œ ํ›„ Next ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

Skip software updates ๋Š” ์ฒดํฌํ•œ ํ›„ Next ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

Page 91: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 91 -

DB์ƒ์„ฑ์€ ๋‚˜์ค‘์— ํ•  ๊ฒƒ์ด๋ฏ€๋กœ Install database software only ์„ ํƒ ํ›„ Next ๋ฒ„ํŠบ์„ ํด๋ฆฝํ•ฉ๋‹ˆ๋‹ค.

RAC ๋ฅผ ์œ„ํ•œ DB ์„ค์น˜ ์ด๋ฏ€๋กœ Oracle Real Application Clusters database Installation ์ฒดํฌ ํ›„

rac1, rac2 ๋ชจ๋‘ ์ฒดํฌํ•ฉ๋‹ˆ๋‹ค.

Page 92: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 92 -

Korean ์„ ์ถ”๊ฐ€ํ•ฉ๋‹ˆ๋‹ค.

Enterprise Edition ์„ ์„ ํƒํ•˜๊ณ  Next ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

Page 93: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 93 -

์†Œํ”„ํŠธ์›จ์–ด ์„ค์น˜ ๋””๋ ‰ํ† ๋ฆฌ๋ฅผ ์ง€์ •ํ•ฉ๋‹ˆ๋‹ค.

(oracle home ์€ oracle base ์— ์œ„์น˜ํ•˜๋„๋ก ๊ถŒ๊ณ ํ•ฉ๋‹ˆ๋‹ค.)

- Oracle Base : /app/oracle

- Oracle Home : /app/oracle/11.2.0.2

OSDBA : dba / OSOPER : dba ์„ ํƒ

Page 94: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 94 -

์„ค์น˜ ์ ‚ requirements check

์„œ๋ฒ„๊ฐ‚ NTP ์„ค์ •์ด ์•ˆ๋˜์–ด Warning ๋ฐœ์ƒ : Ignore All ์ฒดํฌํ›„ ๋„˜์–ด๊ฐ‘๋‹ˆ๋‹ค.

Page 95: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 95 -

Summary ์ž…๋‹ˆ๋‹ค. ๋‚ด์šฉ์„ ๋ณด๊ณ  ์ž˜๋ชป๋œ ๊ตฌ์„ฑ์ด ์žˆ๋‚˜ ๋‹ค์‹œ ํ•œ๋ฒˆ ํ™•์ธํ•˜๊ณ  ๊ตฌ์„ฑ์ด ์ •์ƒ์ ์ด๋ผ๋ฉด

์„ค์น˜๋ฅผ ์‹œ์ž‘ํ•ฉ๋‹ˆ๋‹ค.

Root user๋กœ ์–‘์ชฝ ๋…ธ๋“œ์— root.sh ๋ฅผ ์ˆ˜ํ–‰ํ•ฉ๋‹ˆ๋‹ค.

Page 96: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 96 -

์„ค์น˜ ์™„๋ฃŒ

8.3. ACFS ๊ตฌ์„ฑ

ACFS (Oracle ASM Cluser File System)๋Š” Oracle Home ๋˜๋Š” Non-DB Files ๋ฅผ ์ €์žฅํ•  ์ˆ˜ ์žˆ๋Š”

ASM ๊ธฐ๋ฐ˜์—์„œ ์šด์˜๋˜๋Š” ์ผ๋ฐ˜์ ์ธ cluster file system ์ž…๋‹ˆ๋‹ค. ACFS๋Š” Non-DB Files ๋ฅผ

์ €์žฅํ•œ๋‹ค๊ณ  ํ–ˆ๋Š”๋ฐ ์‹ค์งˆ์ ์œผ๋กœ DB Files๋ฅผ ๊ตฌ์„ฑํ•  ์ˆ˜ ์žˆ๋Š”์ง€ ํ™•์ธํ•ด๋ณด๋„๋ก ํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค.

ACFS ๋ฅผ ๊ตฌ์„ฑํ•˜๋„๋ก ํ•˜๊ธฐ ์œ„ํ•ด ASMCA๋ฅผ ์ˆ˜ํ–‰ํ•ฉ๋‹ˆ๋‹ค.

๋จผ์ € Diskgroup ๋ฅผ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค. Diskgoup๋ฅผ ์ƒ์„ฑํ•˜๊ธฐ ์œ„ํ•ด์„œ๋Š” ์ƒ๋‹จ 4๊ฐœ์˜ tab ์ค‘

Page 97: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 97 -

Disk Groups ๋ฅผ ์„ ํƒํ•˜๊ณ  ํ•˜๋‹จ์˜ Create ๋ฒ„ํŠบ์„ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.

์œ„์™€ ๊ฐ™์ด DATA ๋ผ๋Š” Diskgroup๋ฅผ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค.

๋‹ค์Œ์—๋Š” Volumes Tab ์œผ๋กœ ๊ฐ€์„œ Volume ๋ฅผ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค.

Page 98: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 98 -

์œ„์™€ ๊ฐ™์ด DATA1์ด๋ผ๋Š” Volume ๋ฅผ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค.

Page 99: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 99 -

ASM Cluster File Systems Tab ์œผ๋กœ ์ด๋™ํ•˜์—ฌ Create ๋ฒ„ํŠบ์„ ํด๋ฆญํ•˜์—ฌ ACFS ๋ฅผ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค.

Page 100: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 100 -

ACFS๋Š” Database Home File System ๋˜๋Š” General Purpose File System ์„ ์„ ํƒํ•  ์ˆ˜

์žˆ์Šต๋‹ˆ๋‹ค.. Database home file system ์„ ์„ ํƒํ•˜๋ฉด Grid Infrastructure์— resource๋กœ ๋“ฑ๋ก๋˜์–ด์ ธ

๊ด€๋ฆฌ๋˜์–ด์ง‘๋‹ˆ๋‹ค.,์—ฌ๊ธฐ์„œ๋Š” Database File ์„ ์ €์žฅํ•  ๊ฒƒ์ด๋ฏ€๋กœ General Purpose File System ์„

์„ ํƒํ•œ ํ›„ Mount Point ์œ„์น˜๋ฅผ ์ •ํ•ด ACFS ์ƒ์„ฑ์„ ์™„๋ฃŒํ•ฉ๋‹ˆ๋‹ค.

Page 101: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 101 -

8.4. Database ์ƒ์„ฑ

DBCA ๋ช…๋ น์„ ํ†ตํ•ด์„œ DB๋ฅผ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค.

Page 102: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 102 -

Oracle Real Application Clusters (RAC) database ๋ฅผ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค.

Create Database๋ฅผ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค.

Page 103: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 103 -

General Purpose or Transaction Processing ๋ฅผ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค.

๋‹ค์Œ์— Server Pool (Policy-Managed) ์— ๋Œ€ํ•ด ์•Œ์•„๋ณด๊ธฐ ์œ„ํ•ด Policy-Managed ๋ฅผ

์ฒดํฌํ•œํ›„ ๋‹ค์Œ์œผ๋กœ ๋„˜์–ด๊ฐ‘๋‹ˆ๋‹ค.

Page 104: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 104 -

EM ๊ตฌ์„ฑ์„ ํ•˜์ง€ ์•Š์„ ๊ฒƒ์ด๋ฏ€๋กœ ์ฒดํฌ๋ฅผ ํ—ค์ œํ•œ ํ›„ ๋‹ค์Œ์œผ๋กœ ๋„˜์–ด๊ฐ‘๋‹ˆ๋‹ค.

ํŒจ์Šค์›Œ๋“œ๋ฅผ ์„ค์ •ํ•ฉ๋‹ˆ๋‹ค.

Page 105: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 105 -

ํŒจ์Šค์›Œ๋“œ ๊ทœ์น™์— ์ ํ•ฉํ•˜์ง€ ์•Š์•„์„œ ๋‚˜๋Š” ๊ฒฝ๊ณ ์ด๋ฏ€๋กœ ๋ฌด์‹œํ•˜๊ณ  ๋„˜์–ด๊ฐ‘๋‹ˆ๋‹ค.

DataFile ์ด ์ €์žฅ๋  ์œ„์น˜๋ฅผ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค. ACFS ์— ์ €์žฅํ•˜๊ธฐ๋กœ ํ•˜์˜€์œผ๋‹ˆ Cluster File System ์„

์„ ํƒํ•˜๊ณ  ACFS ๋งˆ์šดํŠธํฌ์ธํŠธ๋ฅผ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค.

Page 106: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 106 -

Page 107: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 107 -

๋ฉ”๋ชจ๋ฆฌ ์„ค์ •, block ์‚ฌ์ด์ฆˆ, ํ”„๋กœ์„ธ์Šค ๊ฐœ์ˆ˜ ๋ฐ ์ผ€๋ฆญํ„ฐ์…‹ ์„ค์ •๋“ฑ์„ ํ•œ ํ›„ ๋‹ค์Œ์œผ๋กœ ๋„˜์–ด๊ฐ‘๋‹ˆ๋‹ค.

Database๋ฅผ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค.

Page 108: Oracle Database 11gR2 RAC Install Step by Step on VSphere

- 108 -

์ •์ƒ์ ์œผ๋กœ ACFS์— DB Filese์ด ์ €์žฅ๋˜๋Š” ๊ฒƒ์ด ํ™•์ธ๋˜์—ˆ์œผ๋‚˜ ์–ด๋–ค ๋ฌธ์ œ๊ฐ€ ์žˆ์„์ง€๋Š” ๋ง‹์€

ํ…Œ์ŠคํŠธ๊ฐ€ ํ•„์š”ํ•  ๊ฒƒ์œผ๋กœ ๋ณด์ž…๋‹ˆ๋‹ค.