deploy oracle rac 12c in minutes - aioug
TRANSCRIPT
Deploy Oracle RAC 12c
in minutes
P Sai JanakiramNovember 9th, 2013
2
Sai Janakiram Penumuruo Ten years in Oracle DBA / Oracle Apps DBA o Currently : WW Product Expert, Cloud Platform in hpo Founding Member of AIOUG, Currently- Director of Financeo Oracle Database 12c Beta Testero Oracle VM SIG Lead www.oraclevmsig.orgo Blogs: www.oadba.com, www.oracle12c.info
3
Virtualization allows multiple operating system instances to run concurrently on a
single computer; it is a means of separating hardware from a single operating system
Type-1 Native (Bare Metal)Oracle VMMicrosoft Hyper-V, VMWare ESX
Type-2 HostedVirtualBoxVMWare Server and Workstation, Microsoft Virtual PC, KVM
A hypervisor, also called a virtual machine manager (VMM), is a program that allows multiple operating systems to
share a single hardware host.
What is Virtualization?
Reasons to Use Virtualization• Resource optimization• Consolidation• Maximizing Uptime• Automatically Protect Applications from
Server Failure• Easily Migrate Workloads as Needs Change
Bare-metal Server Bare-metal Server
4
What is Oracle VM
Source – Oracle VM User's Guide for Release 3.2.1
Oracle VM = Oracle VM Server + Oracle VM Manager
Oracle VM is built upon Xen technology, using the Xen hypervisor.
Oracle VM Server: • providing a lightweight, secure, server platform which runs VMs.• Open source server software tailored by Oracle• Installs on “bare-metal” servers from a single CD• x86 and x86_64 based Intel and AMD Systems
Oracle VM Manager: • Manage Oracle VM Servers, virtual machines, and resources.• Web browser-based management console (command line & API also)• Java-based management server• Database repository: XE (incl.), SE, EE• Installs as guest VM (template available) or on “bare-metal” servers
5
Rapid Application Deployment
Oracle VM Templates
Oracle E-Delivery
DB/RAC File Storage - NAS, SAN, iSCSI
Server 1
Oracle VM Server Pool
Server 2 Server 3
RAC VM1
RAC VM2
EBSVM
VM VM
VM
Download from Oracle Pre-built, pre-configured VM Complete Single Instance OR Clusterware, ASM, RAC installation (11gR2 or 12c) Enterprise Manager DBControl or DBExpress in 12c
Import to Oracle VMManager
Customize & Save as Golden Images
6
History
Oracle VM Templates for Oracle Database
• 2010: Initial release with Oracle VM 2 deployment options only.
• May 2012: The deploycluster tool was released making Oracle VM 3 deployments extremely easy.
• August 2013: The templates support Single Instance, Oracle Restart and the most talked about Oracle 12c features: • Flex Cluster
• Flex ASM
• Container/Pluggable Database
7
New in 2013 releases
Deployment Modes
o The new Oracle VM Templates for Oracle Database support three deployment modes:
Single Instance Database
Database on filesystem
Oracle Restart (formerly known as Single Instance/HA)
Database on ASM or filesystem (in 12c can be in ACFS)
Oracle RAC
Database on ASM or shared filesystem (in 12c can be in ACFS)
o In addition, Clusterware-only mode available
Applicable to Oracle RAC and Oracle Restart
No Database installed, DB Home may be removed (reduced memory/disk)
8
Oracle RAC
Deployment Configuration
• Oracle RAC has two types of deployments
Production Oracle RAC OVM Configurations [Supported]
o Each RAC node must be deployed on a separate physical server
o Shared database disks must be on physical disks
Test Oracle RAC OVM Configurations
o Above requirements are relaxed
o Templates support both configurations, each has its own installation guide to help with steps
o Single Instance deployment has no such requirements
9
Availability
Oracle VM Templates for Oracle Database
• Currently available for 12.1.0.1.0 (64 bit only), 11.2.0.4.0, 11.2.0.3.7, 11.2.0.2.11, 11.2.0.3.2, 11.2.0.2.6, 11.2.0.3.0, 11.2.0.2.2, 11.2.0.2.0, 11.2.0.1.4, 11.2.0.1.2 ,11.1.0.7.6, 11.1.0.7.2 on Oracle Linux 32 and 64 bits
• Download from e-delivery or My Oracle Support Note:1185244.1: https://support.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=1185244.1
• Templates are distributed as archive files containing two disk images • Oracle Linux 5 U4/U5/U6/U7/U8/U9 & OL6U2/U4 system disk
• OL5U8, OL6U2 and higher are OVMAPI enabled (Deploycluster)
• 11.2.0.2.11, 11.2.0.3.7, 11.2.0.4.0, 12.1.0.1.0 and higher have Single Instance support
• Oracle disk image (Clusterware, Database, ASM)
• Suitable for Single Instance or RAC
• All homes updated to latest Bundle / CPU Patch level
• Entire install is automated, with the user only providing minimal input
10
Delivery Mechanism
Oracle VM Templates for Oracle Database
• 32 bit and 64bit versions
• Image files are built with ‘sparse file’ support
• Inside each zip are tgz/tbz archives with the following files: • VM Config file (text file)
• Opatch lsinventory sample output
• README / PDFs for installing
• Disk 1 image file: Operating System
• Disk 2 image file: Oracle Software
• Includes Clusterware, ASM & RAC (suitable for Single Instance)
• Follow the instructions in provided PDF files or document for the new DeployClustertool
11
High-level Workflow
Oracle VM Templates for Oracle Database
• Step 1 Download Template 32/64bits 11.1/11.2/12.1
• Step 2 Register/Import Template with Oracle VM Manager
• Step 3 Create VM(s); Single Instance: 1 VM, RAC: 2+ VMs
• Step 4 (Shared) Storage; Single Instance disks are optional • For Non Production: Create Shared Disk using OVM Manager
• Assigned Shared disk to all Guest VMs using OVM Manager
• For Production Deployment: Identify Physical Shared Disk
• OVM2: Update all Guest VM’s vm.cfg files with location of shared disk
• OVM3: Attach physical disks using Oracle VM Manager
• Step 5 Boot all VMs or use Deploycluster tool and skip Step 6
• Step 6 Run buildcluster/buildsingle to Configure and build the environment
12
Non-Production deployment
Oracle VM Templates for Oracle Database
X86/64 Bare-Metal Server (CPU, Memory, Storage)
Dom-0 Hypervisor
Dom0 OS
Listener
Single Instance Database
Operating System
Guest VM• Single Instance • Minimum Requirements
• One core • 2GB of memory or more • 30GB of disk or more
13
Single Instance deployment
Oracle VM Templates for Oracle Database
X86/64 Bare-Metal Server (CPU, Memory, Storage)
Dom-0 Hypervisor
Dom0 OS
Shared Cache /RAC
• 2-node Test Oracle 12c RAC• Minimum Requirements
• Two or more cores• 4GB of memory or more• 30GB of disk or more
Instance 1
Oracle Clusterware
Operating System
Guest VM
Listener
Oracle ASM
Service
Instance 2
Oracle Clusterware
Operating System
Guest VM
Listener
Oracle ASM
Service
14
Production deployment
Oracle VM Templates for Oracle Database
X86/64 Bare-Metal Server (CPU, Memory, Storage)
Dom-0 Hypervisor
Dom0 OS
Shared Cache /RAC
Guest VM
Instance 2
Oracle Clusterware
Operating System
Guest VM
Listener
Oracle ASM
Service
X86/64 Bare-Metal Server (CPU, Memory, Storage)
Dom-0Hypervisor
Dom0 OS
Instance 2
Oracle Clusterware
Operating System
Guest VM
Listener
Oracle ASM
Service
15
Building Single Instance or a Cluster
• After initial boot, to build Single Instance or a Cluster, run:
/u01/racovm/buildsingle.sh
OR:
/u01/racovm/buildcluster.sh
• Automatically builds Single Instance or a cluster based on netconfig.ini & params.ini
• Automatically writes a build log and progress log
• Internal testers report: Single Instance ~11minutes, w/o relink: 6minutes • 2 node RAC, 18 minutes
• 4 node RAC, 23 minutes
• End-to-end, including Database Creation (DBCA)
• 101-Node Flex Cluster done in ~10 hours (including OVM installation)
16
Automated Deployment
DeployCluster Tool Features
• Allows for fully automated end-to-end cluster deployment of N-node clusters• Assuming VMs are pre-created w/NICs & shared disks
• Option to simulate a deployment attempt • Use the --dryrun (-D) flag
• Allow ANY build configuration (SID name, user name, passwords, ports, etc.) to be modified from outside the guests at deploy time
• Supply a custom params.ini using --params (-P) flag \
• Easy to re-attempt a failed deployment • Only fix what failed, and leave other VMs running
17
2013 release
DeployCluster – What’s NEW
• Full support for Flex Cluster and/or Flex ASM deployments • Allows for optional 3rd network adapter (NIC)
• Support for Single Instance or Single Instance/HA (Oracle Restart) deployments
• Exclusively used to deploy the 101-Node Flex Cluster
18
Examples
DeployCluster
• List all VMs with a simple name of “racnode.?” on Manager
• $ deploycluster.py –u admin –N netconf.ini –M racnode.? -L
• Deploy all VMs with a simple name of “racnode.?”:
• $ deploycluster.py –u admin –N netconf.ini –M racnode.?
• Deploy a VM as the 3rd node in an existing cluster
• $ deploycluster.py –u admin –N netconf.ini –M racnode3 –G –n3
19
Fully automated addition and removal of nodes or instances
Adding or Removing Node(s) / Instance(s)
Simply run:
./racovm.sh -S addnodes -N node2,node3
Or:
./racovm.sh -S removenodes -N node2,node3
Or:
./racovm.sh -S addinstances -N node2,node3
Or:
./racovm.sh -S deleteinstances -N node2,node3
20
doall.sh [options] <command> | "<command1>;<command2>;..<commandX>"
doall.sh – Run command on all nodes
-l <user> : Login as user (default: current user)
-x : Run commands in sequence (default: run in parallel)
-P : Print commands as they are executed (default: noprint)
-p : Setup passwordless SSH for <user> on all nodes listed in
netconfig.ini
-s : Skip confirmation for passwordless SSH setup
-u : Skip unreachable nodes
-U : Skip nodes that are unreachable or without passwordless
SSH configured
-L first|last|skip : Local node execution order
-N <node1>,<node2> .. : Nodes to run on (default: all nodes in netconfig.ini)
Examples: ./doall.sh -L last reboot ./doall.sh -ps /u01/app/11.2.0/grid/bin/diagcollection.sh
21
Useful Links
Oracle VM Templates for Oracle Database
OTN Home pages: 12c/11gR2: http://www.oracle.com/technetwork/server-storage/vm/database-templates-12c-11gr2-1972804.html
11.1: http://www.oracle.com/technetwork/database/clustering/overview/rac-092962.html
Download Locations: From https://edelivery.oracle.com/oraclevm : 12.1.0.1, 11.2.0.1.* & 11.1.0.7.*
From My Support http://support.oracle.com/ (support subscription): 11.2.0.4.0 Patch# 14000094, 11.2.0.3.7 Patch# 14000092, 11.2.0.2.11 Patch# 14000021
11.2.0.3.2 Patch# 13818831, 11.2.0.3.0 Patch# 12694014, 11.2.0.2.6 Patch# 14000016
11.2.0.2.0 Patch# 10113572, 11.2.0.2.2 Patch# 11836831
All described in Note:1185244.1: https://support.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=1185244.1
Training Video on RAC Special Interest Group (SIG): Dates: http://www.oracleracsig.org/pls/apex/f?p=105:206:::NO
22
Useful Links
Keep Watch for SIG events
Oracle VM on oracle.com : http://www.oracle.com/virtualization
Oracle VM on the Wiki : http://wiki.oracle.com/Oracle+VM
Oracle's Virtualization Bloghttps://blogs.oracle.com/virtualization/
Wim Coekaerts Bloghttps://blogs.oracle.com/wim/
VirtualBox.orghttps://www.virtualbox.org/
http://oraclevmsig.org/
24
Backup Slides
25
Oracle VM Login Options
DeployCluster Options
-u <username>, --username=<username>
Username to connect to Oracle VM Manager
-p <password>, --password=<password>
Password to connect to Oracle VM Manager
-H <host>, --host=<host>
Manager hostname (use either -H or -U or none)
-U <url>, --url=<url>
Login URL to Manager (default: tcp://localhost:54321
or tcps://host:54322 when -H used to remote node)
26
DB/RAC OVM Template Options
DeployCluster Options
-L, --list_vms_only
List VMs seen via Oracle VM Manager; Honors -M flag
-M <List of VMs>, --vms=<List of VMs>
List of existing VM names or IDs to deploy cluster on.
Supports "*" & "?" wildcard characters
-P <params.ini>, --params=<params.ini>
Location of params.ini file (sent to VMs)
-N <netconfig.ini>, --netconfig=<netconfig.ini>
Location of netconfig.ini file (sent to VMs)
27
DB/RAC OVM Template Options (Cont’d)
DeployCluster Options
-B <yes|no>, --buildcluster=<yes|no>
Start a buildcluster/buildsingle post-network setup (default: yes.
[If netconfig_args passed then default: no])
-G <args>, --netconfig_args=<args>
Advanced: Arguments to netconfig; override defaults
-K <zip file>, --kitfile=<zip file>
Advanced: Unzip new (partial) kitfile inside the VMs
-X <file>, --extrakeys=<file>
Advanced: File containing extra keys to send all VMs
-D, --dryrunShow what will be done (do not start VMs or send msgs)