building active/passive clusters with oracle fusion middleware 11g
TRANSCRIPT
![Page 1: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/1.jpg)
1 (2.1h)
Building Active/Passive Clusters with Oracle Fusion Middleware 11g
Simon Haslam
Veriton Limited
![Page 2: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/2.jpg)
2 (2.1h)
Simon Haslam / VeritonSpecialised consultant & Oracle Partner, established for 14 years
Demanding web & call-centre applications
Architecture & development strategy; health-checks; disaster recovery; tuning
Oracle Fusion Middleware(clusters, J(2)EE, ADF, SSO, OID, Reports, etc)ADF Application (esp. strategy & admin)
Database & related technologies(OS, load balancers, firewalls, …)
![Page 3: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/3.jpg)
3 (2.1h)
Agenda
� CFC & High Availability Concepts
� Setting up Fusion Middleware 11g for CFC
� Installation Approach for ASCRS
![Page 4: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/4.jpg)
4 (2.1h)
Why Cluster?
• Higher Availability
• Scalability
�
Active Active
Active Passive
Active Active ActiveActive
![Page 5: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/5.jpg)
5 (2.1h)
Active - Active
databases etc
Node 1 Node 2
loadbalancers
web/apptier
infrastructuretier
Note: no firewalls etc shown!
clients
�
![Page 6: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/6.jpg)
6 (2.1h)
Active – Passive
databases etc
Node 2Node 1
�
![Page 7: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/7.jpg)
7 (2.1h)
Active-Passive Pros/Cons
�Licensing– OFM is only running on one node at once
– no licence req. on standby if <10 days’ usage pa
�Hardware/skills: no load balancer required
�Provides protection from node failure
�Can standardise across all sorts of systems
� ‘Unused’ standby server (test etc though)
� Failover time & loss of sessions
�Needs shared storage
�
![Page 8: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/8.jpg)
8 (2.1h)
Oracle’s Software Investment Guide
Failover – In this type of recovery, nodes are arranged in a cluster and share one disk array... When the primary node fails, one of the surviving nodes in the cluster acts as the primary node.Solutions like Oracle Failsafe (…), or third party vendor solutions (e.g. Veritas, HP Service Guard, HACMP, Linux HA - Heartbeat) are used to manage Failover environments. In this type of environment, Oracle permits licensed Oracle customers to run some Technology Programs on an unlicensed spare computer for up to a total of ten separate days in any given calendar year.Once the primary node is repaired, you must switch back to the primary node. Once the failover period has exceeded ten days, the failover node must belicensed…Downtime for maintenance purposes counts towards the ten separate days limitation.
November 2009, http://www.oracle.com/us/corporate/pricing/sig-070616.pdf
�
![Page 9: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/9.jpg)
9 (2.1h)
A/P plus P/A
databases etc
Node 1Web-tier (A)
AS (P)
Node 2Web-tier (P)
AS (A)
Better use of hardware, but maybe not licences.Various permutationsbut often end up going A/A
Both nodes needto be licenced
�
![Page 10: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/10.jpg)
10 (2.1h)
?
Why use Cluster Software?
• A cluster needs:
– communication between nodes
– to know what nodes are available
– coordinated start-up and shutdown
• There are several popular commercial and open-source cluster managers. You could write your own……or just manually do it!
�
![Page 11: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/11.jpg)
11 (2.1h)
Cluster Software Requirements
• VIP Management
• Filesystem Management
• Application Startup/Shutdown
VIP
AS
FS
App Server depends on VIP & Filesystem
�
![Page 12: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/12.jpg)
12 (2.1h)
What is a VIP?
• a ‘floating’ IP address which canexist on any node in cluster
• only active on one node at once
• is only moved in case of failure/shutdown of the node it’s currently running on
• each Virtual IP (VIP) has a corresponding Virtual Hostname (Vhost), e.g.
– Node 1: pwls1.lon.example.com
– Node 2: pwls2.lon.example.com
– Virtual host: store.example.com
‘public’ view
�
![Page 13: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/13.jpg)
13 (2.1h)
Interconnect(typ. ethernet)
Architecture & Processing
Shared storage (e.g. SAN or NAS)
Node 1 Node 2
public network (ethernet)
Fibre, Ethernet, Infiniband
Cluster Software Cluster Software
OracleSoftware & Configuration
VIP
AS
FS
?
VIP
FS
AS
�
![Page 14: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/14.jpg)
14 (2.1h)
By the way…
• There are other ways to do active/passive failover:
– (WLS itself) Whole Server Migration
– Virtual Machines
�
![Page 15: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/15.jpg)
15 (2.1h)
Overall Process
• Install cluster management software
• Configure cluster resources for:
– virtual hostname and virtual IP address
– filesystem for Oracle Home
• Install Oracle Fusion Middleware
– 10g iAS: specify the Vhost/VIP
– 11g OFM: reconfiguration
• Set up cluster resource for running OFM
�
![Page 16: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/16.jpg)
16 (2.1h)
3rd Party Clusterware
• Install & set-up (typically done by sys. admin)
�
![Page 17: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/17.jpg)
17 (2.1h)
History: 10g App Server
• iAS 10.1.2
– Set in installer HA screen
or
– ORACLE_HOMENAME env variable
– OUI_HOSTNAME command line option
• OAS 10.13
– VIRTUAL_HOST_NAME env variable
– OUI_HOSTNAME command line option
�
![Page 18: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/18.jpg)
18 (2.1h)
11gR1
• OFM 11gR1 High Availability Guide says to create a CFC:
– “Transform the Administration Server or Enterprise Manager instance
– Transform all managed servers in the deployment
– Transform the Oracle instances (non-Java EE deployments)”
�
![Page 19: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/19.jpg)
19 (2.1h)
Why do I have to ‘Transform’the Admin Server
• Singleton service – runs in only one place at once
• Rest of env is usually A-A and often have dedicated management server including AS
�
![Page 20: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/20.jpg)
20 (2.1h)
12.2.2.312.2.2.312.2.2.312.2.2.3 Transforming the Administration Transforming the Administration Transforming the Administration Transforming the Administration Server for Cold Failover ClusterServer for Cold Failover ClusterServer for Cold Failover ClusterServer for Cold Failover Cluster
• Create a Machine in the first domain called <Vhost>
• Associate admin (and any managed servers) with the new Machine
• Change the Listen Address of the Admin Server to <Vhost> & restart it
�
![Page 21: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/21.jpg)
21 (2.1h)
12.2.2.312.2.2.312.2.2.312.2.2.3 Transforming the Administration Transforming the Administration Transforming the Administration Transforming the Administration Server for Cold Failover Cluster (contd.)Server for Cold Failover Cluster (contd.)Server for Cold Failover Cluster (contd.)Server for Cold Failover Cluster (contd.)
• Change any existing Oracle Instances to point to admin server on <Vhost> - change the OPMN instance.properties for each
• Change any EM agents to refer to EM FMC running on <Vhost> (two params) & restart
�
![Page 22: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/22.jpg)
22 (2.1h)
12.2.2.412.2.2.412.2.2.412.2.2.4 Transforming Oracle WebLogic Transforming Oracle WebLogic Transforming Oracle WebLogic Transforming Oracle WebLogic Managed ServersManaged ServersManaged ServersManaged Servers
• If managed servers on CFC host then on each change Listen Address to <Vhost> & restart
�
![Page 23: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/23.jpg)
23 (2.1h)
12.2.2.512.2.2.512.2.2.512.2.2.5 Transforming Node ManagerTransforming Node ManagerTransforming Node ManagerTransforming Node Manager
• “Decide whether you want to fail over the node manager, or have one running all the time on each node”
– If using ASCRS then NM config must be under WL_HOME � will move � NM must failover
• Change the node manager properties file to set ListenAddress to <Vhost>. Restart NM
�
![Page 24: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/24.jpg)
24 (2.1h)
12.2.2.612.2.2.612.2.2.612.2.2.6 Transforming Oracle Process Transforming Oracle Process Transforming Oracle Process Transforming Oracle Process Management and Notification ServerManagement and Notification ServerManagement and Notification ServerManagement and Notification Server
• If OPMN already registered with Admin Server (likely if you wanted to test your installation) then update to <Vhost>
– topology.xml
– opmn.xml
– instance.properties
�
![Page 25: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/25.jpg)
25 (2.1h)
12.2.2.712.2.2.712.2.2.712.2.2.7 Transforming Oracle Enterprise Transforming Oracle Enterprise Transforming Oracle Enterprise Transforming Oracle Enterprise Manager for an Oracle InstanceManager for an Oracle InstanceManager for an Oracle InstanceManager for an Oracle Instance
• You probably have Oracle instances, e.g. Web-Tier, OID etc, update:
– emd.properties
– targets.xml
• Restart agent
• Change the targets.xml in the domain/sysman/state directory of the Admin Server
�
![Page 26: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/26.jpg)
26 (2.1h)
12.2.2.812.2.2.812.2.2.812.2.2.8 Transforming Web Tier Transforming Web Tier Transforming Web Tier Transforming Web Tier Components and ClientsComponents and ClientsComponents and ClientsComponents and Clients
• Change Listen to <Vhost> in httpd.conf & restart
�
![Page 27: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/27.jpg)
27 (2.1h)
12.2.312.2.312.2.312.2.3 Transforming Oracle Fusion Transforming Oracle Fusion Transforming Oracle Fusion Transforming Oracle Fusion Middleware ComponentsMiddleware ComponentsMiddleware ComponentsMiddleware Components
• …
�
![Page 28: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/28.jpg)
28 (2.1h)
Pros & Cons
� Tedious work for something that, at least at installation time, should be easy
�At least it’s in main documentation
� You can convert to CFC at a future point
�transform WebLogic to CFC as soon as possible
– make AdminServer listen on VIP from start (e.g. during domain creation), i.e. before installing EM, Web-tier, etc
– transform other installs as you go along
�
![Page 29: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/29.jpg)
29 (2.1h)
• Now you can choose your clusterware…
�
![Page 30: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/30.jpg)
30 (2.1h)
ASCRS
• Wrapper around Oracle Clusterware (aka CRS)• Perl/java calling WLST etc• New in 11gR1• Manages resources:
– VIP– Shared Disk– Application Server/Middleware– (Database & Listener…)
• Most suitable if you don’t have 3rd party clusterware but have RAC experience
�
![Page 31: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/31.jpg)
31 (2.1h)
Oracle Clusterware Key Components
• Network
– Public network
– Interconnect (private)
• Shared storage
– Oracle Cluster Registry (OCR)
– Voting Disk
�
![Page 32: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/32.jpg)
32 (2.1h)
Interconnect(typ. ethernet)
Base Oracle Clusterware
Shared storage (e.g. SAN or NAS)
Node 1 Node 2
public network (ethernet)
Fibre, Ethernet, Infiniband
Clusterware
�
Clusterware
OCR Voting Disk
CRS_HOMEon local disk
CRS_HOMEon local disk
![Page 33: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/33.jpg)
33 (2.1h)
• Install Oracle Clusterware 11gR1
• Copy <ascrs> directory from OFM 11g Companion DVD into the CRS_HOME
�
![Page 34: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/34.jpg)
34 (2.1h)
Interconnect(typ. ethernet)
Oracle Clusterware plus ASCRS
Shared storage (e.g. SAN or NAS)
Node 1 Node 2
public network (ethernet)
Fibre, Ethernet, Infiniband
Clusterware
�
Clusterware
OracleSoftware & Configuration
OCR Voting Disk
CRS_HOMEon local disk
CRS_HOMEon local disk
ASCRS ASCRS
![Page 35: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/35.jpg)
35 (2.1h)
Example – Create VIP
ascrsctl create -name cluster4 -type vip \-ipAddr cluster4-vip -netmask 255.255.255.0 -interface eth0
Prompted as root to run:/opt/grid/crs1110/crs/public/ora.cluster4.cfcvip.cre.root
�
![Page 36: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/36.jpg)
36 (2.1h)
Example – Create Shared Disk
touch /opt/oracle/.ascrssfumount /opt/oracle
ascrsctl create -n cluster4 -type disk -path /opt/oracle \-mc “<your script*> start /opt/oracle /dev/sdc1“ \-umc “<your script*> /opt/oracle /dev/sdc1“
Prompted to run as root:/opt/grid/crs1110/crs/public/ora.cluster4.cfcdisk.cre.root
* Don’t just use mount / umount – write a script to check usage, fsck etc and install under CRS_HOME! e.g.
/opt/grid/crs1110/crs/public/veriton_cfc_orahome.sh
�
![Page 37: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/37.jpg)
37 (2.1h)
Example – Create AS Resource
ascrsctl create -n adminserver -type as \-ch /opt/oracle/user_projects/domains/cfc \-disk cluster4 -vip cluster4
�
![Page 38: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/38.jpg)
38 (2.1h)
Status & Management
$ ascrsctl status |egrep "cfc|Name|---"
Name Type Target State-----------------------------------------------------------------------------------ora.adminserver.cfcas WebLogic Domain ONLINE ONLINE on westfield37ora.cluster4.cfcdisk Shared Disk ONLINE ONLINE on westfield37ora.cluster4.cfcvip Virtual IP ONLINE ONLINE on westfield37
ascrsctl start –n ora.adminserver.cfcas
ascrsctl stop –n ora.adminserver.cfcas
ascrsctl switch –n ora.adminserver.cfcas
�
![Page 39: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/39.jpg)
39 (2.1h)
ASCRS notes
• Unix only
• Docn now says ASCRS supports Oracle Clusterware 10.2.0.4 or 11.1.0.7+– Big clusterware packaging changes in Database 11gR2…
next?
• ASCRS is supported only on Unix platforms
• The ASCRS installation user account should be the same as the owner of the CRS home
• Decide on naming strategy along with database products– with db 11.2 "grid" is becoming common practice
�
![Page 40: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/40.jpg)
40 (2.1h)
Summary
• Cold-failover cluster provides fair resilience for unattended recovery from failures
• Additional costs = minimal:– no extra Oracle licences/support
– extra server (maybe with HBA or iSCSI)
– time/effort to install
• You will need shared storage (e.g. SAN/NAS)
�cost-sensitive projects where availability is important but load doesn’t justify multiple active servers
�Standardised HA across broad IT environments
![Page 41: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/41.jpg)
41 (2.1h)
References
• Oracle® Fusion Middleware High Availability Guide11g Release 1 (11.1.1)
http://download.oracle.com/docs/cd/E12839_01/core.11
11/e10106/ap_crs.htm#CHDHGHBD
![Page 42: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/42.jpg)
42 (2.1h)
Shameless Plug!
• UKOUG App Server & Middleware SIGWed 2nd March 2011
– Theme: Fusion Middleware 11g Upgrade
– Dual venue… speakers at both plus broadcast
• Oracle City Office, London
• Fujitsu Office, Warrington
– 1 FREE place for most UKOUG membership packages
![Page 43: Building Active/Passive Clusters with Oracle Fusion Middleware 11g](https://reader034.vdocument.in/reader034/viewer/2022042611/58a2ef9f1a28ab724d8b9661/html5/thumbnails/43.jpg)
43 (2.1h)
Any questions ?
Thank you for listening !
Blog: simonhaslam.co.uk