Oraclerac12ccollaboratebestpracticeswithappendices 140408185659 Phpapp01

1
Copyright 2013, Oracle and/or its affiliates. All rights reserved.
Oracle Real Application

Clusters (RAC) 12c
Collaborate Best Practices
Markus Michalewicz
Director of Product Management
Oracle Real Application Clusters (RAC)
@OracleRACpm
http://www.linkedin.com/in/markusmichalewicz
http://www.slideshare.net/MarkusMichalewicz
Safe Harbor Statement

The following is intended to outline our general product direction. It is
intended for information purposes only, and may not be incorporated
into any contract. It is not a commitment to deliver any material, code, or
functionality, and should not be relied upon in making purchasing
decisions. The development, release, and timing of any features or
functionality described for Oracles products remains at the sole
discretion of Oracle.
Agenda
Oracle RAC 12c and Standardization
Installation of Oracle Grid Infrastructure 12c
Installation of the Oracle Database Home
Oracle RAC Database Creation using DBCA
Post-install Steps and Configuration
Summary and Q&A
Appendices A-C
Oracle RAC Family of Solutions

For more information see:
http://www.slideshare.net/MarkusMichalewicz/
http://www.slideshare.net/MarkusMichalewicz/the-oracle-real-application-clusters-rac-family-of-solutions
5
Standardize on Clusters
Flexibility
Clusters increase flexibility and HA regardless of DB types used later
n
atio r
r
u
g
onfi
uste
Re-c able cl
n
to e
License Costs
High Availability
6
Standardize on Oracle RAC

Scalability
For all the flexibility you need
ine
Onl de
ra
upg
ation
c
i
l
p
U Ap
S
nd P
a
h
c
) Pat
g
n
i
l
rol
ne (
Onli
Flexibility
7
Standardize on Oracle RAC and Oracle Multitenant

Agility
The new standard for Oracle Database Consolidation
More on Fiday, Apr 11th, Session

2548 Oracle Multinenant meets
RAC Level 3, Lido 3103, 11am
8
Consolidation
Agenda
Summary and Q&A
Appendices A-C
Preparation of the Servers

OS image setup and more
!
Setup of the Servers include:
Setting up network connections

!
OS OL 6.4
dasher
OS OL 6.4
dancer
OS OL 6.4
comet
10
OS OL 6.4
vixen
Setting up shared storage for all servers

!
Public and private with switch
Shared storage required
Setting up the OS image here OL 6.4
Suggestion:
Use cloning to deploy OS images faster
Preparation of the Servers

Kernel and Oracle preinstall package
!
Recommendations:
[root@dasher ~]# uname a

Linux dasher 2.6.39-400.17.1.el6uek.x86_64 #1 SMP Fri Feb 22
Use OL 6.4+ UEK
18:16:18 PST 2013 x86_64 x86_64 x86_64 GNU/Linux
Use the Oracle preinstall package

!
#Get the pre-install package

[root@dasher Desktop]# yum list oracle-*
oracle-rdbms-server-11gR2-preinstall.x86_64 1.0-7.el6
oracle-rdbms-server-12cR1-preinstall.x86_64 1.0-8.el6
ol6_latest
ol6_latest
11
Available for
Oracle Database 11g Rel. 2
Oracle Database 12c Rel. 1
Additional steps to perform after using the

pre-install package for an Oracle RAC cluster:
!
Add a grid user & dba group
Align UIDs / GUIDs across servers
Set SELinux to permissive, if possible
Check large / huge pages settings
Install Oracle Grid Infrastructure 12c

What is the default when keeping the preselection in steps 1-4?
12
GI for a Cluster Installation
Standard Cluster
Typical Installation

Step 3: Double-check the cluster topology to deploy!
13
Oracle Flex Cluster

The new standard for resource management in the cluster
! Oracle Flex Cluster:
The new standard for flexible
Leaf Nodes
resource management in the cluster

! Use it as demand requires it
! Inherits all Flex ASM HA capabilities
! Will support more use cases in future
Efficient High Availability and
resource management across tiers

! Lightweight cluster stack on leaf nodes
Hub Nodes
Benefit from virtualization and
physical deployments in one cluster
14

For now, Standard Cluster is the default given the preselection
! Oracle Flex Cluster
Can consist of only HUB-nodes

! If a Leaf-node has access to shared storage,
it can perform a role change to a HUB-node
A Standard Cluster can be converted to a

Flex Cluster at any time after the installation
! Once a cluster is configured as a Flex Cluster
this configuration is irreversible without a reconfiguration of the cluster.
! Recommendation:
An all-HUB-node Flex Cluster behaves the

same as a Standard Cluster using Flex ASM.
Either can be used, but if in doubt, you can

choose standard cluster and convert later.
More Information in Appendix A

15

Step 4: Do not accept the default choose Advanced Installation
! Typical Installation
Does not provide an option to use Flex ASM
Does not provide an option to create the Mgmt

DB / Grid Infrastructure Management Repository
! Enhancement Requests for later
releases have been filed already
! Advanced Option
16
Recommended for all configurations

Advanced Installation SCAN & GNS requirement
! Recommendations:
SCAN remains to be required for the cluster
Choose cluster-specific unique SCAN names
OUI will try to enforce it as much as possible

! http://www.oracle.com/technetwork/products/
clustering/overview/scan-129069.pdf
Choose Configure GNS if:

! You want to use dynamic IP management
(DHCP assigned / IPv6 Stateless Address

Autoconfiguration) for client connectivity
In this case, GNS requirements remain as

with previous version for standard cluster
! You chose to install an Oracle Flex Cluster
17

Advanced Installation Network Interface Usage
! Recommendations:
Use Redundant Interconnect Usage feature

! Bonding can be used underneath if required
! MOS notes explain further configuration e.g.:
It is recommended to align the

ASM network with the private
interconnect.
Using different subnets for the
private interconnect is required.
18
MOS note 1210883.1 - 11gR2 Grid

Infrastructure Redundant Interconnect
and ora.cluster_interconnect.haip

Advanced Installation Grid Infrastructure Management Repository
! Grid Infrastructure Management Repository (GIMR)
A Single Instance Oracle Database 12c
It will be installed on one of the nodes

! It is managed as a failover database
It contains the Cluster Health Monitor (CHM) data
It is stored in the first ASM disk group created
As part of the configuration, Quality of Service

Management (QoS) required resources are
added to the cluster configuration (e.g. OC4J)
! Recommendation: configure the GIMR!
19

Advanced Installation Storage Options
! For Standard Cluster Installations
three storage options are available:

1. Standard ASM
! ASM configuration as known
from previous releases

2. Oracle Flex ASM
! Recommended option available
with Oracle Grid Infrastructure 12c
Flex Cluster requires Flex ASM
3. Shared File System

! Alternative
20
Oracle ASM 12c Overview

Oracle ASM 12c Standard Deployment
RAC Cluster
Database Instance
One to One
Mapping of ASM
Instances to
Servers
DBA
ASM
DBB
DBB
DBC
Node2
ASM
Node3
ASM
Node4
ASM
Node5
ASM
ASM Cluster Pool of Storage

Disk Group A
Wide File Striping
21
DBB
ASM Instance
Node1
Shared Disk
Groups
DBA
ASM Instance
Disk Group B
ASM Disk
Introducing Oracle Flex ASM

Removal of One to One Mapping and HA
RAC Cluster
Database Instance
Databases share
ASM instances
DBA
DBA
ASM Instance
DBB
DBB
DBB
DBC
ASM Instance
Node1
Node1
runs as
ASM Client
to Node4
Node2
Shared Disk
Groups
ASM
Node3
ASM
Node4
Node2
runs as
ASM Client
to Node3
ASM
Node5
Node5
runs as
ASM Client
to Node4
ASM Cluster Pool of Storage

Disk Group A
Wide File Striping
22
Node2
Disk Group B
ASM Disk

Use Oracle Flex ASM for storage management
! Recommendations:
Use Oracle Flex ASM for storage

! For better HA of database instances
! Reserve per-node spare memory
[GRID]> ps -ef |grep pmon

grid
grid
grid
grid
3822
1
4865
1
9592
1
19114 19003
More Information in Appendix B

23
0
0
0
0
08:05
08:06
08:09
09:22
?
?
?
pts/0
00:00:00
00:00:00
00:00:00
00:00:00
asm_pmon_+ASM1
mdb_pmon_-MGMTDB
apx_pmon_+APX1
grep pmon

Advanced Installation Create ASM Disk Group
! Recommendations:
Create Infrastructure Disk Group (DG) first

! Use it to host OCR / Voting Disk
Choose Redundancy accordingly
Normal(+) redundancy is recommended
Create Data and FRA disk groups

post installation and as required.
! Optional: Use it to host shared DB homes
by creating an ACFS file system on top of it
24
http://www.oracle.com/technetwork/products/cloud-storage/
oop-patching-of-acfs-shared-oh-1885763.pdf
ADVM volumes can be of lower

redundancy than the underlying DG

Advanced Installation Prerequisite Checks: Use FixUp Scripts!
25
New Memory Requirements

Just something to consider
[GRID]> srvctl status asm
ASM is running on comet,dasher,dancer
[GRID]> srvctl status mgmtdb
Database is enabled
Instance -MGMTDB is running on node dasher
Physical memory requirements

with Oracle RAC 12c: 4GB
grid
grid
grid
oracle
3227
3868
7364
7917
1
1
1
1
0
0
0
0
13:54
13:55
13:57
13:57
?
?
?
?
00:00:02
00:00:01
00:00:01
00:00:02
asm_pmon_+ASM1
mdb_pmon_-MGMTDB
apx_pmon_+APX1
ora_pmon_raccdb1_4
[RAC]> df -h
Filesystem
...
tmpfs
...
26
Size
Used Avail Use% Mounted on
1.7G
1.3G
475M
73% /dev/shm
Agenda
27
Summary and Q&A
Appendices A-C
Install the Oracle Database Home

Nothing special just a quick walk through
Not the
default
28
Install the Oracle Database Home

A few things to point out
ACFS based
shared home
29
Before Creating Databases

Create Server Pools and additional disk groups as required
[GRID]$ srvctl add srvpool serverpool backoffice
min 1 max 2 i 1
[GRID]$ srvctl add srvpool serverpool frontoffice
min 1 max 4 i 2
Create additional disk

groups as required.
30
Agenda
31
Summary and Q&A
Appendices A-C
Create an Oracle Database

What is the default when keeping the preselection in steps 1-4?
32
Policy-managed
Oracle RAC-based
Non-CDB Database
Create an Oracle RAC Database

A few tips and tricks
Create an empty
multitenant CDB.
33
Create an Oracle RAC Database

A few tips and tricks
! Recommendations:
Use a different disk group than the database file

location-disk group as the Fast Recovery Area.
Automatic Storage Management (ASM)

recommendation remains unchanged
! Use it for any current production database
! New in Oracle Database 12c:
ACFS can be used to host database files

This is the default,
but not recommended
Use ACFS for database files, if you want to

! manage all data on a file system
! use advanced functionality
34
Milestone
What has been installed and configured so far?
raccdb1_2
Oracle RAC
Oracle RAC
Oracle GI for a cluster
OS OL 6.4
OS OL 6.4
dasher srvpool: frontoffice
dancer srvpool: backoffice
[RAC]> srvctl status database -d raccdb1

Instance raccdb1_1 is running on node comet
Instance raccdb1_2 is running on node dancer
[RAC]>srvctl status srvpool -serverpool backoffice -detail

Server pool name: backoffice
Active servers count: 2
Active server names: comet,dancer
NAME=comet STATE=ONLINE
NAME=dancer STATE=ONLINE
[RAC]> srvctl status srvpool

raccdb1_1
Oracle RAC
Oracle RAC
OS OL 6.4
OS OL 6.4
comet
srvpool: backoffice
vixen
raccdb1
35
srvpool: frontoffice
Server
Active
Server
Active
Server
Active
Server
Active
pool name: Free

servers count: 0
pool name: Generic
servers count: 0
pool name: backoffice
servers count: 2
pool name: frontoffice
servers count: 2
Create Pluggable Databases

Create HR PDB on running instances
raccdb1_2
Create a PDB on a node

that hosts a multintenant
CDB instance
Oracle RAC
Oracle RAC
raccdb1_1
Oracle RAC
comet
raccdb1
36
srvpool: backoffice
Oracle RAC
vixen
Agenda
37
Summary and Q&A
Appendices A-C
Post-Creation Steps
Create services to balance the workload
! Use Dynamic Database Services
raccdb1_2
Oracle RAC
Oracle RAC
For easier management of multitenant CDBs
Details
on FRI, Apr 11th, Session
For better workload management in the cluster
2548 Oracle Multinenant meets
RAC Level 3, Lido 3103, 11am
! Start services after creation and as required
[RAC]> srvctl add service -d raccdb1 -s hrsvc -pdb hr serverpool backoffice
raccdb1_1
Oracle RAC
Oracle RAC
comet
srvpool: backoffice
vixen
raccdb1
38
[RAC]> srvctl add service -d raccdb1 -s crmsvc -pdb crm serverpool frontoffice
More Information in Appendix C
Agenda
39
Testing
Monitoring &Analysis
Summary and Q&A
Appendices A-C
Engineered Systems
Optimized and already tested
IB Interconnect
Low Overhead IPC Prot.
Oracle Database
Appliance
Preconfigured
Full Rack
Half Rack
Quarter Rack
40
Oracle Exadata
Database Machine
Oracle Real Application Testing

Gather and deploy workload on any database type
ERP
CRM
DW
41
Standardize on Oracle RAC (One Node)

Scalability
Here: to simplify Oracle RAC testing
ine
Onl de
ra
upg
tion
a
r
u
g
r
onfi cluste
c
e
R
le
nab
e
o
t
Flexibility
42
Standardize on Oracle RAC (One Node)

To simplify Oracle RAC testing
Oracle RAC testing made simple:
Decide
1. Standardize on Oracle RAC (One Node)
Online
upgrade
AWR
--ASH
AWR
--ASH
2. Run tests on Oracle RAC One Node instance
RAC One Node behaves basically like a single instance
3. Online Upgrade to Oracle RAC for testing only

4. Run tests on Oracle RAC
RON_1
RON
RON_2
Oracle RAC
Oracle GI
Oracle RAC
Oracle GI
comet
43
vixen
5. Decide whether the application provides service
goals when load balanced over multiple active

instances
Identify bottlenecks and tuning actions as required
Agenda
44
Testing
Monitoring &Analysis
Summary and Q&A
Appendices A-C
Post-Install Steps
Check your environment regularly using CVU and ORAcheck
! CVU is run regularly as part of the GI stack
#CVU is run regularly by default
[GRID]> srvctl status cvu
CVU is enabled and running on node comet
! Use ORAcheck (formerly RACcheck)
the Oracle RAC Configuration Audit Tool
For details see MOS note 1268927.1
! Checks the Oracle Database:
Standalone Database
Grid Infrastructure & RAC
Maximum Availability Architecture (MAA) Validation
Upgrade Readiness Validation
Golden Gate
! E-Business Suite
! Oracle SUN Systems
45
Monitoring Essentials
Use Cluster Health Monitor for OS (CHM/OS)
1.
First failure diagnostics: Collects as much

system metrics and data as feasible
2.
Collects system metrics on all

nodes in the cluster synchronized
3.
Persistent storage of all

collected data in a database
4.
Integrated with Oracle Grid Infrastructure

starting with 11.2.0.2 (12c: uses GIMR)
5.
Robust collection in situations

of resource starvation
6.
Data dump or visualization
LOGGERD
sysmond
Oracle GI
dasher
sysmond
Oracle GI
dancer
sysmond
Oracle GI
comet
sysmond
vixen
Oracle GI
sysmond
46
LOGGERD
Log Collection Essentials

Runtime and Emergency Data Collections
!
Save database statistics
LOGs
Oracle RAC
Oracle GI
dasher
LOGs
Oracle RAC
Oracle GI
dancer
For diagnostics:
LOGs
Oracle RAC
Oracle GI
comet
47
LOGs
Oracle RAC
Oracle GI
vixen
Always get AWR and ASH reports
For emergencies and last gasp
For baselines and reference: export AWR
get ASH dump (e.g. oradebug ashdunp level 0)
CHM/OS
oclumon dumpnodeview -n pecdb08 pecdb09 -s

"2011-09-30 15:00:00" -e "2011-09-30 15:30:00" -v
oclumom manage report <ret. time in secs>
CSS logs from all nodes
Node and instance evictions
Interconnect issues (e.g. gc blocks lots )

Use Trace File Analyzer (TFA) to collect Data
!
LOGs
Oracle RAC
Oracle GI
dasher
LOGs
Improved comprehensive first

failure diagnostics collection
Efficient collection, packaging

and transfer of data for customers
Reduce round trips between

customers and Oracle
Supports 10.2, 11.1, 11.2 and above
Included in the 11.2.0.4

patch set and future versions
TFA
Oracle RAC
Oracle GI
comet
48
Goals

!
LOGs
Oracle RAC
Oracle GI
Approach
Collect for all relevant components

(OS, Grid Infrastructure, ASM, RDBMS)
One command to collect all information
Prune large files based on temporal criteria
Collect time relevant IPS (incident)

packages on RAC nodes
Collect time relevant CHM/OS,

OSWatcher data on all Oracle RAC nodes
On-demand (default) and

Event Driven diagnostic collections
dasher
LOGs
TFA
Oracle RAC
Oracle GI
comet
49
TFA Collector MOS note ID 1513912.1

!
LOGs
Oracle RAC
Oracle GI
dasher
LOGs
TFA
Oracle RAC
Oracle GI
comet
50
TFA Version 3.2 Updates (07Apr14):

1.
First version of the Log Analyzer.
2.
Addition of notrim for diagnostic collections.
3.
Support for TFA on zLinux.
4.
Collection of ExaWatcher data.
5.
Sundiag collection
6.
Aging of TFA log files restricting maximum size.
7.
Multiple performance enhancements
8.
Critical Bug fixes
TFA Collector MOS note ID 1513912.1
TFA Usage Example

$ sudo ./tfactl diagcollect
One simple command
Sending diagcollect request to host : myhost2

Getting list of files satisfying time range [Tue Sep 03 14:17:43 PDT 2013, Tue Sep 03 18:17:43 PDT 2013]
myhost1: Zipping File: /opt/oracle/oak/oswbb/archive/oswiostat/myhost1_iostat_13.09.03.1500.dat.gz
myhost1: Zipping File: /u01/app/oracle/diag/rdbms/bill/bill1/trace/alert_bill1.log
Trimming file : /u01/app/oracle/diag/rdbms/bill/bill1/trace/alert_bill1.log with original file size : 109kB
myhost1: Zipping File: /opt/oracle/oak/oswbb/archive/oswtop/myhost1_top_13.09.03.1500.dat.gz
myhost1: Zipping File: /opt/oracle/oak/log/myhost1/oak/oakd.log
Trimming file : /opt/oracle/oak/log/myhost1/oak/oakd.log with original file size : 9.2MB
myhost1: Zipping File: /u01/app/11.2.0.3/grid/log/myhost1/gipcd/gipcd.log
myhost1: Zipping File: /u01/app/11.2.0.3/grid/log/myhost1/agent/ohasd/oraagent_grid/oraagent_grid.log
Trimming file : /u01/app/11.2.0.3/grid/log/myhost1/agent/ohasd/oraagent_grid/oraagent_grid.log with original filesize 4.3MB
myhost1: Zipping File: /var/log/messages
Truncated for brevity
myhost1: Zipping File: /opt/oracle/oak/oswbb/archive/oswslabinfo/myhost1_slabinfo_13.09.03.1800.dat
Collecting ADR incident files...
Total Number of Files checked : 10543
Total Size of all Files Checked : 3.9GB
Number of files containing required range : 68
Total Size of Files containing required range : 129MB
Number of files trimmed : 10
Total Size of data prior to zip : 144MB
Saved 63MB by trimming files
Zip file size : 8.6MB
Total time taken : 47s.
OS Watcher files
Pruning
Relevant files only
ADR Incident files
144MB pruned and compressed down to 8.6MB
47 seconds! 1 command, 2 nodes, 4 databases, ASM, Clusterware, OS
Logs are collected to:

/opt/oracle/tfa/tfa_home/repository/collection_Tue_Sep_3_18_17_24_PDT_2013_node_all/myhost1.tfa_Tue_Sep_3_18_17_24_PDT_2013.zip
/opt/oracle/tfa/tfa_home/repository/collection_Tue_Sep_3_18_17_24_PDT_2013_node_all/myhost2.tfa_Tue_Sep_3_18_17_24_PDT_2013.zip
51
Analysis Essentials
Time Series Analysis AWR Reports are not enough due to average
!
Solution
ASH reports
V$SESSION
V$SESSION_WAIT
V$ACTIVE_SESSION_HISTORY
Write 1
out of 10
samples
Session
state
objects
Circular buffer
in SGA
MMON Lite
(MMNL)
Occurrence of an interconnect
problem ~18 secs avg !!!!
52
Variable
length rows
DBA_HIST_ACTIVE_SESS_HISTORY
(2MB per CPU)
Every
1 hour
or
out-of-space
Direct path
inserts
AWR
Post-Install Steps
Monitor best practices notes and announcements
! ORAcheck - Oracle Configuration Audit Tool
For details see MOS note 1268927.1
! Best practices My Oracle Support (MOS) notes:
MOS note 810394.1 - RAC and Oracle Clusterware Best Practices and Starter Kit (Platform Independent)
! MOS note 811306.1 - RAC and Oracle Clusterware Best Practices and Starter Kit (Linux)
! MOS note 811280.1 - RAC and Oracle Clusterware Best Practices and Starter Kit (Solaris)
Note: Engineered Systems with the same OS will have additional recommendations
! MOS note 811271.1 - RAC and Oracle Clusterware Best Practices and Starter Kit (Windows)
! MOS note 811303.1 - RAC and Oracle Clusterware Best Practices and Starter Kit (HP-UX)
! MOS note 811293.1 - RAC and Oracle Clusterware Best Practices and Starter Kit (AIX)
! MOS note 1452965.2
53
Information Center: Oracle Scalability Grid Infrastructure / Clusterware and Real Application Clusters (RAC)
Agenda
54
Summary and Q&A
Appendices A-C
More Information Extended RAC and More

! Presentation: Oracle RAC on Extended Distance Clusters
http://www.slideshare.net/MarkusMichalewicz/oracle-rac-on-extended-distance-clusters
! WP: Oracle Real Application Clusters on Extended Distance Clusters
http://www.oracle.com/technetwork/database/options/clustering/overview/extendedracversion11-435972.pdf
! WP: Using standard NFS to support a third voting file for extended cluster configurations
http://www.oracle.com/technetwork/database/database-technologies/clusterware/overview/grid-infra-thirdvoteonnfs-131158.pdf
Presentation: Oracle Clusterware Node Management and Voting Disks
http://www.slideshare.net/MarkusMichalewicz/oracle-clusterware-node-management-and-voting-disks
! Presentation: Oracle Database with RAC 12c HA BP TCOUG
55
http://www.slideshare.net/MarkusMichalewicz/oracle-database-with-rac-12c-ha-bp-tcoug
Questions
and
Answers
56
Agenda
57
Summary and Q&A
Appendices A-C
Appendix A:
Converting to an Oracle
Flex Cluster with Node
Conversion Example
58
Oracle Flex Cluster

Some configuration details
! Oracle Flex Cluster
[GRID]> crsctl get cluster mode config
Will be the basis for more uses cases

in future releases (for resource mgmt)
Can consist of only HUB-nodes
If a Leaf-node has access to shared storage,

it can perform a role change to a HUB-node
A Standard Cluster can be converted to a

Flex Cluster at any time after the installation
Once a cluster is configured as a Flex Cluster

this configuration is irreversible without a reconfiguration of the cluster.
Cluster is configured as "standard"
[GRID]> crsctl get cluster mode status

Cluster is running in "standard" mode
[GRID]> olsnodes -s -a -t
dasher
vixen
dancer
comet
Active
Active
Active
Active
Hub
Hub
Hub
Hub
Unpinned
Unpinned
Unpinned
Unpinned
Not a Flex Cluster yet.

An all-Hub Flex Cluster is
basically a Standard Cluster
! More Information:
59
http://docs.oracle.com/cd/E16655_01/rac.121/e17886/
bigcluster.htm#CWADD92560
Oracle Flex Cluster

Converting to Flex Cluster
! More Information:
[GRID]> srvctl config gns
bigcluster.htm#CHDJGBII
PRKF-1110 : Neither GNS server nor GNS client is configured on

this cluster
[GRID]> more /etc/hosts |grep gns

10.1.1.99
mygns mygns.localdomain
#Change to root
[GRID]> su
Password:
[GRID]> srvctl add gns -vip mygns
[GRID]> srvctl start gns
[GRID]> crsctl set cluster mode flex
Cluster mode set to "flex

[GRID]> crsctl get cluster mode config

Cluster is configured as "flex"
60
! Flex Cluster implementations require GNS

! Converting a Flex Cluster requires a cluster restart
Use crsctl stop crs followed by crsctl start crs as root
Hence the difference between status and config
Nodes can be restarted in a rolling fashion:
[GRID]> date ; hostname ;

crsctl get cluster mode status
Sat Sep 14 14:43:45 PDT 2013
dasher
Cluster is running in "flex" mode
[GRID]> date ; hostname ;

crsctl get cluster mode status
Sat Sep 14 14:43:37 PDT 2013
dancer
Oracle Flex Cluster

Standard to Flex Cluster conversion what has changed?
! Nothing at first glance
An all-Hub Flex Cluster behaves

like a Standard Cluster
When converting from Standard Cluster

all nodes are converted into HUB-nodes
raccdb1_2
raccdb1_4
Oracle RAC
Oracle RAC
Oracle GI | HUB
Oracle GI | HUB

Cluster is running in "flex" mode
[GRID]> olsnodes -a -s -t
raccdb1_1
raccdb1_3
Oracle RAC
Oracle RAC
Oracle GI | HUB
comet
srvpool: backoffice
Oracle GI | HUB
vixen
raccdb1
61
dasher
vixen
dancer
comet
Active
Active
Active
Active
Hub
Hub
Hub
Hub
Unpinned
Unpinned
Unpinned
Unpinned

Instance
Instance
Instance
Instance
raccdb1_1
raccdb1_2
raccdb1_3
raccdb1_4
is
is
is
is
running
running
running
running
on
on
on
on
node
node
node
node
comet
dancer
vixen
dasher
Oracle Flex Cluster

Changing node roles server vixen becomes a Leaf node
! More Information:
[GRID]> hostname
vixen
bigcluster.htm#BABHCEAE
[GRID]> srvctl config vip -node vixen

VIP exists: network number 1, hosting node vixen
VIP Name: vixen-vip
VIP IPv4 Address: 10.1.1.33
VIP IPv6 Address:
[GRID]> crsctl get node role config
Node 'vixen' configured role is 'hub'
#Change to root
[GRID]> su
Password:
[GRID]> crsctl get node role config
[GRID]> crsctl set node role leaf
[GRID]> srvctl config vip -node vixen
CRS-4408: Node 'vixen' configured role successfully changed; restart

Oracle High Availability Services for new role to take effect.
[GRID]> crsctl stop crs

[GRID]> crsctl start crs
62
Node 'vixen' configured role is 'leaf'
VIP
VIP
VIP
VIP
exists: network number 1, hosting node vixen

Name: vixen-vip
IPv4 Address: 10.1.1.33
IPv6 Address:
Oracle Flex Cluster

Node role change to Leaf what has changed?
! Server vixen has converted to a Leaf node
! Leaf nodes do not host DB instances in 12.1
raccdb1_2
raccdb1_4
Oracle RAC
Oracle RAC
Oracle GI | HUB
Oracle GI | HUB
Oracle RAC
Oracle RAC
Oracle GI | HUB
srvpool: backoffice
Oracle GI | LEAF
vixen
raccdb1
63
Server Pool frontoffice is a database pool
Note: all nodes in this example have access

to shared storage, which means only the node
role changes storage access is preserved.
raccdb1_1
comet
! Server vixen moved to Server Pool FREE as
srvpool: FREE
Instance raccdb1_1 is running on node comet

Instance raccdb1_2 is running on node dancer
Instance raccdb1_4 is running on node dasher
[RAC]> srvctl status server -servers vixen -detail

Server
Server
Server
Server
active pools: Free

name: vixen
state: ONLINE
state details:
Oracle Flex Cluster

Revert role change server vixen becomes a HUB again
raccdb1_2
raccdb1_4
Oracle RAC
Oracle RAC
Oracle GI | HUB
Oracle GI | HUB
#As root
[GRID]> crsctl set node role hub

CRS-4408: Node 'vixen' configured role successfully changed;
restart Oracle High Availability Services for new role to take
effect.
[GRID]> crsctl stop crs

[GRID]> crsctl start crs
raccdb1_1
raccdb1_3
Oracle RAC
Oracle RAC
Oracle GI | HUB
comet
srvpool: backoffice
Oracle GI | HUB
vixen
raccdb1
64
Instance
Instance
Instance
Instance
raccdb1_1
raccdb1_2
raccdb1_3
raccdb1_4
is
is
is
is
running
running
running
running
on
on
on
on
node
node
node
node
comet
dancer
vixen
dasher
Appendix B:
Oracle Flex ASM
Details and Test Scenarios
65
Oracle Flex ASM

Configuration details
! Flex ASM introduces new local resources:
[GRID]> crsctl stat res -t
------------------------------------------------------------------------------Name
Target State
Server
State details
------------------------------------------------------------------------------Local Resources
-------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
...
ora.DATA.dg
ONLINE
ONLINE
ONLINE
ONLINE
ONLINE
ONLINE
ONLINE
ONLINE
comet
dancer
dasher
vixen
STABLE
STABLE
STABLE
STABLE
ONLINE
ONLINE
ONLINE
OFFLINE
ONLINE
ONLINE
ONLINE
OFFLINE
comet
dancer
dasher
vixen
STABLE
STABLE
STABLE
STABLE
ONLINE
ONLINE
ONLINE
OFFLINE
ONLINE
ONLINE
ONLINE
OFFLINE
comet
dancer
dasher
vixen
STABLE
STABLE
STABLE
STABLE
ONLINE
ONLINE
ONLINE
ONLINE
comet
dancer
dasher
vixen
STABLE
STABLE
STABLE
STABLE
...
ora.INFRA.dg
At least one ASM listener
One proxy_advm (per node)

! Used for ACFS access to Flex ASM instances
! Connections from a database instance to an ASM
instance are based on SQLnet using listeners.
The listener directs the connection to the least loaded

ASM instance based on the load metric it maintains.
The connection details are fetched from CSS global data
The ASM instance to which the database instance

connects to is listed in the database alert log:
!
...
ora.proxy_advm
ONLINE
ONLINE
ONLINE
ONLINE
66
NOTE: ASMB connected to ASM instance

+ASM1 (Flex mode; client id 0x10004)
The userid and password supplied are also managed

automatically. They are supplied while establishing the
session, not while connecting.
Oracle Flex ASM

Administering Flex ASM
! Check ASM mode using asmcmd
[GRID]> asmcmd
ASMCMD> showclustermode
ASM cluster : Flex mode enabled

! Check where ASM instances are running using srvctl

! Check the configuration of ASM using srvctl
! Modify the ASM configuration using srvctl
[GRID]> srvctl config asm -detail

ASM home: /u01/app/12.1.0/grid
Password file: +INFRA/orapwASM
ASM listener: LISTENER
ASM is enabled.
ASM instance count: 3
Cluster ASM listener: ASMNET1LSNR_ASM,ASMNET2LSNR_ASM

[GRID]> srvctl modify asm -count all
[GRID]> srvctl start asm
ASM is running on comet,vixen,dasher,dancer
67
! Cluster ASM listener:
Flex ASM can have its own network or overlap with the
private interconnect network used by RAC DB instances
It is recommended to configure a full overlap of the private

interconnect and the ASM network in current use cases:
Oracle Flex ASM

Some test scenarios
! A failure of an ASM instance is without effect for the
databases using ASM disk groups (here: -MGMTDB)

grid
grid
grid
oracle
3840
4093
4548
5092
1
1
1
1
0
0
0
0
09:11
11:35
11:36
11:36
?
?
?
?
00:00:01
00:00:00
00:00:00
00:00:00
mdb_pmon_-MGMTDB
asm_pmon_+ASM1
apx_pmon_+APX1
ora_pmon_raccdb1_4
[GRID]> kill -9 4093

grid
grid
oracle
3840
4548
5092
1
1
1
0 09:11 ?
0 11:36 ?
0 11:36 ?
00:00:01 mdb_pmon_-MGMTDB
00:00:00 apx_pmon_+APX1
00:00:00 ora_pmon_raccdb1_4
3840
1
4548
1
5092
1
5748
1
5793 19013
0
0
0
0
0
09:11
11:36
11:36
11:39
11:39
If an ASM instance is running on all nodes (count all)

the ASM instance is restarted upon failure
If an ASM instance is running on a subset of nodes

the ASM instance might be restarted on another node
The client using the ASM instance may change
! A failure of an ASM instance is without effect for
the APX (ADVM proxy) running on the same node

grid
grid
oracle
grid
grid
?
?
?
?
pts/1
00:00:01
00:00:00
00:00:00
00:00:00
00:00:00
mdb_pmon_-MGMTDB
apx_pmon_+APX1
ora_pmon_raccdb1_4
asm_pmon_+ASM1
grep pmon
! A failure of the APX will lead to a restart of the database
instance (on the node) that uses an ACFS file system.
[GRID]> asmcmd lsct data

DB_Name
+APX
Status
CONNECTED
Software_Version
12.1.0.1.0
Compatible_version
12.0.0.0.0
Instance_Name
+APX1
Disk_Group
DATA
[GRID]> ssh vixen /u01/app/12.1.0/grid/bin/asmcmd lsct data

DB_Name
+APX
+APX
68
Status
CONNECTED
CONNECTED
Software_Version
12.1.0.1.0
12.1.0.1.0
Compatible_version
12.0.0.0.0
12.0.0.0.0
Instance_Name
+APX2
+APX3
Disk_Group
DATA
DATA
! More information:
http://docs.oracle.com/cd/E16655_01/server.121/e17612/
asminst.htm#OSTMG95329
Appendix C:
Policy-Managed Databases
and with Oracle RAC 12c
69
Policy-Managed Databases with Oracle RAC 12c

Database Services
! Database Services
raccdb1_2
raccdb1_4
Oracle RAC
Oracle RAC
Oracle GI | HUB
Oracle GI | HUB
raccdb1_1
raccdb1_3
Oracle RAC
Oracle RAC
Oracle GI | HUB
comet
srvpool: backoffice
Oracle GI | HUB
vixen
raccdb1
70
Ensure that workload is hosted in the respective

server pool with the cardinality defined as part of
the policy definition.
[GRID]> srvctl status serverpool

Server pool name: frontoffice
Active Servers count: 2
[RAC]> srvctl status service -d raccdb1
Service crmsvc is running on nodes: dasher,vixen
Service hrsvc is running on nodes: comet,dancer

Improved HA Management - Startup
3rd
1st
! Defining a Service Startup Order
Ensure services are started in specified groups

and specified order.
Leverages Serverpool Min and Importance properties
raccdb1_2
raccdb1_4
Oracle RAC
Oracle RAC
Oracle GI | HUB
Oracle GI | HUB
2nd
4th
[GRID]> srvctl config serverpool

Importance: 10, Min: 2, Max 2

raccdb1_1
raccdb1_3
Oracle RAC
Oracle RAC
Oracle GI | HUB
comet
srvpool: backoffice
Oracle GI | HUB
vixen
raccdb1
71

Server pool name: Free
Importance: 0, Min: 0, Max -1

Improved HA Management New Failover Strategy
! Servers Move to Replace Failed node
raccdb1_4
raccdb1_2
raccdb1_2
Oracle RAC
Oracle RAC
Oracle GI | HUB
Oracle GI | HUB

frontoffice
Protects against cascade failures due to load
Ensures workload isolation between pools
Less important workloads shutdown transactionally


raccdb1_1
raccdb1_3
Oracle RAC
Oracle RAC
Oracle GI | HUB
Oracle GI | HUB
comet
srvpool: backoffice
vixen
raccdb1
72

[GRID]> srvctl status serverpool


Improved HA Management Manage Last Service Standing
! Business Critical Services survive multiple failures
raccdb1_4
raccdb1_2
raccdb1_2
Oracle RAC
Oracle RAC
Oracle GI | HUB
Oracle GI | HUB

frontoffice
Most important pool always gets the servers
Services preserved across multiple failures
Less important workloads shutdown transactionally
[RAC]> srvctl config serverpool


raccdb1_1
raccdb1_3
Oracle RAC
Oracle RAC
Oracle GI | HUB
comet
srvpool:frontoffice
backoffice
srvpool:
Oracle GI | HUB
vixen
raccdb1
73

[RAC]> srvctl status service db
Service crmsrv is running on nodes comet,vixen
Service hrsvc is not running

Improved HA Management Dynamic Provisioning
! Add Servers Just-In Time to meet demand
raccdb1_4
raccdb1_2
raccdb1_2
Oracle RAC
Oracle RAC
Oracle GI | HUB
Oracle GI | HUB

frontoffice
Server Pools sized via Min and Max properties
Dynamically controlled by QoS Management
Planned control via Clusterware or QoSM Policies
[GRID]> srvctl modify serverpool

serverpool backoffice max 1
[RAC]> srvctl config serverpool
raccdb1_1
raccdb1_3
Oracle RAC
Oracle RAC
Oracle GI | HUB
comet
srvpool: backoffice
Oracle GI | HUB
vixen
raccdb1
74


[RAC]> srvctl status service db
Service crmsrv is running on nodes dasher,dancer,vixen
Service hrsvc is not running
Policy-Management with Oracle RAC 12c

Support for Multiple Policies tracking business objectives
! More Information:
http://docs.oracle.com/cd/E16655_01/rac.121/e17886/pbmgmt.htm
! New in Oracle Grid Infrastructure 12c
[GRID]> crsctl modify policyset attr

"LAST_ACTIVATED_POLICY=NightTime
QoS Management
OR
CRS-2673: Attempting to stop

'ora.raccdb1.crmsvc.svc' on 'comet'
CRS-2673: Attempting to stop
'ora.raccdb1.crmsvc.svc' on 'dancer'
CRS-2677: Stop of 'ora.raccdb1.crmsvc.svc' on
'comet' succeeded
CRS-2673: Attempting to start
'ora.raccdb1.backup.svc' on 'comet'
CRS-2677: Stop of 'ora.raccdb1.crmsvc.svc' on
'dancer' succeeded
CRS-2672: Attempting to start
'ora.raccdb1.hrsvc.svc' on 'dancer
Oracle Clusterware - CRSCTL
75
Server Categories
! Server Categories use server attributes to allow
for an active use of differently sized servers
Policy Sets
! Policy Sets allow for dynamic adjustment
to demand changes in an atomic transaction

Server Attributes
NAME
MEMORY_SIZE!
CPU_COUNT
CPU_CLOCK_RATE!
CPU_HYPERTHREADING!
CPU_EQUIVALENCY
!
Server Categories
NAME
ACL
EXPRESSION

Setting up policy sets Provision Server Pools and creating a PolicySet
! Add another server pool backup
[GRID]> srvctl add serverpool
serverpool backup min 0 max 2 importance 20
[GRID] srvctl status serverpool
! Set up policy set with 3 server pools & 3 policies as follows:


Server pool name: backup
[GRID]> crsctl modify policyset

-file /u01/app//policyset.txt
76
DayTime:
!
frontoffice uses three servers (MIN_SIZE=3)
backoffice uses one server (MIN_SIZE=1)
backup does not run during daytime (MIN_SIZE=0)
NightTime:
!
frontoffice uses one server (MIN_SIZE=1)
backoffice uses two servers (MIN_SIZE=2)
backup uses only one server (MIN_SIZE=1)
Weekend:
!
frontoffice uses one server (MIN_SIZE=1)
backoffice uses one server (MIN_SIZE=1)
backup uses two servers (MIN_SIZE=2)

Using Policy Sets part 1: Activate a policy
[GRID]> crsctl modify policyset
-attr "LAST_ACTIVATED_POLICY=Weekend"
Server pool name: Free
Importance: 0, Min: 0, Max: -1
Category:
Candidate server names:
Server pool name: Generic
Importance: 0, Min: 0, Max: -1
Category:
Importance: 0, Min: 1, Max: 1
Category:
Server pool name: backup
Category:
Category:
77
! Activate the policy for the weekend

Using Policy Sets part 2: check the result
! With an activated weekend policy
raccdb1_2
raccdb1_4
Oracle RAC
Oracle RAC
Oracle GI | HUB
Oracle GI | HUB
dasher srvpool: backoffice
dancer srvpool: backup

raccdb1_1
raccdb1_3
Oracle RAC
Oracle RAC
Oracle GI | HUB
Oracle GI | HUB
comet
srvpool: backup
vixen
raccdb1
78
Instance
Instance
Instance
Instance
raccdb1_1
raccdb1_2
raccdb1_3
raccdb1_4
is
is
is
is
running
running
running
running
on
on
on
on
node
node
node
node
comet
dancer
vixen
dasher

Service backup is running on nodes: comet,dancer
Service crmsvc is running on nodes: vixen
Service hrsvc is running on nodes: dasher

Adding Server Categories to the picture part 1
! Assume you have 2 servers that have better IO
[GRID]> su
Password:
[GRID]> crsctl set server label IOplus

...
Use these servers for backups whenever possible

! Here comet and dancer have better IO by definition
#On dancer
[GRID]> crsctl set server label Ioplus

[GRID]> crsctl get server label
CRS-4972: Current SERVER_LABEL parameter value is Ioplus
[GRID]> crsctl status server comet dancer f

Comet
Dancer
NAME=comet
MEMORY_SIZE=3338
CPU_COUNT=1
CPU_CLOCK_RATE=2132
CPU_HYPERTHREADING=0
CPU_EQUIVALENCY=1000
DEPLOYMENT=other
CONFIGURED_CSS_ROLE=hub
RESOURCE_USE_ENABLED=1
NAME=dancer
MEMORY_SIZE=3338
CPU_COUNT=1
CPU_CLOCK_RATE=2247
CPU_HYPERTHREADING=0
CPU_EQUIVALENCY=1000
DEPLOYMENT=other
CONFIGURED_CSS_ROLE=hub
RESOURCE_USE_ENABLED=1
SERVER_LABEL=IOplus
SERVER_LABEL=IOplus
...
...
79
! What you need to do:
Set up a server category that identifies the servers
Add the use of the server category to the server pool

! Define the server pools that utilize the category
and during which policy activation it shall be used.
! You need to restart the cluster stack on
the servers that you modify in this fashion

Adding Server Categories to the picture part 2
! What you need to do:
[GRID]> crsctl add category moreIO
attr "EXPRESSION='SERVER_LABEL co IOplus'"
[GRID]> crsctl status category moreIO
Set up a server category that identifies the servers done
Add the use of the server category to the server pool
NAME=moreIO
ACL=owner:grid:rwx,pgrp:oinstall:rwx,other::r-ACTIVE_CSS_ROLE=hub
EXPRESSION=(SERVER_LABEL co IOplus)
[GRID]> crsctl modify serverpool ora.backup

-attr "SERVER_CATEGORY=moreIO" -all_policies
! Define the server pools that utilize the category
and during which policy activation it shall be used
! Note: Add the server category usage to the
server pool(s) that require it & specify the

policies that should be altered accordingly
80
In this example the backup server pool is the one

that will benefit the most and the policies will only
start this server pool as required.

Adding Server Categories to the picture comparison
Before
After
[GRID]> crsctl status policy DayTime
[GRID]> crsctl status policy DayTime
POLICY
NAME=DayTime
DESCRIPTION=
SERVERPOOL
NAME=Free
...
SERVERPOOL
NAME=ora.backoffice
IMPORTANCE=0
MAX_SIZE=1
MIN_SIZE=1
SERVER_CATEGORY=
SERVER_NAMES=
SERVERPOOL
NAME=ora.backup
IMPORTANCE=0
MAX_SIZE=0
MIN_SIZE=0
SERVER_CATEGORY=
SERVER_NAMES=
SERVERPOOL
NAME=ora.frontoffice
IMPORTANCE=0
MAX_SIZE=3
MIN_SIZE=3
SERVER_CATEGORY=
SERVER_NAMES=
81
POLICY
NAME=DayTime
DESCRIPTION=
SERVERPOOL
NAME=Free
...
SERVERPOOL
NAME=ora.backoffice
IMPORTANCE=0
MAX_SIZE=1
MIN_SIZE=1
SERVER_CATEGORY=
SERVER_NAMES=
SERVERPOOL
NAME=ora.backup
IMPORTANCE=0
MAX_SIZE=0
MIN_SIZE=0
SERVER_CATEGORY=moreIO
SERVER_NAMES=
SERVERPOOL
NAME=ora.frontoffice
IMPORTANCE=0
MAX_SIZE=3
MIN_SIZE=3
SERVER_CATEGORY=
SERVER_NAMES=

Using Policy Sets and the effect of Server Categories
raccdb1_2
raccdb1_4
Oracle RAC
Oracle RAC
Oracle RAC
Oracle RAC
Oracle GI | HUB
Oracle GI | HUB
Oracle GI | HUB
Oracle GI | HUB
dancer srvpool: frontoffice
raccdb1_1
raccdb1_3
raccdb1_1
raccdb1_3
Oracle RAC
Oracle RAC
Oracle RAC
Oracle RAC
Oracle GI | HUB
comet
srvpool: backup
Oracle GI | HUB
vixen
raccdb1
82
raccdb1_2
raccdb1_4
Oracle GI | HUB
comet
raccdb1
Oracle GI | HUB
vixen
srvpool: backoffice

Using Policy Sets means changing policies on a push of a button
raccdb1_2
raccdb1_4
Oracle RAC
Oracle RAC
Oracle GI | HUB
Oracle GI | HUB

backoffice
[GRID]> crsctl modify policyset attr
"LAST_ACTIVATED_POLICY=DayTime
raccdb1_1
raccdb1_1
raccdb1_3
Oracle RAC
Oracle RAC
Oracle GI | HUB
comet
srvpool:
srvpool:frontoffice
backup
Oracle GI | HUB
vixen
[GRID]
Server
Active
Server
Active
Server
Active
srvctl status serverpool

pool name: frontoffice
Servers count: 3
pool name: backoffice
Servers count: 1
pool name: backup
Servers count: 0

Service backup is not running.
Service crmsvc is running on nodes: dasher,vixen,comet
Service hrsvc is running on nodes: dancer
raccdb1
83

Using Policy Sets changing policies on the push of a button is fast
raccdb1_4
Oracle RAC
Oracle GI | HUB
raccdb1_1
Oracle RAC
Oracle GI | HUB
comet
srvpool: backup
[GRID]> date; crsctl modify policyset -attr

raccdb1_2
"LAST_ACTIVATED_POLICY=DayTime";
date
Oracle RAC
Oracle GI | HUB
vixen
raccdb1
84
Oracle RAC
Oracle RAC
Mon Sep 16 19:26:42 PDT 2013

Oracle GIon| HUB
OracleAttempting
GI | HUB to stop 'ora.raccdb1.backup.svc'
CRS-2673:
'dancer'
CRS-2673:
Attempting
to
stop
'ora.raccdb1.backup.svc'
on
'comet'
CRS-2677: Stop of 'ora.raccdb1.backup.svc' on 'dancer' succeeded
CRS-2677: Stop of 'ora.raccdb1.backup.svc' on 'comet' succeeded
CRS-2672: Attempting to start 'ora.raccdb1.crmsvc.svc' on 'dancer'
CRS-2672: Attempting to start 'ora.raccdb1.crmsvc.svc' on 'comet'
CRS-2676: Start of 'ora.raccdb1.crmsvc.svc' on 'dancer' succeeded
CRS-2676:
Start of 'ora.raccdb1.crmsvc.svc' on 'comet'
succeeded
raccdb1_1
raccdb1_3
Mon Sep 16 19:26:43 PDT 2013
" Time to execute: 1 second!
raccdb1_2
raccdb1_4
Oracle RAC
Oracle GI | HUB
dancer srvpool: frontoffice
raccdb1_3
Oracle RAC
Oracle GI | HUB
comet
raccdb1
Oracle RAC
Oracle GI | HUB
vixen
srvpool: backoffice

What-If evaluation of policy changes
raccdb1_2
raccdb1_4
Oracle RAC
Oracle RAC
Oracle GI | HUB
Oracle GI | HUB

Service crmsvc is running on nodes: dancer,vixen,dasher
Service hrsvc is running on nodes: comet
[GRID]> crsctl eval activate policy Weekend

Stage Group 1:
------------------------------------------------------------------------------Stage Number
Required
Action
------------------------------------------------------------------------------1
Y
Y
raccdb1_1
raccdb1_3
Oracle RAC
Oracle RAC
Oracle GI | HUB
comet
Oracle GI | HUB
vixen
raccdb1
85
Y
Y
Server 'comet' will be moved from pools

[ora.frontoffice] to pools [ora.backup]
Server 'dancer' will be moved from pools
[ora.frontoffice] to pools [ora.backup]
Resource 'ora.raccdb1.crmsvc.svc' (1/1) will be
in state [OFFLINE]
Resource 'ora.raccdb1.crmsvc.svc' (2/1) will be
in state [OFFLINE]
Resource
in state
Resource
in state
[dancer]
[ONLINE|INTERMEDIATE] on
[ONLINE|INTERMEDIATE] on
(1/1) will be
server[comet]
(2/1) will be
server
What-If with Oracle RAC 12c

What-If evaluation of policy changes in various levels

-admin -l 'resources'
-------------------------------------------------------------------------------Name
Target State
Server
Effect
-------------------------------------------------------------------------------Cluster Resources
-------------------------------------------------------------------------------ora.mgmtdb
1
ONLINE ONLINE
dasher
ora.raccdb1.backup.svc
1
ONLINE ONLINE
comet
Started
2
ONLINE ONLINE
dancer
Started
ora.raccdb1.crmsvc.svc
1
ONLINE OFFLINE
Stopped
2
ONLINE OFFLINE
Stopped
3
ONLINE ONLINE
dasher
ora.raccdb1.db
1
ONLINE ONLINE
comet
2
ONLINE ONLINE
dancer
3
ONLINE ONLINE
vixen
4
ONLINE ONLINE
dasher
ora.raccdb1.hrsvc.svc
1
ONLINE ONLINE
vixen
2
ONLINE OFFLINE
--------------------------------------------------------------------------------
86


NAME = Free
ACTIVE_SERVERS
NAME = Generic
ACTIVE_SERVERS
NAME = ora.backoffice
ACTIVE_SERVERS = vixen
NAME = ora.backup
ACTIVE_SERVERS = comet dancer
NAME = ora.frontoffice
ACTIVE_SERVERS = dasher
-admin -l 'serverpools'

Information on each step on the way
87
Before
After
[GRID]> crsctl modify policyset -attr

"LAST_ACTIVATED_POLICY=NightTime
[GRID]> crsctl modify policyset -attr

"LAST_ACTIVATED_POLICY=DayTime"
CRS-2673:
CRS-2673:
CRS-2677:
CRS-2677:
CRS-2672:
CRS-2672:
CRS-2676:
CRS-2676:
CRS-2673:
CRS-2673:
CRS-2677:
CRS-2677:
CRS-2672:
CRS-2672:
CRS-2676:
CRS-2676:
Attempting to stop 'ora.raccdb1.crmsvc.svc' on 'dancer'

Attempting to stop 'ora.raccdb1.crmsvc.svc' on 'comet'
Stop of 'ora.raccdb1.crmsvc.svc' on 'dancer' succeeded
Stop of 'ora.raccdb1.crmsvc.svc' on 'comet' succeeded
Attempting to start 'ora.raccdb1.backup.svc' on 'dancer'
Attempting to start 'ora.raccdb1.backup.svc' on 'comet'
Start of 'ora.raccdb1.backup.svc' on 'dancer' succeeded
Start of 'ora.raccdb1.backup.svc' on 'comet' succeeded
Attempting to stop 'ora.raccdb1.backup.svc' on 'dancer'

Attempting to stop 'ora.raccdb1.backup.svc' on 'comet'
Stop of 'ora.raccdb1.backup.svc' on 'dancer' succeeded
Stop of 'ora.raccdb1.backup.svc' on 'comet' succeeded
Attempting to start 'ora.raccdb1.crmsvc.svc' on 'dancer'
Attempting to start 'ora.raccdb1.crmsvc.svc' on 'comet'
Start of 'ora.raccdb1.crmsvc.svc' on 'dancer' succeeded
Start of 'ora.raccdb1.crmsvc.svc' on 'comet' succeeded
88

Oraclerac12ccollaboratebestpracticeswithappendices 140408185659 Phpapp01

Transféré par

Informations du document

Titre original

Copyright

Formats disponibles

Partager ce document

Partager ou intégrer le document

Options de partage

Avez-vous trouvé ce document utile ?

Ce contenu est-il inapproprié ?

Droits d'auteur :

Formats disponibles

Oraclerac12ccollaboratebestpracticeswithappendices 140408185659 Phpapp01

Transféré par

Droits d'auteur :

Formats disponibles

1

Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Oracle Real Application

Safe Harbor Statement

Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Oracle RAC 12c and Standardization

Installation of Oracle Grid Infrastructure 12c

Installation of the Oracle Database Home

Oracle RAC Database Creation using DBCA

Post-install Steps and Configuration

Summary and Q&A

Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Oracle RAC Family of Solutions

Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Clusters increase flexibility and HA regardless of DB types used later

Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Standardize on Oracle RAC

For all the flexibility you need

Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Standardize on Oracle RAC and Oracle Multitenant

The new standard for Oracle Database Consolidation

More on Fiday, Apr 11th, Session

Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Oracle RAC 12c and Standardization

Installation of Oracle Grid Infrastructure 12c

Installation of the Oracle Database Home

Oracle RAC Database Creation using DBCA

Post-install Steps and Configuration

Summary and Q&A

Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Preparation of the Servers

Setup of the Servers include:

Setting up network connections

Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Setting up shared storage for all servers

Public and private with switch

Shared storage required

Setting up the OS image here OL 6.4

Use cloning to deploy OS images faster

Preparation of the Servers

[root@dasher ~]# uname a

Use OL 6.4+ UEK

18:16:18 PST 2013 x86_64 x86_64 x86_64 GNU/Linux

Use the Oracle preinstall package

#Get the pre-install package

Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Oracle Database 11g Rel. 2

Oracle Database 12c Rel. 1

Additional steps to perform after using the

Add a grid user & dba group

Align UIDs / GUIDs across servers

Set SELinux to permissive, if possible

Check large / huge pages settings

Install Oracle Grid Infrastructure 12c

Copyright 2013, Oracle and/or its affiliates. All rights reserved.

GI for a Cluster Installation

Install Oracle Grid Infrastructure 12c

Copyright 2013, Oracle and/or its affiliates. All rights reserved.

Oracle Flex Cluster

resource management in the cluster

Efficient High Availability and

resource management across tiers

physical deployments in one cluster