Pachot Hueber OracleDatabaseAppliance

Infrastructure at your Service.
Oracle Database Appliance
About us
Franck Pachot
Senior Consultant
Oracle Technology Leader
David Hueber
Senior Consultant
COO
www.dbi-services.com
Page 2
13.05.2014
Who we are
dbi services
Experts At Your Service
35 specialists in IT infrastructure
> Certified, experienced, passionate
>
Based In Switzerland
100% self-financed Swiss company
> Over CHF 4 mio. turnover
>
Leading In Infrastructure Services

More than 100 customers in CH, D, & F
> Over 30 SLAs dbi FlexService contracted
>
Page 3
13.05.2014
Agenda
1. ODA Overview & Architecture
2. Operating ODA
3. ODA Advanced Get full power
4. ODA Performances
5. Pricing & Licensing
Page 4
13.05.2014
ODA overview and architecture

What? How?
> Principle
> Hardware architecture
> Storage capacity & redundancy
> Bare Metal vs Virtualized
Page 5
13.05.2014

Principle
Part of Oracle Engineered System
Full stack integrated solution
Simplify
Deployment
> Maintenance
> Support
>
Simple
Reliable
Available
Page 6
13.05.2014

Hardware Architecture ODA X3-2 / ODA X4-2
2 x 1 RU x86 Server
>
>
>
>
>
>
>
2 x 8-cores Intel Xeon E5-2690 / 2 x 12-cores Intel Xeon E5-2697v2

256 GB RAM (16 x 16GB)
2 x 600GB Boot Disks
> Mirrored
1 x Internal SAS HBA
2 x External SAS HBA
10GbE Interconnect
> Redundant
4 x External 1/10GbE
1 x 2 RU Storage
4 x 2.5 200GB SSD (Redo)
> 20 x 2.5 900GB HDD (Data)
>
Page 7
13.05.2014

Redundant Power Supply
Node 1
Node 0
Storage
Shelf
Page 8
13.05.2014

Management Interface
ILOM
Node 1
Node 0
Storage
Shelf
Page 9
13.05.2014

Cluster Interconnect
10Gb
Node 1
Node 0
Storage
Shelf
Page 10
13.05.2014

100 / 10 GbE external Network
bond0 & bond1
Node 1
Node 0
Storage
Shelf
Page 11
13.05.2014

SAS-2 Storage connectors
Node 1
Node 0
Storage
Shelf
SAS-2 I/O modules
Page 12
13.05.2014

Storage capacity & redundancy
Depends on ASM redundancy
Double mirrored: 9TB
> Triple mirrored: 6 TB
>
Depends on backups location

Local or External
> Impacts +DATA and +RECO DiskGroups
>
Backup Mode
+ DATA (TB)
+RECO (TB)
+REDO (GB)
Normal Redundancy
Local
3.6
4.5
248
External
7.2
0.98
248
Local
2.4
248
External
4.8
0.65
248
High Redundancy
Page 13
13.05.2014

Controller 1
Controller 2
PCIe2
PCIe3
PCIe2
Expander 1
Expender 2
SSD - 20
SSD - 21
SSD - 22
SSD - 23
SAS - 16
SAS - 17
SAS - 18
SAS - 19
SAS - 12
SAS - 13
SAS - 14
SAS - 15
SAS - 8
SAS - 9
SAS - 10
SAS - 11
SAS - 4
SAS - 5
SAS - 6
SAS - 7
SAS 0
SAS - 1
SAS - 2
SAS - 3
Storage Shelf backplane
Page 14
13.05.2014
PCIe3

Controller 1
Controller 2
PCIe2
PCIe3
PCIe2
Expander 1
Expander 2
SSD - 20
SSD - 21
SSD - 22
SSD - 23
SAS - 16
SAS - 17
SAS - 18
SAS - 19
SAS - 12
SAS - 13
SAS - 14
SAS - 15
SAS - 8
SAS - 9
SAS - 10
SAS - 11
SAS - 4
SAS - 5
SAS - 6
SAS - 7
SAS 0
SAS - 1
SAS - 2
SAS - 3
Storage Shelf backplane
ASM
Redundancy
Page 15
13.05.2014
PCIe3

Bare Metal vs Virtualized
Bare Metal
Dedicated to databases
> Latest Patch Bundle ODA 2.10 (May 2014)
>
Oracle Database 11.2.0.4.2

Grid Infrastructure 11.2.0.4.2
Appliance Manager 2.10
Oracle Linux 5.9
Kernel 2.6.39-400
Oracle Database
Oracle Clusterware
Appliance Manager
Oracle Linux
Page 16
13.05.2014

Bare Metal vs Virtualized
Virtualized Platform
Consolidate databases and applications on a single platform
> Based on Oracle VM
>
Applications
ODA Base
Oracle Database
Oracle Weblogic
Oracle Clusterware
Oracle VM
Appliance Manager
Oracle Linux
Page 17
13.05.2014
ODA Management
Database in a single click?
> OAKCLI overview

> Hardware monitoring
> Managing databases
Page 18
13.05.2014
Operating ODA
OAKCLI overview
Cross layer solution
Hardware
> List
> Diagnose & validate
> Operating System
> Install End User Bunddle
> Upgrade
> Apply patches
> Database & Cluster
> Create environments
> Delete environments
>
Used for VMs management

Oracle Database
Oracle Clusterware
OVM
Appliance
Manager
Oracle Linux
Hardware
Always run as root user
Page 19
13.05.2014
Operating ODA
OAKCLI overview
[root@dbi-oda1 ~]# oakcli -h
Usage: oakcli show
- show disk, diskgroup, expander, controller,
server, processor, memory, power, cooling, network, storage, version,
dbhomes, databases, db_config_params, core_config_key, env_hw
oakcli apply
- applies the core_config_key
oakcli locate
- locates a disk
oakcli deploy
- deploys the Database Appliance
oakcli update
- updates the Database Appliance
oakcli validate
- validates the Database Appliance
oakcli manage
- manages the oak repository, diagcollect e.t.c
oakcli unpack
- unpack the given package to oak repository
oakcli copy
- copies the deployment config file
oakcli upgrade
- upgrades database
oakcli stordiag
- run storage diagnostic tool on both node
oakcli test
- test asr
oakcli odachk
- performs configuration settings check on ODA
oakcli configure - configures the network or asr
oakcli create
- create database, dbhome, db_config_params file
oakcli delete
- deletes database, dbhome, db_config_params file
Page 20
13.05.2014
Operating ODA
Hardware monitoring
Checking state and settings OAKCLI show
>
Checking disks
[root@dbi-oda1 ~]# oakcli show disk
NAME
PATH
TYPE
e0_pd_00
e0_pd_01
e0_pd_02
e0_pd_03
e0_pd_04
>
/dev/sda
/dev/sdb
/dev/sdaa
/dev/sdab
/dev/sdac
HDD
HDD
HDD
HDD
HDD
STATE
STATE_DETAILS
ONLINE
ONLINE
FAILED
ONLINE
ONLINE
Good
Good
DiskRemoved
Good
Good
Get storage hardware details

[root@dbi-oda1 ~]# oakcli show storage -h
Usage:
oakcli show storage [-errors]
where:
storage
-shows the controllers, expanders, disks
storage -errors
-shows the storage errors
Page 21
13.05.2014
Operating ODA
Managing databases
Database creation through a mask
Based on size level templates
> Defines
> CPU_COUNT
> SGA / PGA
> Redo Log Size
> Maximum number of databases
> IOPS in single storage shelf
> IOPS in extended storage shelf
>
6 Databases classes
>
Very small (XS) to Extra Extra Large (XXL)
Page 22
13.05.2014
Operating ODA
Managing databases
Components
XS
XL
XXL
CPU_COUNT
12
24
32
SGA (MB)
4096
8192
16384
24576
49152
65536
PGA (MB)
2048
4096
8192
12288
24576
32768
Processes
200
400
800
1200
2400
3200
Log files size (GB)
Nb Databases*
16
206.25
412.5
825
1650
3300
3300
IOPS**
*Recommended limit per node

** Guaranteed values by Oracle if above recommendations are respected
Page 23
13.05.2014
Operating ODA
Managing databases
Create a new database oakcli create database
>
>
>
>
>
Done using oakcli as root user

Creates a new ORACLE_HOME by default
> Use option oh to reuse existing ORACLE_HOME
Option version available in case of multi-home environments
Static parameter defined in a configuration file
> Default available
> Additional configuration can be created
Triggers DBCA in background
[root@dbi-oda1 ~]# oakcli create database -h

Usage:
oakcli create database -db <db_name> [[-oh <home>] | [-version
<version>]] [-params <params_file>]
Page 24
13.05.2014
Operating ODA
Managing databases
Deleting databases oakcli delete database
>
Does not delete the corresponding ORACLE_HOME

[root@dbi-oda1 DBITEST6]# oakcli delete database -h
Usage:
oakcli delete database -db <db_name>
where:
db_name
name of the database
to be deleted
Page 25
13.05.2014
ODA Advanced Get full power

More than plug & play?
Page 26
13.05.2014

Memory Management
All databases created and configured with
>
ASMM Automatic Shared Memory Management

> sga_target
> sga_max_size
> pga_target
SQL> show parameter sga
NAME
--------------------sga_max_size
sga_target
TYPE
-----------big integer
big integer
VALUE
-------------16G
16G
SQL> show parameter pga

NAME
TYPE
VALUE
--------------------- ------------ --------------pga_aggregate_target big integer 8G
Page 27
13.05.2014

Memory Management
All databases created and configured with
>
SGA allocation in huge pages

> Configured on OS level
> 2MB pages
> 128GB configured by default
[root@dbi-oda1 ~]# grep -i huge /proc/meminfo
HugePages_Total:
64000
HugePages_Free:
56200
HugePages_Rsvd:
393
HugePages_Surp:
0
Hugepagesize:
2048 kB
By default databases cant used more than 50% of ODAs RAM
Page 28
13.05.2014

Database Management
Some additional work for DBAs
>
No file multiplexing by default

> Control Files
> Redo Logs
>
Tablespace policy management to be defined

> Tablespace are auto-extensible with UNLIMITED maximum size
> Application dependent
>
Parameters adjustment
> Max processes and / or sessions
> SGA fine tuning
> Default parameters taken from the databases class templates
Page 29
13.05.2014
ODA Performances
Lighting-fast?
> Disks stress

> Load increase
> Controller loss impact
> CPU stress
Page 30
13.05.2014
ODA Performances
Disk stress using IO_calibrate
Bare metal X3-2
Similar I/O performance
dbms_resource_manager.calibrate_io(20,10,:max_iops,:max_mbps,:actual_latency);
MAX_IOPS
MAX_MBPS MAX_PMBPS
LATENCY NUM_PHYSICAL_DISKS
---------- ---------- ---------- ---------- -----------------12030
4247
702
8
20
OVM X4-2
MAX_IOPS
MAX_MBPS MAX_PMBPS
LATENCY NUM_PHYSICAL_DISKS
---------- ---------- ---------- ---------- -----------------18040
4860
709
10
20
I/O performance is similar, no overhead from virtualization:

> Its the same disks, and still direct access through ASM
>
Page 31
13.05.2014
ODA Performances
Load increase using Swingbench
Swingbench
Free load generator for Oracle databases
> Available on
> http://dominicgiles.com/swingbench.html
>
Test 1 OLTP simulation

10 to 80 simultaneous users
> ODA seems scalable
>
Page 32
13.05.2014
ODA Performances
Test 2 DBWn & LGWn performances
Page 33
13.05.2014
ODA Performances
Test 3 Storage saturation
Data access saturated (more than 50% i/o > 32ms ) queuing
> Minimal contention on log Writer
> All redo writes less than milliseconds
>
% of Waits
Event
db file parallel read
db file parallel write
db file scattered read
db file sequential read
log file parallel write
Total Waits
<1ms
63,6K
10.7
<8ms
<16ms <32ms
5.3
63.2
29.3
10.6
.5
3.2
17.7
8.1
11.3
59.7
46.4
.0
33.8
66.2
.0
.0
4.8
13.8
16.0
18.1
1833,6K
98.6
.8
.0
.1
.5
.0
204
73.6
14.3
10.5
21.6
.7
2074,5K
>1s
17.6
.2
14 100.0
<=1s
21.1
251,9K
log file single write
9.7
62
14 100.0
log file sync
<4ms
19
log file sequential read
log file switch completion
<2ms
4.3
4.3
3.4
Page 34
13.05.2014
.2
ODA Performances
Controller loss impact
Test 4 Simulate controller loss impact
Still 2 nodes available
> Disk redundancy is still guaranteed using remaining controller
>
Page 35
13.05.2014
ODA Performances
CPU stress using swingbench
ODA X3-2
ODA X4-2
Faster CPUs
Page 36
13.05.2014
Pricing & Licensing

Keep the costs under control
> Software Licensing

> Hardware Pricing
Page 37
13.05.2014
Pricing & Licensing

Software Licensing
Supports only Enterprise Edition
Pay as your Grow
Bare Metal environment
Minimum 4 cores per node 8 per ODA
> Cores enabled per increment of 4 per node
> CPU limitation done through oakcli and activation key
>
Virtualized environment
Minimum of 2 cores per node 4 per ODA
> Cores enabled per increment of 2 per node
> All remaining cores available for applications domains
> Weblogic
> Java applications or any others
>
Page 38
13.05.2014
Pricing & Licensing

Hardware Pricing ODA vs HP DL380 Gen 8
Catalog Prices
>
No potential discounts or other advantages taken into account
ODA X3-2
E5-2690 256 GB RAM 22 x 600GB SAS 10k 4 x 200GB SSD
> ~60000$ CHF 54000
>
HP DL380 Gen8
E5-2690 256 GB RAM 2 x 600GB SAS 10k 2 x P420 Smart Array
> MSA 2040 20 x 600GB SAS 10k 4 x 200GB SSD 2 controllers
> ~ CHF 56000 CHF 60000 (depending on controllers model)
>
>
All cores must be licensed
Page 39
13.05.2014
References
Useful links
ODA Information Center
>
1417713.2
OAKCLI Reference Guide

>
1417879.1
Supported Versions & Known Issues

>
888888.1
ODA documentation
>
http://docs.oracle.com/cd/E22693_01/nav/portal_booklist.htm
Page 40
13.05.2014
Any questions? Please do ask.
Franck Pachot
Senior Consultant
Oracle Technology Leader
David Hueber
Senior Consultant
COO
www.dbi-services.com
We look forward to working with you!
Page 41
13.05.2014

Pachot Hueber OracleDatabaseAppliance

Transféré par

Informations du document

Copyright

Formats disponibles

Partager ce document

Partager ou intégrer le document

Options de partage

Avez-vous trouvé ce document utile ?

Ce contenu est-il inapproprié ?

Droits d'auteur :

Formats disponibles

Pachot Hueber OracleDatabaseAppliance

Transféré par

Droits d'auteur :

Formats disponibles

Infrastructure at your Service.

Oracle Database Appliance

Oracle Database Appliance

Infrastructure at your Service.

Oracle Database Appliance

Leading In Infrastructure Services

Oracle Database Appliance

Oracle Database Appliance

ODA overview and architecture

ODA overview and architecture

Oracle Database Appliance

ODA overview and architecture

2 x 8-cores Intel Xeon E5-2690 / 2 x 12-cores Intel Xeon E5-2697v2

Oracle Database Appliance

ODA overview and architecture

Redundant Power Supply

Oracle Database Appliance

Redundant Power Supply

ODA overview and architecture

Oracle Database Appliance

ODA overview and architecture

Oracle Database Appliance

ODA overview and architecture

Oracle Database Appliance

ODA overview and architecture

SAS-2 Storage connectors

Oracle Database Appliance

ODA overview and architecture

Depends on backups location

Oracle Database Appliance

ODA overview and architecture

Storage Shelf backplane

Oracle Database Appliance

ODA overview and architecture

Storage Shelf backplane

Oracle Database Appliance

ODA overview and architecture

Oracle Database 11.2.0.4.2

Oracle Database Appliance

ODA overview and architecture

> OAKCLI overview

Used for VMs management

Oracle Database Appliance

Get storage hardware details

Oracle Database Appliance

Very small (XS) to Extra Extra Large (XXL)

Oracle Database Appliance

Log files size (GB)

*Recommended limit per node

Done using oakcli as root user

[root@dbi-oda1 ~]# oakcli create database -h

Oracle Database Appliance

Does not delete the corresponding ORACLE_HOME

Oracle Database Appliance

name of the database

ODA Advanced Get full power

Oracle Database Appliance

ODA Advanced Get full power

ASMM Automatic Shared Memory Management

SQL> show parameter pga

Oracle Database Appliance

ODA Advanced Get full power

SGA allocation in huge pages

By default databases cant used more than 50% of ODAs RAM