Académique Documents
Professionnel Documents
Culture Documents
After carefully testing several data warehouse platforms, we chose the Oracle Database Machine. Oracle Exadata was able to speed up one of our critical processes from days to minutes..
Brian Camp, Sr. VP of Infrastructure Services
Agenda
Overview Exadata Based Product Offerings Exadata Architecture and Features Best Data Warehousing Machine Best OLTP Machine Best Consolidation Machine
The Products
Exadata Storage Server & Database Machine
Exadata Storage Server
Storage Product Optimized for Oracle Database Extreme I/O and SQL Processing performance Combination of hardware and software
Storage Bottlenecks
Data Bandwidth limits severely restrict performance for data warehousing Random I/O bottlenecks limit performance of OLTP applications
8
Oracle solves random I/O bottlenecks using Exadata Smart Flash Cache
Increase random I/Os by factor of 20X
10
Sun Oracle Database Machine delivers the first and only complete grid architecture for all data management needs
InfiniBand Network
40 Gb/sec fault-tolerant unified server and storage network
11
Extreme Performance
InfiniBand Network
880 Gb/sec aggregate throughput
12
Quarter Rack
Half Rack
Full Rack
13
Scalable
Scales to 8 rack database machine by just adding wires
Multi-petabyte databases
14
Months to Days
15
Hardware by
Software by
16
Pre-installed Software: InfiniBand QDR (40Gb/s) dual port card Oracle Exadata Storage Server Software 4 x 96GB Sun Flash PCIe Cards Oracle Enterprise Linux Drivers
17
1 Admin Cisco Ethernet switch Keyboard, Video, Mouse (KVM) hardware Redundant Power Distributions Units (PDUs) Single Point of Support from Oracle 3 year, 24 x 7, 4 Hr On-site response
18
1 Admin Cisco Ethernet switch Keyboard, Video, Mouse (KVM) hardware Redundant PDUs Single Point of Support from Oracle 3 year, 24 x 7, 4 Hr On-site response
19
2 Sun Fire X4170 Oracle Database servers 3 Exadata Storage Servers (All SAS or all SATA) 2 Sun Datacenter InfiniBand Switch 36 36-port Managed QDR (40Gb/s) InfiniBand switch 1 Admin Cisco Ethernet switch Keyboard, Video, Mouse (KVM) hardware Redundant PDUs Single Point of Support from Oracle 3 year, 24 x 7, 4 Hr On-site response
20
21
Customer supplied x86 64-bit Linux Database Servers Hardware installation more complex No single point of support for entire deployment
22
24 TB
384 GB
72 TB
1.1 TB 6 TB 21 TB
168 TB
2.6 TB 14 TB 50 TB
336 TB
5.3 TB 28 TB 100 TB
SAS SATA
2 TB 7 TB
1 Raw capacity calculated using 1 GB = 1000 x 1000 x 1000 bytes and 1 TB = 1000 x 1000 x 1000 x 1000 bytes. 2 - User Data: Actual space for end-user data, computed after single mirroring (ASM normal redundancy) and after allowing space for database structures such as temp, logs, undo, and indexes. Actual user data capacity varies by application. User Data capacity calculated using 1 TB = 1024 * 1024 * 1024 * 1024 bytes.
23
SAS SATA
1 Bandwidth is peak physical disk scan bandwidth, assuming no compression. 2 - Max User Data Bandwidth assumes scanned data is compressed by factor of 10 and is on Flash. 3 IOPs Based on IO requests of size 8K 4 - Actual performance will vary by application.
24
25
Exadata Configuration
Single-Instance Database RAC Database
InfiniBand Switch/Network
Exadata Cell
Exadata Cell
Exadata Cell
Each Exadata Cell is a self-contained server which houses disk storage and runs the Exadata software Oracle Databases are deployed across multiple Exadata Cells Oracle Database enhanced to work in cooperation with Exadata Storage Server No practical limit to number of Cells that can be in the grid
26
Exadata Architecture
Single-Instance Database DB Server DB Instance DBRM ASM RAC Database DB Server DB Server DB Instance DBRM ASM DB Instance DBRM ASM
Enterprise Manager
InfiniBand Switch/Network
OEL
CELLSRV
OEL
CELLSRV
CELLSRV
27
28
29
I/Os Issued
Smart Scan Example: Telco wants to identify customers that spend more than $200 on a single phone call Rows Returned The information about these premium customers occupies 2MB in a 1 terabyte table With traditional storage, all DB Host reduces database intelligence resides terabyte of data to 1000 in the database hosts customer names that are returned to client Very large percentage of data returned from storage is discarded by database servers Discarded data consumes valuable resources, and I/Os Executed: impacts the performance of 1 terabyte of data other workloads
returned to hosts
30
customer_name and required rows where amount>200 are are returned to hosts
Smart Scan identifies rows and columns within terabyte table that match request
Copyright 2009, Oracle Corporation and/or its affiliates
31
32
11.2
All data mining scoring functions offloaded to Exadata Up to 10x performance gains Reduced CPU utilization on Database Server
33
11.2
Index
Exadata Storage Indexes maintain summary information about table data in memory
Store MIN and MAX values of columns Typically one index entry for every MB of disk
Min B = 1 Max B =5 Eliminates disk I/Os if MIN and MAX can never match where clause of a query Min B = 3 Completely automatic and transparent Max B =8
8
3
Select * from Table where B<2 - Only first set of rows can match
34
35
11.2
50X
36
Up To
37
Archive Compression
Optimized for Space 15x average storage savings
Up to 50x on some data
38
50 45 40 35 30 25 20 15 10 5 0
43 29 16 19 19 19 20 21
10
10
10
11
Columnar compression ratios Query = 14.6X Archive = 22.6X Vary by application and table
Copyright 2009, Oracle Corporation and/or its affiliates
39
11.2
Ideal Solution - Exadata Smart Flash Cache Tens of Thousands of I/Os per Second
Keep most data on disk for low cost Transparently move hot data to flash Use flash cards instead of flash disks to avoid disk controller limitations Flash cards in Exadata storage High bandwidth, low latency interconnect 4 x 96GB PCI Express Flash Cards per Exadata Server
40
11.2
Caches data intelligently to maximize Flash memory usage for frequently read data Automatically skips caching of infrequently read objects
Backups not cached Secondary copy of mirrored user data not cached I/Os due to ASM rebalance operations not cached.
User can further optimize caching policies by specifying whether or not to cache specific database objects.
41
11.2
Integrated solution provides performance of Flash at the price of traditional disks Exadata Flash Cache is shared across all the database nodes of a cluster unlike flash cards inserted in a database server Exadata Flash Cache does not duplicate data cached in other Exadata Storage Servers Exadata Flash Cache benefits from Exadatas scale-out architecture. More capacity and bandwidth as you add more Exadata Storage Servers Can run Smart Scans against contents in the Exadata Flash Cache Can simultaneously issue I/O to the Flash cards and the physical disks for even higher performance
42
11.2
Configure a portion or all of the Flash memory to act as persistent Logical Flash Disks Treat them just like regular disks
Create ASM diskgroups across these Flash disks like any other ASM diskgroup Data is automatically mirrored by ASM across these Flash disks with the mirrored copy on other Exadata Storage Servers
43
InfiniBand Switch/Network
Exadata Cell
Exadata Cell
Exadata Cell
44
Ensure different users and tasks within a database are allocated the correct relative amount of I/O bandwidth
Database A: Reporting: 60% of I/O resources ETL: 40% of I/O resources Database B: Interactive: 30% of I/O resources Batch: 70% of I/O resources
InfiniBand Switch/Network
Exadata Cell
Exadata Cell
Exadata Cell
45
Single-Instance Database
RAC Database
InfiniBand Switch/Network
Exadata Cell
Exadata Cell
Exadata Cell
46
ASM disk
Grid Disk n
Sys Area
ASM disk
47
Exadata Cell
Exadata Cell
Hot Cold
Hot Cold
Hot Cold
Hot
Cold
ASM hot and cold Disk Group Two ASM disk groups created across the two sets of grid disks ASM striping evenly distributes I/O across the disk groups ASM mirroring is used to protect against disk failures ASM failure groups are used to protect against cell failures
48
11.2
Grid Disk 1
Hot Data, Cold Data
Grid disks are optionally split and interleaved to place frequently accessed data in all grid disks on higher performing outer tracks All applications benefit from higher performance outer tracks of disks
Grid Disk 2
Hot Data, Cold Data
49
Comprehensive CLI
Local Exadata Storage cell management Distributed shell utility to execute CLI across multiple cells
50
51
Data Guard provides disaster protection and data corruption protection Flashback provides human error protection Recovery Manager (RMAN) provides backup to disk
52
Database Server
Exadata
Non-Exadata
Online migration if currently using ASM and ASM redundancy Migration can be done using RMAN or Data Guard
Online Migration
53
54
OLAP
ETL
OLAP, Statistics, Spatial, Data Mining, Real-time transactional ETL, Efficient point queries
Data Mining
New
55
56
11.2
A single database machine has over 400GB of memory usable for caching Database release 11.2 introduces parallel query processing on memory cached data
Harnesses memory capacity of entire database cluster for queries Foundation for world record 1TB TPC-H
315,842
ParAccel
Exasol
Exadata Hybrid Columnar Compression enables multi-terabyte tables or partitions to be cached in memory
Memory has 100x more bandwidth than Disk
Source: Transaction Processing Council, as of 9/14/2009: Oracle on HP Bladesystem c-Class 128P RAC, 1,166,976 QphH@1000GB, $5.42/QphH@1000GB, available 12/1/09. Exasol on PRIMERGY RX300 S4, 1,018,321 QphH@1000GB, $1.18/QphH@1000GB, available 08/01/08. ParAccel on SunFire X4100 315,842 QphH@1000GB, $4.57 /QphH@1000GB, available 10/29/07.
57
Benefits Multiply
1 TB with compression
58
5 to 7 GB/sec file system I/O throughput Load into database using External Tables
ETL
59
60
61
Exadata Flash
Solves the Random I/O Bottleneck
11.2
Sun Oracle Database Machine has 5+ TB of flash storage Exadata Smart Cache caches hot data Database Machine achieves: 20x more random I/Os Over 1 million per second 2x faster sequential query I/O 50 GB/sec 10x better I/O response time Sub-millisecond Greatly Reduced Cost 10x fewer disks for IOPS Lower Power
62
WAN
Protection from
Server Failures Storage Failures Network Failures Site Failures
63
Configuration Management
Access Control
Audit Vault
Total Recall
Database Vault
Encryption and Masking
Label Security
Advanced Security
Secure Backup
Data Masking
64
65
Consolidation
ERP CRM ERP
CRM
HR
Warehouse
Warehouse
Data Mart
Data Mart HR
The Sun Oracle Database Machine handles any combination of workloads with extreme performance
And predictable response times
67
Consolidate Storage
Exadata and ASM allow all storage servers to be shared across databases
ERP CRM Warehouse Data Mart HR
Shared Configuration
Advanced data striping spreads every database across all storage servers Eliminates hot-spots and captive unused space Full storage grid performance available to all databases Database or cluster level storage security
Predictable Performance
Exadata I/O resource manager prioritizes I/Os to ensure predictable performance At user, job, application, or database level No need for isolated storage islands
68
Consolidate Servers
Many databases can run on Database Machine servers Shared Configuration
CRM Applications connect to a database service that runs on one or more database nodes Services can grow, shrink, & move dynamically Large databases can span nodes using RAC Multiple small databases can run on a single node
ERP
Warehouse
HR
Data Mart
Predictable performance
Instance caging provides predictable CPU resources when multiple databases run on the same node Restricts a database to subset of processors
69
70
Resources
Oracle.com:
http://www.oracle.com/exadata
http://www.oracle.com/technology/products/bi/db/exadata/pdf/migr ation-to-exadata-whitepaper.pdf
71
72