Exadata X6 Hardware Overview

Exadata Hardware Overview
X6
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 1

Oracle Exadata Database Machine Vision
• The best platform for all Oracle Database workloads
– Warehousing  OLTP  Consolidation  In-Memory Database
• Latest, most advanced hardware

– Fully scale-out servers and intelligent storage with unified InfiniBand
connectivity and PCI flash
• Unique software that maximizes the Oracle Database

– Database optimized compute, storage, and networking software
dramatically improves performance and cost
• Standardized, optimized, hardened end-to-end

– By the core Oracle RDBMS development team

Exadata Hardware

Exadata Hardware Architecture
Complete | Optimized | Standardized | Hardened Database Platform
 Standard Database Servers
– 2-socket server  44 cores, up to 768GB DDR4 DRAM
or
– 8-socket server  144 cores, up to 6TB DRAM
 Unified Ultra-Fast Network

– 40 Gb InfiniBand internal connectivity
– 10 Gb or 1 Gb Ethernet data center connectivity
 Scale-out Intelligent Storage Servers

– Extreme Flash Storage Server  25.6 TB NVMe Flash
– High Capacity Storage Server  12.8 TB NVMe Flash
+ 96 TB SAS drives
Fully Redundant – 2-socket servers  20 cores per server

Pre-built and Optimized Out-of-the-Box
100%
Custom Configuration
Test & debug

failure modes
Performance Achievement
Performance Achievement
Measure,
diagnose, Multi-
Assemble tune and
dozens of vendor
reconfigure finger
components
pointing
Time Time
(Days) (Months)

Standardized and Simple to Deploy
• All Database Machines are the same
– Delivered ready-to-run ‒ No unique configuration issues
– Tested ‒ Identical to configuration used
by Oracle Engineering
– Highly supportable
• Runs existing OLTP and DW applications
– Full 30 years of Oracle DB capabilities
– No Exadata certification required
• Leverages Oracle ecosystem
– Skills, knowledge base, people and partners
Deploy in Days,
Not Months

Elastically Scale-Out from Eighth-Rack to Multi-Rack
Eighth
Quarter
Half Full
Multi-Rack
• Start with 2 Database Servers and 3 Storage Servers
- Add Database or storage servers as needed
- Use Oracle Exadata Configuration Assistant (OECA) to Create Desired Configuration
• Expand older machines with new generation servers
Two Types of Database Servers
• X6-2 Machines use 2-socket database servers
– Mainstream Exadata platform
– Available in Eighth Rack and Quarter Rack as well many other Elastic Configurations
• X6-8 Machines use 8-socket database servers

– Available in Half Rack and Elastic Configurations
– Higher-end configuration
• Larger SMP nodes
• More memory
– Well suited for high-end OLTP workloads, large scale consolidation of databases,
memory intensive workloads, and multi-rack data warehouses
• Both use exactly the same storage servers and InfiniBand

Exadata X6-2 Database Server plus InfiniBand Infrastructure
New 22-core “Broadwell-EP” CPUs, DDR4 2400 Memory expandable to 768 GB
Processors 2 Twenty-two-Core Intel® Xeon® E5-2699 v4 Processors (2.2GHz)

DDR4 2400 Memory 256 GB (8 x 32GB) – Expandable to 768 GB (24 x 32GB) via memory kits
Local Disks 4 x 600GB 10K RPM SAS Disks (Hot-Swappable) – Expandable to 8 x
Disk Controller Disk Controller HBA with 1GB Cache – No More batteries
Network 2 x InfiniBand 4X QDR (40Gb/s) Ports (PCIe 3.0) – Both Ports Active
4 x 1GbE/10GbE Base-T Ethernet Ports
2 x 10GbE Ethernet SFP+ Ports (1 Dual-port 10GbE PCIe 2.0 network
card based on the Intel 82599 10GbE Controller technology)
Remote 1 Ethernet port (ILOM)
Management
Power Supplies Redundant Hot-Swappable power supplies and fans

Exadata X6-8 Database Server plus InfiniBand Infrastructure
18-core “Haswell-EX” CPUs, Up to 3X More Memory
Processors 8 Eighteen-Core Intel® Xeon® E7-8895 v3 Processors (2.6GHz)
DDR3 Memory 2 TB (64 x 32GB) - Expandable to 6TB (192 X 32GB)
Local Disks 8 x 600GB 10K RPM SAS Disks (Hot-Swappable)
Disk Controller Disk Controller HBA with 1GB Cache – No More batteries
Network 8 x InfiniBand 4X QDR (40Gb/s) Ports (PCIe 3.0) – All Ports Active
10 x 1GbE Base-T Ethernet Ports (2 Quad-port PCIe 2.0 network card, and 2
embedded ports based on the Intel I350 1GbE Controller technology)
8 x 10GbE Ethernet SFP+ Ports (4 Dual-port 10GbE PCIe 2.0 network card
based on the Intel 82599 10GbE Controller technology)
Remote Management 1 Ethernet port (ILOM)
Power Supplies Redundant Hot-Swappable power

supplies and fans

Two Types of Storage Servers
• X6-2 Extreme Flash (EF) Storage Server
Industry Leading I/O Performance
– All Flash, Scale-out, Highly Available, InfiniBand Connected Smart Storage
– 8x front mounted 3.2TB PCIe flash drives
• State-of-the-art NVMe interface optimized for low-overheard
• No flash cache misses, so predictably low flash response times
– Capacity increases to 25.6 TB, doubling previous generation EF PCIe Flash drives
• X6-2 High Capacity (HC) Storage Server

More Flash, Higher Performance
– Tiered, Scale-out, Highly Available, InfiniBand Connected Smart Storage
– 12 front mounted 8 TB High Capacity Disks – 1344 TB per Rack
– 4x 3.2TB PCIe flash cards per storage server
• State-of-the-art NVMe interface optimized for low-overheard
• Smart Flash Cache intelligently manages flash

Exadata X6-2 EF Storage Server plus InfiniBand Infrastructure
New 10-core “Broadwell-EP” CPUs, NVMe Flash Drive, No Spinning Drive
Processors 2 Ten-Core Intel® Xeon® E5-2630 v4 2.2 GHz-More Cores

DDR4 Memory 128 GB (8 x 16GB)
Drives 8 x 3.2 TB 2.5-inch Flash Accelerator F320 PCIe Drives

Non Volatile Memory Express (NVMe) protocol
Network 2 InfiniBand 4X QDR (40Gb/s) Ports (PCIe 3.0) – All Ports Active
Embedded Gigabit Ethernet Ports for management connectivity
Power Supplies Redundant Hot-Swappable power supplies and fans

Exadata X6-2 Storage Server HC plus InfiniBand Infrastructure
New 10-core “Broadwell-EP” CPUs, Larger NVMe Flash Cards
Processors 2 Ten-Core Intel® Xeon® E5-2630 v4 2.2 GHz - More Cores

DDR4 Memory 128 GB (8 x 16GB)
Disks 12 x 8 TB 7.2K RPM High Capacity SAS (hot-swap) – 3.5” disk size
Flash 4 x 3.2 TB Flash Accelerator F320 PCIe Card

Non Volatile Memory Express (NVMe) protocol
Disk Controller Disk Controller HBA with 1 GB Cache - No more batteries
Network 2 InfiniBand 4X QDR (40Gb/s) Ports (PCIe 3.0) – All Ports Active
Embedded Gigabit Ethernet Ports for management connectivity
Power Supplies Redundant Hot-Swappable
power supplies and fans

Exadata Database Machine X6-2 X6-2 In-Memory X6-2 Flash OLTP
Elastic Configuration
• Start with a Quarter rack
– 2x Exadata X6-2 Database Servers
– 3x X6-2 High Capacity Storage Servers Or
3x X6-2 Extreme Flash Storage Servers
• Add up to 17 more X6-2 Database Servers (Max 19…1RU each in size)

• Add up to 15 more X6-2 Storage Servers (Max 18…2RU each in size)
– When adding, can mix Extreme Flash and High Capacity Storage Servers
• Maximum of 22 servers or 38 RU of servers per rack

• Elastic Configuration Tool (OECA) available to demonstrate multiple
server configuration possibilities
• 2x Sun Datacenter InfiniBand Switch 36
• 36-port Managed QDR (40Gb/s) switch
• 1 “Admin” Ethernet switch
• Redundant Power Distributions Units
16x Database Servers 8x Database Servers
5 x HC Storage Servers 8x EF Storage Servers

Exadata Database Machine X6-8 X6-8 In-Memory X6-8 Flash OLTP
Elastic Configuration
• Start with a Half rack
– 2x X6-8 Database Servers (eight socket)
– 3x X6-2 High Capacity Storage Servers Or
3x X6-2 Extreme Flash Storage Servers
• Add up to 2 more X6-8 Database Servers (Max 4…5RU in size)

• Add up to 11 more X6-2 Storage Servers (Max 14…2RU in size)
– When adding, can mix Extreme Flash and High Capacity Storage Servers
• Elastic Configuration Tool (OECA) available to demonstrate multiple

server configuration possibilities
• 2x Sun Datacenter InfiniBand Switch 36
• 36-port Managed QDR (40Gb/s) switch
• Redundant Power Distributions Units
4x Database Servers 4x Database Servers
6x HC Storage Servers 8x EF Storage Servers

Exadata Memory Expansion Kit
• DDR4 2400 Optional kit for X6-2 customers who consolidate large numbers
of databases or require more memory
– Expands memory configuration of the X6-2 database server from 256 GB (8 x 32 GB)
to 512 GB (16 x 32 GB) or to 768 GB (24x 32GB)
– No need to remove existing DIMMs, just add new DIMMS to expand memory
• DDR3 LRDIMM optional Memory expansion kit for X6-8 customers who
consolidate large numbers of databases or require more memory
– Adds additional 32 GB DIMMs to database servers
– Expands memory configuration of the X6-8 database server from 2 TB (64 x 32 GB) to
4 TB (128 x 32 GB) or to 6 TB (192 x 32 GB)

Exadata Storage Expansion X6-2 Quarter Rack
For additional storage – backups, historical data, unstructured data, etc.
• Start with Quarter Rack Storage Expansion

– 4x X6-2 High Capacity Storage Server Or
4x X6-2 Extreme Flash Storage Server
– Add up to 15 more X6-2 Storage Servers (max of 19 per rack)
• Additional servers can be a mix of Extreme Flash and High Capacity Storage
• 3 Sun Datacenter InfiniBand Switch 36
– 36-port Managed QDR (40Gb/s) switch
– Note that storage expansion racks always includes a third switch to
be used for connecting to other Database Machine racks
Add storage servers online
• Redundant Power Distributions Units (PDUs)
Use (OECA) for
Exadata Database Machine Standard Configurations others
X6-8 Full X6-8 Half X6-2 Full X6-2 Half X6-2 Quarter X6-2 Eighth
Database Servers 2 2 8 4 2 2
Database Grid Cores 288 288 352 176 88 44
4096 DDR3 4096 DDR3 2048 DDR4 1024 DDR4 512 DDR4 512 DDR4
Database Grid Memory (GB) (max 12288) (max 12288) (max 6144) (max 3072) (max 1536) (max 1536)
InfiniBand Switches 3 2 3 3 2 2
Management Ethernet Switch 1 1 1 1 1 1
Exadata Storage Servers 14 3 14 7 3 3
Storage Grid CPU Cores 280 60 280 140 60 30
EF 358.4 TB 76.8 TB 358.4 TB 179.2 TB 76.8 TB 38.4 TB
Raw PCI Flash Capacity
HC 179.2 TB 38.4 TB 179.2 TB 89.6 TB 38.4 TB 19.2 TB
EF - - - - - -
Raw Hard Disk Capacity
HC 1344.0 TB 288.0 TB 1344.0 TB 672.0 TB 288.0 TB 144.0 TB
EF 130.0 TB 27.9 TB 130.0TB 65.0 TB 27.9 TB 13.9 TB

Usable mirrored capacity
HC 508.3 TB 108.9 TB 508.3 TB 254.2 TB 108.9 TB 54.5 TB
Usable Triple mirrored (High EF 102.0 TB 21.9 TB 102.0 TB 51.0 TB 21.9 TB 10.9 TB
Redundancy) capacity HC 398.6 TB 85.4 TB 398.7 TB 199.4 TB 85.4 TB 42.7 TB

Exadata Storage Expansion Rack Summary
X6-2 Quarter Single Storage Cell
InfiniBand switches 3 N/A
Management Ethernet switch 1 N/A
Exadata Storage Servers 4 1
Storage Grid CPU Cores 80 20
Extreme Flash 102.4 TB 25.6 TB
Raw PCI Flash Capacity
High Capacity 51.2 TB 12.8 TB
Extreme Flash - -
Raw Hard Disk Capacity
Extreme Flash 37.1 TB 9.3 TB
Usable mirrored capacity
Use (OECA) for
Usable Triple mirrored (High Extreme Flash 29.1 TB 7.3 TB other
configurations
Redundancy) capacity High Capacity 113.9 TB 28.5 TB

Automatic Service Request (ASR)
• Automatically opens a Service Request (SR) to Oracle Support Services
when Exadata hardware fault occurs
• Hardware component faults include disk, flash, memory, processor, fan,
power supply, etc
• ASR is a complementary mechanism to expedite and simplify hardware
replacement. It is not a replacement for other monitoring mechanisms (i.e.
SMTP and SNMP alerts)

Onsite Re-rack of Half, Qtr, and Eighth Racks
• Re-rack of Exadata hardware components to customer
provided rack. Used when data center requires
specialized racks
— Example – specialized racks with thermal containment
— Customer rack must satisfy a set of technical specs
• Only Exadata “Two-Socket” Racks may be Re-racked
— Use Oracle Exadata Configuration Assistant (OECA) to
determine if current configuration is approved for Re-rack
• Additional re-rack service fee in addition to standard HW
installation and SW configuration fees
• Re-racking performed at customer location by Oracle
HW service engineers prior to standard install
Environmental
Information

Use (OECA) for other
Exadata X6-2 Environmental (HC Disks) configurations
X6-2 Full HC * X6-2 Half HC * X6-2 Quarter HC X6-2 Eighth HC

Max 14.8 kW (15.0 kVA) 8.0 kW (8.2 kVA) 4.0 kW (4.1 kVA) 3.3 kW (3.4 kVA)
Power
Typical 10.4 kW (10.6 kVA) 5.6 kW (5.7 kVA) 2.8 kW (2.9 kVA) 2.3 kW (2.3 kVA)
50,455 BTU/hr 27,335 BTU/hr 13,679 BTU/hr 11,207 BTU/hr

Max 53,230 kJ/hr 28,838 kJ/hr 14,432 kJ/hr 11,823 kJ/hr
Cooling
Typical 37,261 kJ/hr 20,187 kJ/hr 10,102 kJ/hr 8,276 kJ/hr
Airflow: Max (CFM) 2336 1265 633 519

front-to-back Typical (CFM) 1635 886 443 363
Rack 1928.5 lbs (874.8 kg) 1236.5 lbs (560.9 kg) 840.5 lbs (381.2 kg) 810.3 lbs (367.6 kg)
Weight
Shipping Wt 2074.5 lbs (941.0 kg) 1382.5 lbs (627.1 kg) 986.5 lbs (447.5 kg) 956.3 lbs (433.8 kg)
Acoustics 8.6B (operating) 8.5B (operating) 8.3B (operating) 8.3B (operating)
Dimensions 78.66” (H) x 23.62”(W) x 47.24”(D) (1998mm (H) x 600mm (W) x 1200mm (D))
5 ºC to 32 ºC (41 ºF to 89.6 ºF), 10% to 90% relative humidity, non-condensing . Altitude Operating: Up to 3,048 m,
Operating Temperature max. ambient temperature is de-rated by 1° C per 300 m above 900 m
* Assume rack has spine switch

Exadata X6-2 Environmental (EF Disks) configurations
X6-2 Full EF * X6-2 Half EF * X6-2 Quarter EF X6-2 Eighth EF

Power

Cooling
Airflow: Max (CFM) 2245 1220 614 507

Rack 1774.5 lbs (804.9 kg) 1159.5 lbs (525.9 kg) 807.5 lbs (366.3 kg) 807.5 lbs (366.3 kg)
Weight
Shipping Wt 1920.5 lbs (871.1 kg) 1305.5 lbs (592.2 kg) 953.5 lbs (432.5 kg) 953.5 lbs (432.5 kg)

Exadata X6-8 Environmental (EF and HC) configurations
X6-8 Full EF * X6-8 Full HC * X6-8 Half EF X6-8 Half HC

Power

Cooling
Airflow: Max (CFM) 2479 2570 1478 1497

Rack 1826.5 lbs ( 828.5 kg) 1980.5 lbs ( 898.3 kg) 1159.5 lbs ( 525.9 kg) 1192.5 lbs ( 540.9 kg)
Weight
Shipping Wt 1972.5 lbs (894.7kg) 2126.5 lbs (964.6 kg) 1305.5 lbs ( 592.2 kg) 1338.5 lbs ( 607.1 kg)
5 ºC to 32 ºC (41 ºF to 89.6 ºF), 10% to 90% relative humidity, non-condensing . Altitude Operating:
Operating Temperature Up to 3,048 m, max. ambient temperature is de-rated by 1° C per 300 m above 900 m

Storage Expansion X6-2 Environmental (EF and HC Disks) configurations
Quarter HC Quarter EF
Max 3.6 kW (3.7 kVA) 3.4 kW (3.5 kVA)
Power
Typical 2.5 kW (2.6 kVA) 2.4 KW (2.4 kVA)
12,239 BTU/hr 11,680 BTU/hr

Max 12,913 kJ/hr 12,322 kJ/hr
Cooling
8,568 BTU/hr 8,176 BTU/hr
Typical 9,039 kJ/hr 8,626 kJ/hr
Airflow: Max (CFM) 567 541

front-to-back Typical (CFM) 397 379
Rack 847.5 lbs (384.4 kg) 803.5 lbs (364.5 kg)

Weight
Shipping Wt 993.5 lbs (450.6 kg) 949.5 lbs (430.7 kgs)
Acoustics 8.4B (operating) 8.4B (operating)
5 ºC to 32 ºC (41 ºF to 89.6 ºF), 10% to 90% relative humidity, non-condensing .

Operating Temperature Altitude Operating: Up to 3,048 m, max. ambient temperature is de-rated by 1° C
per 300 m above 900 m

Exadata X6-2 Single Server Environmental configurations
X6-2 Single HC X6-2 Single EF X6-2 Single DB X6-8 Single DB

Power

Cooling
Airflow: Max (CFM) 93 86 105 537

Weight Rack 73.0 lbs (33.1 kgs) 62.0 lbs (28.1 kgs) 45.0 lbs (20.4 kgs) 206.0 lbs (93.4 kgs)
Acoustics 7.8 B (operating) 7.8 B (operating) 7.8 B (operating) 8.1 B(operating)

Typical Data Center Deployment (Airflows)
Rack Rear
• Assuming perforated tiles (~ 400 CFM/tile) in front of
Hot Air Outlet the rack for cold air intake
— 4 floor tiles for Full Rack
— 3 floor tiles for Half Rack
— 1 floor tile for Quarter Rack
• Tiles can be arranged in any order in front of the rack
Rack Front as long as cold air from the tiles can flow into the rack
Cold Air Inlet • Inadequate cold air flow could result in higher air inlet
temperatures in the servers due to exhaust air
recirculation
Each data center has a unique environment, therefore a universal optimal

deployment is not possible

PDU Choices

Exadata Database Machine PDUs
Single Phase Three Phase
GEOGRAPHY X6-2 <= 11 X6-2 > 11 X6-2 Storage X6-2 <= 11 X6-2 > 11 X6-2
Total Servers Total Servers Expansion Total Servers Total Servers Storage
Expansion
Low Voltage LV TBD kVA Low Voltage Low Voltage LV TBD kVA Low Voltage
Americas / Japan / Taiwan
15 kVA See OECA 15 kVA 15 kVA See OECA 15 kVA
High Voltage High Voltage High Voltage High Voltage HV TBD kVA High Voltage
EMEA / APAC (excl Japan /Taiwan)
22 kVA 22 kVA 22 kVA 15 kVA See OECA 15 kVA
Single Phase Three Phase

GEOGRAPHY X6-8 <= 3 X6-8 = 4 X6-8 <= 3 X6-8 = 4
DB Servers DB Servers DB Servers DB Servers
Low Voltage Low Voltage Low Voltage

Americas / Japan / Taiwan N/A
22kVA 24kVA 37kVA
High Voltage High Voltage High Voltage
EMEA / APAC (excl Japan /Taiwan) N/A
22kVA 24kVA 37kVA

Low Voltage Single Phase PDU (Americas / Japan/ Taiwan)
Specifications 15kVA ATO Part Number Spare or PTO Part Number
Number of Inputs 3x 30A per PDU 6442A XSR-15K-L630-N
Voltage 200 - 240 VAC 7105793 for EMEA
Notes:
Frequency 50/60 Hz 1. 2x PDUs needed for new orders (ATO)
Output Current 72A per PDU 2. 2x PDUs needed for swaps (PTO or Spare)
3. Use OECA to size PDUs for Customer Order
Outlets 42x C13 6x C19
Outlet Groups 6 Handling Customer requests to install less power than specified
1. Eighth and Quarter Racks are approved to remove 2x Inputs per PDU
Data Center 2. Half Racks are approved to remove 1x Input per PDU
Receptacle NEMA L6-30R
3. OECA must be consulted to determine what outlets must be moved
• Remove Inputs to the PDU from the top of the rack down
• Any servers connected to outlets where an input was removed
must have their plug relocated
• i.e. Quarter Racks relocate server plugs for outlets in the OECA
1Ph LV PDU details Grey Zone to the Yellow Zone for Input 2 Removal—
15kVA PDU Example on Next Slide
Plug • FE will update the tracking system with the above deviation

Relocating Outlets in a 1Ph 15kVA PDU Equipped Qtr Rack
• Customer Data Center is only able to supply 1x 30A Input per PDU
DISCOLSURES:
• OECA environmental calculations will deviate from new actuals
• Jumpers may not route through the CMA Step 1: Load the Customer Configuration in OECA and work with a
• Increases possibility of power loss when removing servers picture similar to the one to the Left
and hot swapping components
• Restore power when expanding and return outlets to original
Step 2: PDU-A P3 and PDU-B P1 may be removed. No outlet
locations
• Ensures correct power routing and OECA calculated values reassignments required
are correct
• No Additional equipment can be added
• Not supported for Re-Rack service
Step 5: PDU-B, G2-5 and G2-6 will be relocated to G4-2 and G4-3
respectively
Step 3: PDU-A, G3-1 and G3-0 will be
relocated to G1-4 and G1-3
Step 6: PDU-B, G3-5 will be relocated to G4-4. G5+G4 Total is also
4,107W which is below the 5000W max for G5+G4
Step 4: PDU-A, G2-1 will be relocated
G1-2. Note: New G1+G0 total is
4,107W which is below the 5000W max Step 8: PDU-B P2 may be removed once the
for G1+G0 above outlet reassignments are completed
Step 7: PDU-A P2 may be removed

once the above outlet reassignments
are completed
Step 9: Recheck connections and power on the machine. Ensure
all remaining install checklists are completed.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Low Voltage Three Phase PDU (Americas / Japan/ Taiwan)
Specifications 15kVA
ATO Part Number Spare or PTO Part Number
Number of Inputs 1x 60A 3Ph Per PDU 6440A XSR-15KIEC309-4P-N
Voltage 200 - 208 VAC 3Ph 7105792 for EMEA
Frequency 50/60 Hz
Notes:
Output Current 69A Per PDU 1. 2x PDUs needed for new orders (ATO)
2. 2x PDUs needed for swaps (PTO or Spare)
Outlets 42x C13 6x C19
3. Use OECA to size PDUs for Customer Order
Outlet Groups 6
IEC309-3P4W-IP67 60A Handling Customer requests to install less power than specified
Data Center 250VAC 3ph (Hubbell
Receptacle equivalent HBL460R9W) • There is 1x single input to each of the Low Voltage 3Ph 15kVA PDU
• All Inputs for this PDU must be wired at install to ensure maximum
rack availability
3Ph LV
15kVA PDU
Plug

Low Voltage Single Phase PDU (Americas / Japan/ Taiwan)
Number of Inputs 3x 36.8A Per PDU 7100873 7100342
Voltage 200 - 240 VAC
Frequency 50/60 Hz
Notes:
1. 2x PDUs needed for new orders (ATO)
Output Current 110.4A Per PDU 2. 2x PDUs needed for swaps (PTO or Spare)
Outlets 42x C13 6x C19 3. Use OECA to size PDUs for Customer Order
Outlet Groups 6
Handling Customer requests to install less power than specified
Data Center Hubbell 1. Eighth and Quarter Racks are approved to remove 2x Inputs per PDU
Receptacle CS8269 or CS8264 2. Half Racks are approved to remove 1x Input per PDU
• i.e. Quarter Racks relocate server plugs for outlets in the OECA PDU
details Grey Zone to the Yellow Zone for Input 2 Removal—Example
on Next Slide
1Ph LV
• FE will update the tracking system with the above deviation
22kVA PDU
Plug
• Customer Data Center is only able to supply 1x 36.8A Input per PDU
DISCOLSURES:
locations
are correct
respectively

are completed

Number of Inputs 2x 60A 3Ph Per PDU 6444A #371-4510
Voltage 200 - 208 VAC 3Ph
Frequency 50/60 Hz
Notes:
Output Current 120A Per PDU 2. 2x PDUs needed for swaps (PTO or Spare)
Outlet Groups 6
IEC309-3P4W-IP67 60A
Data Center 250VAC 3ph (Hubbell 1. Half Racks and less are approved to remove 1x Input per PDU
Receptacle equivalent HBL460R9W) 2. OECA must be consulted to determine what outlets must be moved
• i.e. Relocate server plugs for outlets in the OECA PDU details Upper
Yellow Zone to the Lower Yellow Zone when removing upper
input—Example on Next Slide
3Ph LV
22kVA PDU
Plug
Relocating Outlets in a 3Ph PDU Equipped Half Rack
• Customer DC is only able to supply 1x 60A 3Ph input per 24kVA PDU
Step 1: Load the Customer Configuration into OECA and
work with a picture similar to the one to the Left
Step 2: PDU-B, relocate existing G3-0 to G3-1
Step 3: PDU-B, relocate G0-6 to G3-0.

Step 4: PDU-A, relocate existing G0-6 to G0-5 Relocate G0-4 to G3-5.
Step 5: PDU-A, relocate G3-2 to G0-6.

Relocate G3-0 to G0-3.
Note: Given that outlets were relocated in
the same phase, the total W for the Phase,
DISCOLSURES:
• OECA environmental calculations will deviate from new actuals Phase 1 in this case, remains the same
• Jumpers may not route through the CMA
• Increases possibility of power loss when removing servers
• Restore Power Inputs when expanding and return outlets to
original locations
• Ensures correct power routing and OECA calculated values
are correct
• Not supported for Re-Rack service Step 6: Recheck connections, tuck/velcro wires. Power
on the machine. Ensure all remaining install checklists
are completed.

Specifications 37kVA Marketing Part Number Spare or PTO Part Number
Number of Inputs 3x 60A 3Ph Per PDU 7110975 XSR-37KIEC309-4P-N
Voltage 200 - 208 VAC 3Ph
Frequency 50/60 Hz
Notes:
Outlet Groups 6
Receptacle equivalent HBL460R9W)
3Ph LV
37kVA PDU
Plug

High Voltage Three Phase PDU EMEA / APAC (excluding Japan/ Taiwan)
Number of Inputs 1x 25A 3Ph Per PDU 6441A XSR-15KIEC309-U5P
Voltage 220/380 – 240/415 VAC 3Ph
Frequency 50/60 Hz
Notes:
Output Current 62.7A Per PDU 2. 2x PDUs needed for swaps (PTO or Spare)
Outlet Groups 6
Data Center 400VAC 3ph (Hubbell • There is 1x single input to each of the High Voltage 3Ph 15kVA PDUs
Receptacle equivalent HBL532R6W) • All Inputs for this PDU must be wired at install to ensure maximum
rack availability
1Ph HV
15kVA PDU
Plug

High Voltage Single Phase PDU EMEA / APAC (excluding Japan/ Taiwan)
Number of Inputs 3x 32A Per PDU 7100874 7100262
Voltage 220/380 – 240/415 VAC 7100343 for EMEA
Frequency 50/60 Hz
Notes:
Outlet Groups 6
Data Center 250VAC (Hubbell equivalent 1. Eighth and Quarter Racks are approved to remove 2x Inputs per PDU
Receptacle HBL332R6W) 2. Half Racks are approved to remove 1x Input per PDU
• Any servers connected to outlets where an input was removed must
have their plug relocated
• i.e. Quarter Racks relocate server plugs for outlets in the OECA PDU
details Grey Zone to the Yellow Zone for Input 2 Removal—Example on
Next Slide
3Ph HV • FE will update the tracking system with the above deviation
22kVA PDU
Plug
• Customer Data Center is only able to supply 1x 32A Input per PDU
DISCOLSURES:
locations
are correct
respectively

are completed

Number of Inputs 2x 25A 3Ph Per PDU 6445A #371-4977
Voltage 220/380 – 240/415 VAC 3Ph
Frequency 50/60 Hz
Notes:
Outlet Groups 6
Data Center 400VAC 3ph (Hubbell 1. Half Racks and less are approved to remove 1x Input/PDU
Receptacle equivalent HBL532R6W) 2. OECA must be consulted to determine what outlets must be moved
• i.e. Relocate server plugs for outlets in the OECA PDU details Upper
Yellow Zone to the Lower Yellow Zone when removing upper input
3Ph HV
24kVA PDU
Plug
Relocating Outlets in a 3Ph 24kVA PDU Equipped Half Rack
• Customer DC is only able to supply 1x 25A 3Ph input per 24kVA PDU
Step 1: Load the Customer Configuration into OECA and
work with a picture similar to the one to the Left
Step 2: PDU-B, relocate existing G3-0 to G3-1
Step 3: PDU-B, relocate G0-6 to G3-0.

Step 4: PDU-A, relocate existing G0-6 to G0-5 Relocate G0-4 to G3-5.
Step 5: PDU-A, relocate G3-2 to G0-6.

Relocate G3-0 to G0-3.
Note: Given that outlets were relocated in
the same phase, the total W for the Phase,
DISCOLSURES:
• OECA environmental calculations will deviate from new actuals Phase 1 in this case, remains the same
• Jumpers may not route through the CMA
• Increases possibility of power loss when removing servers
• Restore Power Inputs when expanding and return outlets to
original locations
• Ensures correct power routing and OECA calculated values
are correct
• Not supported for Re-Rack service Step 6: Recheck connections, tuck/velcro wires. Power
on the machine. Ensure all remaining install checklists
are completed.

Number of Inputs 3x 25A 3Ph Per PDU 7110976 XSR-37KIEC309-U5P
Voltage 220/380 – 240/415 VAC 3Ph #371-4978 for EMEA
Frequency 50/60 Hz
Notes:
Outlet Groups 6
Receptacle equivalent HBL532R6W)
3Ph HV
37kVA PDU
Plug

InfiniBand
Network

InfiniBand Network
• Unified InfiniBand Network
– Storage Network
– RAC Cluster Interconnect
– External Connectivity (optional)
• High Performance, Low Latency Network
– 80 Gb/s bandwidth per link (40 Gb/s each direction)
– SAN-like Efficiency (Zero copy, buffer reservation)
– Simple manageability like IP network
• Protocols
– Zero-copy Zero-loss Database Communication Protocol (ZDP RDSv3) Used by Database
• Low CPU overhead (Transfer multiple GB/s with 2% CPU usage)
– Internet Protocol over InfiniBand (IPoIB)
• Looks like normal Ethernet to host software (tcp/ip, udp, http, ssh,…)

InfiniBand Switches
• Uses Sun Datacenter 36-port Managed QDR (40Gb/s)

InfiniBand switches
– Runs subnet manager and automatically discovers network topology
– Only one subnet manager active at a time in entire connected fabric
• 2 “leaf” switches standard per rack for redundant

connectivity of servers within the rack
• 1 “spine” switch per rack added if Exadata rack will be

InfiniBand connected to other racks

InfiniBand HCA Cards in Servers
• Database Server and Exadata Servers

– Each X6-2 DB or storage server has a Dual-port QDR (40Gb/s) InfiniBand HCA
• X6-8 database server has 4 dual-port HCAs
– Active-Active Bonding – Assign two IP addresses per dual-port HCA for X6-2/X6-8
database and X6-2L storage servers
– Connect one port from the HCA to one leaf switch and the other port to the
second leaf switch for redundancy
– Connections pre-wired in the Factory

InfiniBand Wiring Internal to Exadata Racks
InfiniBand HCA Port 1 InfiniBand HCA Port 1
Servers in Bottom Half of Servers in Top Half of • Each Server HCA connects to both
Rack Rack leaf switches for redundancy
• Connections pre-wired at factory
7
Leaf switch #1 Leaf switch #2
InfiniBand HCA Port 2 InfiniBand HCA Port 2
Servers in Top Half of Servers in Bottom Half of

Rack Rack

Multi-rack Cabling – Fat Tree Topology
• Single InfiniBand Network across all connected racks
• Connect Racks using a “Fat Tree” Topology
– Valid up to 18 Racks with no external switches
– Every “leaf” switch inter-connected with every “spine” switch
– “Leaf” switches not connected with other “leaf” switches
– “Spine” switches not connected with other “spine” switches
– Database and Exadata Server cabling unchanged.
– Inter-rack cabling done at installation time
• Can be extended beyond 18 racks using external switches
• Refer to the Database Machine Owner’s Guide for exact port mappings

Multi-Rack cabling – X4 and later Generations
• Some Database Machine racks may not include the third “spine” switch by
default
– Need to install IB spine switch (Expansion Switch Kit) when inter-connecting multiple
racks
– Exceptions is Quarter rack does not require an extra switch in most cases
• Need to configure inter-rack InfiniBand cables with appropriate lengths
– Copper or Optical depending on distance

Two Rack Case – Fat Tree Topology
Spine Spine
4 4
4 4 4 4
4 4
L2
L1 L1 L2
Rack 1 Rack 2
• Install Spine Switch in each rack (if no spine switch exists)

• Remove inter-switch links between leaf switches (L1,L2) in each rack
• Connect each leaf switch to both the spine switches (4 links per pair)
Multiple Rack Case – Up to 8 Racks
Spine Spine
… Spine
L2
L2 L2 L1
L1 L1
Rack N
Rack 1 Rack 2
• Install Spine Switch in each rack (if no spine switch exists)
• Distribute 8 links from every “leaf” switch to every “spine” switch
– Example – 4 rack case – 2 links from each leaf to each spine

Multiple Rack Case – 9 to 18 Racks
Spine Spine
…
…
L2
L2 L2 L1
L1 L1
… Rack N
Rack 1 Rack 8
• Install Spine Switch in 1st eight racks, if no spine switch exists

• Distribute 8 links from every “leaf” switch to “spine” switch in 1st 8 racks

Scaling Out to 36 Racks
• Single InfiniBand Network
• Requires 2 “external spine” 36-port InfiniBand switches
– Add another level to the Fat Tree topology
• Divide Racks into groups each having 2-8 racks
– Group related racks together – for example, racks that run a common database or are
part of a common cluster
– Inter-connect racks within each group using the two level Fat Tree topology
• Inter-connect the groups via the two “external spine” switches
– Connect each “internal spine” switch in each rack to the two “external spine” switches
• Bandwidth from/to each group is 80 Gb/s * number of racks in the group

Multiple Rack Case – 9 to 36 Racks
External Spine switches
…
…
…
Group 1 (2 to 8 racks) Group N (2 to 8 racks)

Inter-connecting Quarter Racks
• Limited situations where a Quarter Rack can be inter-connected with

other rack without requiring a spine switch in the Quarter rack
• Case 1 - Connect two Quarter Racks
– The pre-requisite is that at least 4 ports reserved for external connectivity are open
on each leaf switch
• Case 2 – Connect one Quarter Rack with one other Half or Full Rack
– The pre-requisite is that at least 4 ports reserved for external connectivity are open
on each leaf switch
• Case 3 – Connect one Quarter Rack to two or more racks (all of which are
either Exadata Half or Full Racks)

Case 1 – Two Base/Quarter Racks
L1 2 L1
7 7
2 2
L2
L2
Base/Quarter Rack 1 Base/ Quarter Rack 2
• Inter-connect the leaf switches between racks with 2 links each

– Use the ports reserved for external connectivity

Case 2 –Base/Quarter with One Additional Rack
L1 2 L1
1 Spine switch is
optional
7 7 Spine1
2 2
L2 1
L2
Base/Quarter Rack Elastic Rack
• Inter-connect the leaf switches between racks with 2 links each

– Use the ports reserved for external connectivity

Case 3 – Base/Quarter Rack with Two or more Racks
Spine
… Spine
L1 L2
L1 L2 L1 L2
Elastic Rack N
Base/Quarter Rack Elastic Rack 1
• Remove the 7 inter-switch links between leaf switches in the Quarter Rack
• Connect each leaf switch of the Quarter Rack to each spine switch of the other
Elastic Racks with 2 links each (if there are less than 4 racks) or 1 link each (if
there are more than 4 racks)

InfiniBand Network – External Connectivity
• Six ports in each of the two leaf switches per Exadata rack are available
for external connectivity
– Ports 5B,6A,6B,7A,7B, 12A per leaf switch (total 12 per rack)
– Connecting to media servers for Tape backup
– Connect to ZDLRA or ZFS appliance for Disk Backup
– Data Loading
– Client / Application Access
– For HA connections, connect 1 port to one Leaf switch and another to the second
Leaf switch
• Important – Never connect servers directly to spine switch
• Never connect other vendor’s InfiniBand switches to Oracle IB switches

Expansion Switch Kit
• Purpose
– Spine switch needed to inter-connect multiple racks
– One per rack being inter-connected
– Needed for systems that did not ship with a spine switch
• All X4-2 and possibly X5-2 and X6-2 racks (except storage expansion)
• X4-8 racks
• X3-8 Full rack with X4-2 and X3-2 storage servers
• V2 Half rack
• Contains
– Sun Datacenter 36-port InfiniBand Switch to be used as a spine switch in a rack

InfiniBand cables needed for multi-racks
• For connecting 2 – 8 Exadata Full / Half Racks in a two level fat tree
topology
– 16 cables per Exadata Full / Half Rack (as 8 links per leaf switch dedicated for inter-
switch connectivity)
• When adding a third level to the fat tree topology via pair of external
InfiniBand switches (for 9 – 36 rack case)
– Additional 2 cables per Exadata rack
• For each Quarter Rack added to the configuration
– 4 cables if inter-connecting to another single rack
– If inter-connecting to more than 1 other rack (max of 8)
• 2 per other rack if number of other racks is <=4
• 1 per other rack if number of other racks is > 4

Cables lengths for multi-rack situations
• 3m copper cables for intra-rack cabling (i.e connecting switches within
the same rack)
• 5m copper cables to connect switch in one rack to a switch in 1st and 2nd
physically adjacent rack
– Assumes raised floor and racks in same aisle and are physically adjacent to each
other
• All other cases, require 10m or longer cables (must be optical cables)
– Any multi-rack involving 4 or more racks will definitely require purchasing longer
optical cables
– 10m cables typically sufficient if inter-connecting up to 8 physically adjacent racks in
the same aisle with raised floor
When in doubt – measure!

Sourcing cables for multi-rack situations
• Purchase cables as needed for multi-rack situations (Note: Starting with X4, spares kits do
not contain InfiniBand cables)
Description Oracle part# Need discrete
transceivers?
3m QSFP-QSFP cable (copper) X2121A-3M-N No
5m QSFP-QSFP cable (copper) X2121A-5M-N No
10m MPO-MPO cable (optical) 7102869 Yes, (2 x X2124A-N)
Note - You need 2 QSFP SR transceivers (X2124A-N) for each optical cable

InfiniBand Network Addresses
X6-2 X6-8 X6-8 Storage
Expansion
Full Half Quarter / Full Half Quarter

Eighth
Ib0 and ib1 for 16 8 4 16 16 -

Database
Servers
Ib0 and ib1 for 28 14 6 28 6 8
Exadata Storage
Servers
Total 44 22 10 44 16 8

Ethernet Network
Connectivity

“Admin” Ethernet Network
• One Cisco 1Gb Ethernet “Admin” switch is pre-installed
Database Servers (ILOM)
and pre-cabled in each rack
Database Servers (“mgmt” port)
– Connected to hardware mgmt ports of each server
Exadata Storage Servers (ILOM)
• ILOM port on the Exadata Storage Servers and Database
Exadata Storage Servers (“mgmt” port)
Servers
IB Switch (Mgmt port)
– Connected to software mgmt ports of each server
• eth0 on Exadata storage server
• eth0 on the Database Server
Cisco switch • For software admin, root access, ..
– Connected to InfiniBand Switch management ports
• Cisco Admin switch can be replaced by customer
1
management switch at customer’s expense
To Data Center Network – There are restrictions on replacement switch

External Connectivity for Admin Network
• One port is available in the Cisco Admin Ethernet switch to connect

to the data center administration network
• One network port in each of the PDUs can be connected directly to

the data center administration network for monitoring

External Connectivity for Database Workloads
• Support for IPv4 and IPv6 connectivity
• Compute nodes and storage servers are now enabled to use IPv6 for the management
network, ILOM, and the client access network. This works for both bare metal and
virtualized deployments
• Database / Client / Application Access to Databases
• 2U space at top of X6-2 machines can be used for customer provided top of rack
switches
– Ensure top of rack is not occupied by a storage server
– Top of rack space was used in full rack eight-socket DB machines, can be filled in elastic
configurations
• Need to connect at least one Ethernet port on each DB Server
• X6-2 Database Server available ports for external connection
– 3 x 1GbE / 10 GbE Base-T Ethernet ports available
– 2 x 10GbE Ethernet SFP+ ports available
• X6-8 Database Server available ports for external connection
– 9 x 1GbE Base-T Ethernet ports available
– 8 x 10GbE Ethernet SFP+ ports available
Number of Ethernet Network Addresses Required
X6-2 X6-8 X6-8 SER
Full Half Qtr Eighth VM Impact Full Half Half

ILOM for Database Servers 8 4 2 2 - 2 2 -
ILOM for Exadata Storage Servers 14 7 3 3 - 14 3 9
Eth0 (mgmt) for DB Servers 8 4 2 2 + 1x Num VMs 2 2 -
Eth0 (mgmt) for Exadata Storage 14 7 3 3 - 14 3 9
Mgmt port for IB switches 2 2 2 2 - 2 2 3
IP address for Ethernet Switch 1 1 1 1 - 1 1 1
IP address for PDUs 2 2 2 2 - 2 2 2
Mgmt Subnet Total 49 27 15 15 Mgmt + 1x VMs 37 15 24

Client Access Database Servers 8 4 2 2 = Num VMs 2 2 -
VIPs for Database Servers 8 4 2 2 = Num VMs 2 2 -
SCAN Addresses (per Cluster) 3 3 3 3 = 3x Num Clusters 3 3 -
Client Access Total 19 11 7 7 = 2 x Num VMs + 3x Num 7 7 -

Clusters
Total 68 38 22 22 Mgmt + 3x Num VMs + 3x 44 22 24

Num Clusters
“+” Delineates to add the VM IPs to the Mgmt Total

“=“ Indicates to replace the Client Access Total Ips with
the identified VM IP amount
Additional Ethernet Network Requirements
• Additional Ethernet IP addresses needed if multiple clusters are deployed
on the Database Machine Full Rack, Half Rack, or Quarter Rack
– 3 IP addresses per additional cluster for SCAN addresses
– Static IP addressing only (no DHCP)
– All Ethernet IP addresses must be registered in DNS
• Additional Ethernet IP addresses needed if deploying VMs

Virtual Local Area Network Support
• Reduces the number of switch ports consumed on the
system
• OEDA now supports creating VLANs on management
network, ILOM, client and backup access network
• VLAN tagging is only necessary when VLANs span
multiple switches
• Provide QoS between a disaster recovery network and
a client access network through the same network
card
• VLAN tagging with OVM separates client networks
across different VMs

VLAN Support
• VLAN networks must be bonded except for admin network
• Backup and Client networks cannot be on the same tagged VLAN
network
• Backup and Client networks can share the same network cables
• IPv6 VLAN is only supported on Exadata Storage Server’s management
network
• Virtual deployments do not support IPv6 VLANs

Exadata Database Machine
• The ultimate platform for all database workloads
– OLTP, Warehousing, Database as a Service
• Most advanced hardware

– Fully scale-out servers and intelligent storage with unified
InfiniBand connectivity and PCI flash
• Most advanced software

– Database optimized compute, storage, and networking
algorithms dramatically improve performance and cost
• Standardized, optimized, hardened end-to-end


Exadata X6 Hardware Overview

Transféré par

Informations du document

Copyright

Formats disponibles

Partager ce document

Partager ou intégrer le document

Options de partage

Avez-vous trouvé ce document utile ?

Ce contenu est-il inapproprié ?

Droits d'auteur :

Formats disponibles

Exadata X6 Hardware Overview

Transféré par

Droits d'auteur :

Formats disponibles

Exadata Hardware Overview

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 1

• Latest, most advanced hardware

• Unique software that maximizes the Oracle Database

• Standardized, optimized, hardened end-to-end

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 2

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 3

 Unified Ultra-Fast Network

 Scale-out Intelligent Storage Servers

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 4

Test & debug

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 5

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 6

• X6-8 Machines use 8-socket database servers

• Both use exactly the same storage servers and InfiniBand

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 8

Processors 2 Twenty-two-Core Intel® Xeon® E5-2699 v4 Processors (2.2GHz)

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 9

Power Supplies Redundant Hot-Swappable power

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 10

• X6-2 High Capacity (HC) Storage Server

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 11

Processors 2 Ten-Core Intel® Xeon® E5-2630 v4 2.2 GHz-More Cores

Drives 8 x 3.2 TB 2.5-inch Flash Accelerator F320 PCIe Drives

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 12

Processors 2 Ten-Core Intel® Xeon® E5-2630 v4 2.2 GHz - More Cores

Flash 4 x 3.2 TB Flash Accelerator F320 PCIe Card

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 13

• Add up to 17 more X6-2 Database Servers (Max 19…1RU each in size)

• Maximum of 22 servers or 38 RU of servers per rack

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 14

• Add up to 2 more X6-8 Database Servers (Max 4…5RU in size)

• Elastic Configuration Tool (OECA) available to demonstrate multiple

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 15

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 16

• Start with Quarter Rack Storage Expansion

EF 130.0 TB 27.9 TB 130.0TB 65.0 TB 27.9 TB 13.9 TB

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 18

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 19

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 20

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 22

X6-2 Full HC * X6-2 Half HC * X6-2 Quarter HC X6-2 Eighth HC

50,455 BTU/hr 27,335 BTU/hr 13,679 BTU/hr 11,207 BTU/hr

Airflow: Max (CFM) 2336 1265 633 519

Acoustics 8.6B (operating) 8.5B (operating) 8.3B (operating) 8.3B (operating)

* Assume rack has spine switch

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 23

X6-2 Full EF * X6-2 Half EF * X6-2 Quarter EF X6-2 Eighth EF

48,497 BTU/hr 26,355 BTU/hr 13,260 BTU/hr 10,952 BTU/hr

Airflow: Max (CFM) 2245 1220 614 507

Acoustics 8.6B (operating) 8.5B (operating) 8.3B (operating) 8.3B (operating)

* Assume rack has spine switch

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 24

X6-8 Full EF * X6-8 Full HC * X6-8 Half EF X6-8 Half HC

53,547 BTU/hr 55,505 BTU/hr 31,924 BTU/hr 32,344 BTU/hr

Airflow: Max (CFM) 2479 2570 1478 1497

Acoustics 8.6B (operating) 8.6B (operating) 8.5B (operating) 8.5B (operating)

* Assume rack has spine switch

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 25

12,239 BTU/hr 11,680 BTU/hr

Airflow: Max (CFM) 567 541

Rack 847.5 lbs (384.4 kg) 803.5 lbs (364.5 kg)

Acoustics 8.4B (operating) 8.4B (operating)

5 ºC to 32 ºC (41 ºF to 89.6 ºF), 10% to 90% relative humidity, non-condensing .