IBM System Storage

IBM System StorageTM DS8000 series

Overview

Peter Klee
ATS EMEA

IBM Systems
2006 IBM Corporation
 IBM System Storage

DS8000
POWER basierte Server Technologie IBM POWER5+
+ 15% vs 8000

DS8300
Server-basierende Architektur bringt pSeries p5 570
2-4 way 4-way 1.9GHz IBM POWER5
kontinuierliche Produktverbesserungen- ~ 28X H50
Vorteil: 8-way
DS8100
Performance (Prozessor, SMT) 12-way pSeries p5 570
Skalierbarkeit 16-way
2-way 1.5GHz IBM POWER5
~ 12X H50
RAS
Kostenreduzierungen (Packaging, Stckzahl)
ESS 800 w/Turbo 2
Cache pSeries 660 6H1
Funktionen (LPAR, Virtualisierung) 6-way 750MHz RS64 IV
~ 7X H50
ESS 800
pSeries 660 6H1
ESS Fxx 4-way 600MHz PowerPC RS64 IV
6-way 668MHz PowerPC RS64 IV
RS6000 H70
ESS Exx 4-way 255MHz ~ 4 to 5X H50
RS6000 H50 PowerPC RS64 II
4-way 332MHz PowerPC ~ 2X H50 Jetzt:
603e Bisher:
pSeries Plattform
Gleiche Bauteile mit pSeries

2
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

Neue Architektur auf Basis der POWER-Technologie

64bit

Host Host Host Host Host Host Host

Adapters Adapters Adapters Adapters Adapters Adapters Adapters

Higher Bandwidth Fault Tolerant Fabric

POWER5 Volatile Volatile POWER5

Memory Memory
SMP LPAR SMP
Persistent Persistent
Memory LPAR LPAR Memory

64bit
Switch

RAID
RAID RAID
RAID
RAID RAID
Adapters
Adapters Adapters
Adapters
Adapters Adapters
Switch

3
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

DS8000 Storage System LPAR

Stufe 1 LPAR: Aufteilung eines 4-way Systems in 2 x 2-Way
Aufteilung von Prozessoren, Cache, Adapter und Laufwerken zwischen den
LPARS
Robustere Isolation zwischen den Images via Hardware und POWER Hypervisor
Firmware
Jede Partition kann ihre eigene Mikrocode-Version betreiben
4-way p5 570 Server 4-way p5 570 Server
L3 Cache L3 Cache

Memory DIMMs P5 RIO-G2 P5 Memory DIMMs

Memory DIMMs Memory DIMMs

Memory DIMMs Memory DIMMs

P5 P5 Memory DIMMs
Memory DIMMs
RIO-G2
L3 Cache L3 Cache

4
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

16 Drive Disk Enclosure

Backplane
Top Half of Disk Enclosure: 8 Disks in
two rows of four disks each

Bottom Half of Disk Enclosure: 8

Control card Disks in two rows of four disks each

Disk
DS8000: Disk enclosures installed in pairs -> one in front & one in back

5
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

Switched Fibre Channel Disk System

Switched Fibre Channel

Point to Point links to each
drive and adapter
Predictive Failure Statistics
No common hardware
between switch fabrics
Minimal Arbitration Delay
Two simultaneous operations
per domains. Doubles the
bandwidth over traditional FC-
AL loop implementations

6
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

Sequential Bandwidth

Conservatively (Per RIO-G

loop)
Reads: 2 GB/s
Writes: 1 GB/s

Configuration Reads Writes

2-way 2 GB/s 1 GB/s
4-way 4 GB/s 2 GB/s
8-way *) 8 GB/s 4 GB/s

*) projected

7
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

DDM to DA Mapping -- 2-way (DS8000)

4 Device Adapter (DA) pairs

DA pairs 0 / 1 / 2 / 3 2 3
2 3
Maximum configuration
0 1
(384 DDMs)
DA pair 0 = 128 DDMs 0 1
SMC
DA pair 1 = 64 DDMs Switches 2
DA pair 2 = 128 DDMs C0 2
DA pair 3 = 64 DDMs C1 0
Balanced configuration at 0
b

256 DDMs, i.e., 64 DDMs per 0/1 1/0

DA pair
2/3 3/2
DA (card) plugging order:
2/0/3/1

8
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

Primary Frame DS8000

Standard 19in rack
mounting space

Dense HDD Packaging

16 drives per pack
128 drives in rack
Dual FC-AL Loop Switches
Point to Point Isolation
Two Simultaneous
Operations per loop
Storage Hardware
Maintenance Console
Redundant Configuration
Power Guided Maintenance/Call Home
Supports Multiple Systems

IBM eServer p5 570

Dual 2-way or Dual 4-way
4 I/O Bays
Each bay supports
4 Host Adapters and
2 Device Adapters

Battery Host Adapter

4 FCP/FICON Ports
or 2 ESCON Ports
Device Adapter
4 FC-AL Ports
Front Rear

9
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

DS8000
2-Way 4-way 8-way* 12-way*
Server Processors 2-way POWER5 4-way POWER5 8-way POWER5 12-way POWER5

Cache 16 to 128 GB 32 to 256 GB 64 to 512 GB 96 to 768GB

Host Ports
FICON (2Gb/s) 8 to 64 8 to 128 up to 256 up to 384

(4 ports per adapter)

Fibre Channel (2Gb/s) 8 to 64 8 to 128 up to 256 up to 384
(4 ports per adapter)
ESCON 4 to 32 8 to 64 up to 128 Up to 192

(2 ports per adapter)

Device Ports 8 to 32 8 to 64 8 to 128 8 to 192

(2 ports per adapter)

Drives 16 to 384 16 to 640 up to 1792 up to 1792

73 GB (15K RPM)
146 GB (15K RPM)
146 GB (10K RPM)
300 GB (10K RPM)

Physical Capacity 1.2 to 115TB 1.2 to 192TB up to 344 TB up to 344 TB

Number of Frames 1 to 2 1 to 3 2 to 8 2 to 8

* Statement of Direction

10
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

DS8000 Series

DS8100 (2-way) DS8300 (4-way)

Basis Erweiterung Basis Erweiterung 1 Erweiterung 2

128 LW +256 LW 128LW +256 LW +256LW

640 Laufwerke

11
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

DS8000 Adressierung Grenzwerte

DS8000 with
ESS 800 DS8000
LPAR
Max Logical Subsystems 32 255 510
Max Logical Volumes 8K 64K 128K
Max Logical CKD Volumes 4K 64K 128K
Max FB Logical Volumes 4K 64K 128K
Max N-Port Logins/Port 128 509 509
Max N-Port Logins/System 512 8K 16K
Max Logical Paths/FICON Port 256 2K 2K
Max Logical Paths/CU Image 256 512 512
Max Path Groups/CU Image 128 256 256

12
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

New Cache Algorithm

SARC
Simplified Adaptive Replacement Cache
More efficient use of cache
Improve cache hits
Improve Response Time
Cache performance is better than competitors at same cache size
RHR improvement is higher for cache hostile workload
Better cache management with mixed random and heavy sequential
workload

13
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

Technology improvements allow more economical

configurations with improved performance!

Benefits of adaptive replacement caching

Lower cache-to-backstore ratios with outstanding service times

Nimrod Megiddo and Dharmendra S. Modha, "Outperforming LRU with an Adaptive Replacement Cache Algorithm, IEEE Computer, pp. 4-11, April 2004.

14
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

Impact of ARC on Resp Time and Thruput

Lab Simulation of Cust. Production Workload
Improvement
due to ARC:
Effective cache space: 33%
Miss rate: 11% reduced
Peak Throughput: 12.5%
Response Time:
7.60ms (before) /
1.88 ms (after) 4000 IOPS

15
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

IBM DS8300 Outperforms DMX-3 in Balanced Workload

IBM Storage Performance Lab Measurements
Results show the IBM DS8300s advantage in measured transaction processing
workloads similar to that found in database, order entry, financial system applications

Open Systems Mixed Workload - 60% Writes (No Skew)

DS8300
25 (R1.6)
R e s p o n s e T im e (m s )

DM X-3
Measured 116K IO/sec with DS8K
20 R2.0 DS8300 (R2*)
15

10

5 Response Time
and IOPS
0 Advantage:
0 20000 40000 60000 80000 100000 120000 IBM
I/O Request Throughput (IO/sec)

DS8300 vs DMX-3, 480 Active 73GB/15k RPM DDMs

*Measured using pre-GA version of Sept.06 GA code.
DS8300 R1.6 RAID 10 (32) 2Gbit FC ports and 256GB cache Performance of GA code may vary, but IBM expects that GA
DS8300 early R2.0 RAID 10 (32) 2Gbit FC 64GB Cache code will meet or exceed performance set forth in this slide.

DMX-3 RAID 1 (32) 2Gbit FC ports and 128GB cache

16
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

Representative Production Skew Performance Results

Results show the IBM DS8300s has big advantage over DMX, when volumes are not
Show IBM which
evenly loaded, DS8300 Advantage
is representative vs.
of many EMCenvironments
customer DMX-3

Representative IO Skew (Busiest LUN 20x avg for 480 LUNs)

Open Systems Mixed Workload - 60% Writes
20 DS8300 R1.6
18
R e s p o n s e T im e (m s )

16 Production Skew
Performance DMX-3
14
12 Advantage: IBM
10
8
6 480 Active DDMs (73GB 15k RPM)
DS8300 (32) 2Gbit FC ports and
4 64GB cache, RAID-10
2 DMX-3 (32) 2Gbit FC ports and
128GB cache, RAID-1
0
0 10000 20000 30000 40000 50000 60000 70000
I/O Request Throughput (IO/sec)
IBM Storage Performance Measurements
Real Production Workloads are often skewed with hot volumes, hot arrays
In real production environments, ratio of busiest to average volume can range from several times to several dozen times.
Ratio is typically large when the number of volumes is large.

17
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

IBM System Storage DS8000 Does Data Warehousing

DB2 Test Results

Business Value 5
Faster scans and joins enable more
nimble business operations! 4

sc
e)
Test results show near DS8300 native Full

B
/
3

G
disk bandwidth Table
Scan

u
pt(
Join
2

h
Performance Tests

g
Query

ou
Scan and Join Queries, which are key

hr
1

performance-critical operations in data
warehousing
Full table scan query: designed to
measure sequential read bandwidth.
Reads entire table.
Join query: joins two tables in the
database to answer a business
question. Reads both tables
sequentially to compute the joined
result.
T
0
Configuration
AIX 5L V5.3, DB2 UDB V8.2
DS8300 (4-way): 64 GB cache memory,16 host adapters, 32 ports, 8 DA
pairs, 512 15K RPM disks, 480 active disks, 32 hot spares,64 RAID10
arrays and ranks
p5 595: 16-way 1.9GHz CPUs, 32 FC disk adapters, 64 GB server memory
DB2 UDB V8.2 Enterprise Server Edition with Database Partitioning Feature
Database size: 1TB

18
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

Results Show IBM DS8000 Higher Host Port Throughput

than EMC DMX-3 Infrastructure Advantage: IBM DS8000
Can result in cost savings potential:
Fewer ports or host adapters on storage
Fewer switches
Fewer host bus adapters on servers
Reduces chances of host port bottleneck
Single Port 4KB
Fiber Channel Port Comparison 8 Ports 4KB
40

30 250
200
IOPS 20 DMX3
DS8K 150
IOPS DMX3 8 Ports
10
100 DS8K 8 Ports
0 50
RD HIT WRT HIT
0
Single Port 64KB RD HIT WRT HIT

250 8 Ports 64KB

200
1600
150 1400
MB/s DMX3 1200
100 DS8K 1000
MB/s 800 DMX3 8 Ports
50 600 DS8K 8 Ports
400
0 200
RD HIT WRT HIT
0
RD HIT WRT HIT

19
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

Results Show IBM Metro Mirror Gives Better Response Time -

No matter the Distance
Synchronous Copy Compare EMC SRDF/S vs. IBM Metro Mirror

6 Same response,
at longer distance
5
Response Tim e (m s)

2
Faster response,
1
at same distance

0
0 100 200 300 400 500 600
Distance (km)
EMC DMX DS8100

Source: EMC/Penn Northeast & IBM. 4KB writes <1000 IO/s

Note: EMC numbers are based on their testing. Source publication "Penn's Northeast: A Viable Option to Strengthen the Resilience of the US
Financial System". http://www.pennsnortheast.com. IBM numbers are based on IBM testing.

20
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

PPRC Environment
Switch to Metro Mirror

70/30 Read Write Ratio with Channel Extender

21
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

Trademarks
The following terms are trademarks or registered trademarks of the IBM Corporation in either the United States, other countries
or both.

IBM, S/390, ES/3090, ES/9000, AS/400, RS/6000, MVS/ESA, OS/390, VM/ESA, VSE, TPF, OS/2, OS/400, AIX,, FlashCopy, z/VM, z/OS,
POWER5, POWER5+, DB2, Universal Database
DFSMS/MVS, DFSMS/VM, , DFSMSdfp, DFSMSdss, DFSMShsm, DFSMSrmm, BladeCenter,
FICON, ESCON, TotalStorage, Enterprise Storage Server, iSeries, pSeries, xSeries, zSeries, System z, System z9, System i, System i5,
System p, System p5, System x, System Storage

Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.
Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or
both.
Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and
Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.
UNIX is a registered trademark of The Open Group in the United States and other countries.
Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.
Other company, product, or service names may be trademarks or service marks of others.

22
DS8000 POWER To Perform | IBM Systems
 IBM System Storage

Disclaimers
Copyright 2006 by International Business Machines Corporation.

No part of this document may be reproduced or transmitted in any form without written permission from IBM Corporation.

Product data has been reviewed for accuracy as of the date of initial publication. Product data is subject to change without notice. This information could include technical inaccuracies or
typographical errors. IBM may make improvements and/or changes in the product(s) and/or programs(s) at any time without notice.

Unless otherwise note, the performance data contained herein was obtained in a controlled, isolated environment. Actual results that may be obtained in other operating environments may vary
significantly. While IBM has reviewed each item for accuracy in a specific situation, there is no guarantee that the same or similar results will be obtained elsewhere. Other data may have been
obtained from publicly available documents or sources. In such cases, IBM has endeavored to provide comparable measurements for systems being compared.

References in this document to IBM products, programs, or services does not imply that IBM intends to make such such products, programs or services available in all countries in which IBM
operates or does business. Any reference to an IBM Program Product in this document is not intended to state or imply that only that program product may be used. Any functionally equivalent
program, that does not infringe IBMs intellectually property rights, may be used instead. It is the users responsibility to evaluate and verify the operation of anynon-IBM product, program or service.

The information provided in this document is distributed "AS IS" without any warranty, either express or implied. IBM EXPRESSLY DISCLAIMS any warranties of merchantability, fitness for a
particular purpose OR NONINFRINGEMENT. IBM shall have no responsibility to update this information. IBM products are warranted according to the terms and conditions of the agreements (e.g.,
IBM Customer Agreement, Statement of Limited Warranty, International Program License Agreement, etc.) under which they are provided. IBM is not responsible for the performance or
interoperability of any non-IBM products discussed herein.

Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products
in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products
should be addressed to the suppliers of those products.

The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents or copyrights. Inquiries regarding patent or copyright licenses
should be made, in writing, to:

IBM Director of Licensing

IBM Corporation
North Castle Drive
Armonk, NY 10504-1785
U.S.A.

23
DS8000 POWER To Perform | IBM Systems