Vous êtes sur la page 1sur 141

Unit Objectives

After completing this unit, you should be able to:


Plan for the implementation of the IBM TotalStorage SAN
switches and directors (b-type, m-type, n-type), and the Cisco
directors and switches by reviewing default configuration
parameters and tailoring options
List the steps necessary to set up and use the TotalStorage
SAN Switch Specialist, the McDATA EFC Manager, the CNT
Enterprise Manager, or the Cisco Fabric Manager user
interfaces
Describe switch port interfaces and port initialization
Interpret topology, routing, and trunking data displayed by switch
management interfaces
Plan and implement switch zoning to restrict any-to-any data
access and ensure resource access integrity

Copyright IBM Corporation 2004


Fibre Channel Switches and Directors

(b-type) (m-type)

(n-type)

Copyright IBM Corporation 2004


Planning for FC Switches and Directors

Cable length? Number of ports?

Longwave/Shortwave
SFPs?
Switch names
Desktop or and IDs?
Rack?

Ethernet
IP-address?
Firmware
download

Copyright IBM Corporation 2004


Setting up the IBM SAN Portfolio: b-type

(b-type)

Setting up the IBM TotalStorage


SAN Portfolio: b-type

Functions of the IBM TotalStorage


SAN Portfolio: b-type

Copyright IBM Corporation 2004


IBM TotalStorage SAN Switches and Directors

2109-M14
(128 ports) 2109-M12
(one domain) (2 x 64 ports)
(Silkworm 24000) (two domains)
(Silkworm 12000)

b-type

SAN32B-2
2005-B32 2005-H08
(Silkworm 4100) (Silkworm 3250)

2005-H16
(Silkworm 3850)
Copyright IBM Corporation 2004
Additional SAN Switches and Managed Hub

2109-F16
(Silkworm 3800)
2109-F32 3534-F08
(Silkworm 3900) (Silkworm 3200)
BladeCenter
Switch Module
(Silkworm 3016)

One Gigabits per second

2109-S16 2109-S08
(Silkworm 2800) (Silkworm 2400)

3534-1RU
Managed Hub (Silkworm 2010)
Copyright IBM Corporation 2004
SAN Switches and Directors - Setup Overview
Verify complete shipment, unpack
Insert SFPs/GBICs
Install additional power supply
Power on self test (POST)
Set IP address
Attach to LAN
Activate the IBM TotalStorage SAN Switch Specialist
Download firmware and update switch
Set time and switch name and number
Connect FC cables and apply labels

Copyright IBM Corporation 2004


Switch Connections and Ports
2005-H16 Front Panel

Eight
Power Ports
Receptacle
Power
Receptacle
Ethernet Serial port
connection connection
Port Link
Status Speed

Copyright IBM Corporation 2004


2109-M12 and M14 Configuration Components

Logical Switch 0: Logical Switch 1:


Slots 1-4 Slots 7-10
Logical cards 0-3 Logical cards 0-3

Power Supplies (4)


Two CP Blades
Slots 5 & 6
Copyright IBM Corporation 2004
Brocade Management Interfaces
Command Line Interface (Telnet, SSH, Secure Telnet)

IBM TotalStorage SAN Switch Specialist - aka


Brocade Web Tools - (SSL )

Fabric Manager (optional)

Fabric Manager

Multiple Fabrics Secure


Switch Groups Fabric OS
Port Groups GUI

Copyright IBM Corporation 2004


Management Interfaces via IP Network

Brocade
Brocade Fabric Manager
Telnet Secure Web Tools Multiple Fabrics
Telnet
HTTP SSL
GUI Switch Groups
SSH CLI Port Groups

IP Network SNMP v1, v 3

NTP RADIUS
server
Serial
Connection CLI

Copyright IBM Corporation 2004


Login to the Switch

admin/password

default

Consistent time across switches:


NTP server, or
Fabric Manager Set Time

Copyright IBM Corporation 2004


Useful Switch OS Commands

Show Commands Help Commands

fabricShow
Help
switchShow diagHelp

portShow licenseHelp

nsShow loopdiagHelp

routeHelp
nsAllShow
zoneHelp
configShow

Copyright IBM Corporation 2004


Display Switches in a Fabric
fabricShow
DAZZ16A:admin> fabricShow
Switch ID Worldwide Name Enet IP Addr FC IP Addr Name
-------------------------------------------------------------------------
2: fffc02 10:00:00:60:69:e2:01:38 9.11.199.7 0.0.0.0 "Meteor"
3: fffc03 10:00:00:60:69:80:43:b6 9.11.195.215 0.0.0.0 "SecFab1"
4: fffc04 10:00:00:60:69:80:43:b7 9.11.195.216 0.0.0.0 "SecFab3"
6: fffc06 10:00:00:05:1e:34:11:8e 9.11.198.5 0.0.0.0 "DAZZ16A"
7: fffc07 10:00:00:05:1e:34:11:9a 9.11.198.254 0.0.0.0 "DAZZ16B"
9: fffc09 10:00:00:05:1e:34:10:5a 9.11.198.56 0.0.0.0 "DAZZ8A"
10: fffc0a 10:00:00:05:1e:34:10:5d 9.11.199.3 0.0.0.0 "DAZZ8B"
11: fffc0b 10:00:00:60:69:90:03:60 9.11.193.223 0.0.0.0 "IOTL128"
12: fffc0c 10:00:00:60:69:50:03:fd 9.11.193.220 0.0.0.0 "IOTL118"
13: fffc0d 10:00:00:60:69:50:03:e5 9.11.193.216 0.0.0.0 "IOTL119"
14: fffc0e 10:00:00:60:69:50:04:a7 9.11.193.217 0.0.0.0 "IOTL120"
15: fffc0f 10:00:00:60:69:c0:06:d5 9.11.192.74 0.0.0.0 "Mojo1"
16: fffc10 10:00:00:60:69:10:6f:4a 9.11.193.234 0.0.0.0 "IOTL104"
18: fffc12 10:00:00:60:69:30:06:07 9.11.193.222 0.0.0.0 "IOTL127"
19: fffc13 10:00:00:05:1e:34:11:ad 9.11.198.138 0.0.0.0 "DAZZ16C"
29: fffc1d 10:00:00:05:1e:34:13:5c 10.150.10.71 0.0.0.0 "SANBladeFC1"
30: fffc1e 10:00:00:05:1e:34:13:4a 10.150.10.72 0.0.0.0 >"SANBladeFC2"

The Fabric has 17 switches

> = Principal Switch


Copyright IBM Corporation 2004
Display Switch and Port Status
DAZZ16A:admin> switchShow switchShow
switchName: DAZZ16A
switchType: 26.2
switchState: Online
switchMode: Native
switchRole: Subordinate
switchDomain: 6
switchId: fffc06
switchWwn: 10:00:00:05:1e:34:11:8e
zoning: ON (Primary_Dazzler_Meteor)
switchBeacon: OFF

Port Media Speed State


=========================
0 id N2 Online E-Port (Trunk port, master is Port 3)
1 id N2 No_Light
2 id N2 Online E-Port (Trunk port, master is Port 3)
3 id N2 Online E-Port 10:00:00:60:69:80:43:b6 "SecFab1" (Trunk master)
4 id N1 Online F-Port 10:00:00:00:c9:23:94:69
5 id N2 Online F-Port 50:05:07:63:00:c7:a8:05
6 -- N2 No_Module
7 id N1 Online G-Port
8 id N2 Online E-Port 10:00:00:60:69:e2:01:38 "Meteor" (upstream)
9 id N2 Online E-Port 10:00:00:60:69:e2:01:38 "Meteor"
10 id N2 Online E-Port 10:00:00:60:69:e2:01:38 "Meteor"
11 id N2 Online E-Port 10:00:00:60:69:e2:01:38 "Meteor"
12 -- N2 No_Module
13 id N2 Online L-Port 1 public
14 -- N2 No_Module
15 id N2 Online L-Port 1 public

Copyright IBM Corporation 2004


Display Switch Operating Parameters
DAZZ16A:admin> configshow
RSCN.end-device.TransmissionMode:0 configShow
alpaList:1
cer.internal_port_code:1
diag.loopID:125
diag.mode.burnin:0
diag.mode.esd:0
diag.mode.lab:0
diag.mode.mfg:0
diag.postDisable:0
diag.retryDisable:0
diag.test.crossPort.passes:5000
diag.test.passes:0
diag.test.portLoopback.passes:1000
diag.test.silkScreen.passes:180
diag.test.spinSilk.passes:120
ether.link.mode:AUTO
fabric.domain:6
fabric.ididmode:0
fabric.ops.BBCredit:16
fabric.ops.E_D_TOV:2000
fabric.ops.R_A_TOV:10000
fabric.ops.dataFieldSize:2112
fabric.ops.mode.fcpProbeDisable:0
fabric.ops.mode.isolate:0
fabric.ops.mode.longDistance:0
fabric.ops.mode.noClassF:0
fabric.ops.mode.pidFormat:1
PID Format =
fabric.ops.mode.tachyonCompat:0
fabric.ops.mode.unicastOnly:0
0,1,2
fabric.ops.mode.useCsCtl:0
fabric.ops.mode.vcEncode:0
fabric.ops.vc.class.2:2
fabric.ops.vc.class.3:3
Type <CR> to continue, Q<CR> to stop:
Copyright IBM Corporation 2004
Switch Port ID (PID) Format
L3F3S1:admin> switchdisable

L3F3S1:admin> configure
24-bit Port ID
Configure... 8 bits 8 bits 8 bits
Fabric parameters (yes, y, no, n): [no] y

Domain: (1..239) [21] Domain Area Device


BB credit: (1..27) [16]
R_A_TOV: (4000..120000) [10000]
E_D_TOV: (1000..5000) [2000]
Data field size: (256..2112) [2112]
Sequence Level Switching: (0..1) [0]
Disable Device Probing: (0..1) [0]
Suppress Class F Traffic: (0..1) [0] PID Formats :
SYNC IO mode: (0..1) [0]
VC Encoded Address Mode: (0..1) [0] 0 = Native PID (16 ports)
Switch PID Format: (0..2) [0] 1 1 = Core Switch PID (256 ports)
Per-frame Route Priority: (0..1) [0]
Long Distance Fabric: (0..1) [0] 2 = Extended Edge PID (256 ports)

Committing configuration...done.
0x102d7970 (tShell): Jul 8 16:36:39
WARNING CONFIG-PIDCHANGE_CORE, 3, Switch PID format changed to Format 1
('Core PID Format').

L3F3S1:admin> switchenable

Copyright IBM Corporation 2004


Display Nodes in a Given Name Server
ATSSAN_fabric2:admin> nsshow nsShow
The Local Name Server has 6 entries {
Type Pid COS PortName NodeName TTL(sec)
N 021a00; 3;21:00:00:eO:8b:02:1b:69;20:00:00:e0:8b:O2:1b:69; na
Fabric Port Name: 20:0a:00:60:69:10:3a:ce
N 021b00; 2,3;l0:00:00:00:c9:20:d8:5f;l0:00:00.00:c9:20.d8:5f; na
Fabric Port Name: 20:0b:00:60:69:10:3a:ce
N 021c00; 2,3;l0:00:00:00:c9:22:ae:a7;20:00:00:00:c9:22:ae:a7; na
FC4s: FCP [EMULEX FIREFLY ]
Fabric Port Name: 20:0c:00:60:69:10:3a:ce
N 021d00; 2,3;l0:00:00:00:c9:22:72:48;20:00:00:00:c9:22:72:48; na
FC4s: FCP [EMULEX FIREFLY ]
Fabric Port Name: 20:0d:00:60:69:10:3a:ce
N 021e00; 2,3;l0:00:00:00:c9:22:af:a3;20:00:00:00:c9:22:af:a3; na
FC4s: FCP [EMULEX FIREFLY ]
Fabric Port Name: 20:0e:00:60:69:10:3a:ce
N 021f00; 2,3;l0:00:00:00:c9:22:af:ae;20:00:00:00:c9:22:af:ae; na
FC4s: FCP [EMULEX FIREFLY ]
Fabric Port Name: 20:0f:00:60:69:10:3a:ce
}

ATSSAN_fabric2:admin> nsallshow
nsAllShow
14 Nx_Ports in the Fabric {
011a00 011b00 011c00 011d00 011e00 011f00 021a00 021b00
021c00 021d00 021e00 021f00 031700 0318ef
}
Copyright IBM Corporation 2004
TotalStorage SAN Switch Specialist

Management tools Administrative tools


General Switch View Administrative Interface
Telnet Interface
Performance View

Port Detail View Zoning Management

Fabric (SAN) View

Fabric Topology View

Windows
Zone 1
IBM Zone 3

Sun Zone
2
Web browser interface
Copyright IBM Corporation 2004
Fabric Tree

Fabric Events
Fabric Topology
Name Server
Zone Admin

Copyright IBM Corporation 2004


Name Server Display

Copyright IBM Corporation 2004


Name Server Entry Detail

Copyright IBM Corporation 2004


Switch View (2005-H16)

Copyright IBM Corporation 2004


Switch View (2005-H08)

Copyright IBM Corporation 2004


Switch View (2005-B32) - Switch Health

Copyright IBM Corporation 2004


Switch Status - Port Detail Report

Copyright IBM Corporation 2004


Switch Status - SAM Report

Copyright IBM Corporation 2004


Fabric Tree and 2109-M14 Switch View

HA

Copyright IBM Corporation 2004


2109-M14 High Availability Status

Copyright IBM Corporation 2004


Fabric Tree and 2109-M12 Switch View

Copyright IBM Corporation 2004


Embedded BladeCenter Switch

Copyright IBM Corporation 2004


Fabric Events and Switch Events Log

Copyright IBM Corporation 2004


Port Detail View

Copyright IBM Corporation 2004


Basic Performance Monitoring Options

Copyright IBM Corporation 2004


Advanced Performance Monitoring Options

Copyright IBM Corporation 2004


Performance Monitoring Grid

Copyright IBM Corporation 2004


Fabric Watch

Copyright IBM Corporation 2004


Access Administrative and Zoning Pages

Admin authority level required to access:

Administrative pages

Zoning pages

Copyright IBM Corporation 2004


Switch Information

Copyright IBM Corporation 2004


Switch Information Report

Copyright IBM Corporation 2004


Network Configuration

Copyright IBM Corporation 2004


Firmware Download

Copyright IBM Corporation 2004


Hot Code Activation
Two code partitions per CP:
Primary Secondary
Current New Firmware download
level level

Secondary Primary
Current New
level level Auto Reboot

Secondary Primary
New current New current
Auto Commit
level level
Copyright IBM Corporation 2004
SNMP Administration

Copyright IBM Corporation 2004


License Administration

Copyright IBM Corporation 2004


Port Setting

Copyright IBM Corporation 2004


User Administration

Copyright IBM Corporation 2004


Configure Switch Parameters

Copyright IBM Corporation 2004


Configuration Upload/Download

Copyright IBM Corporation 2004


RADIUS Configuration

Copyright IBM Corporation 2004


Trace

Copyright IBM Corporation 2004


Fabric Manager - Fabrics View

Copyright IBM Corporation 2004


Fabric Manager - Fabric Overview

View selector

Copyright IBM Corporation 2004


Fabric Manager - Switch Summary View

View selector

Copyright IBM Corporation 2004


Fabric Manager - Topology View

Copyright IBM Corporation 2004


Topology View - Attached Devices

Double-click device icon

Copyright IBM Corporation 2004


Fabric Manager - Port Grid

Copyright IBM Corporation 2004


Fabric Manager - Tools

Copyright IBM Corporation 2004


FM - Multiswitch Firmware Download

Copyright IBM Corporation 2004


Secure FOS - Security Policies

Define Fabric Configuration Server (FCS)


Define Switch Connection Control (SCC)
Define Device Connection Control (DCC)
Define Management Access Control (MAC)
Telnet/HTTP/API
SES/Managemnet Server
Serial port/Front panel
Manage passwords

Copyright IBM Corporation 2004


Functions of IBM SAN Portfolio: b-type

(b-type)

Setting up the IBM TotalStorage


SAN Switches: b-type

Functions of the IBM TotalStorage


SAN Switches: b-type

Copyright IBM Corporation 2004


Switch - Port Interfaces
NL_Port
N_Port

F_Port
E_Port Switch FL_Port
Switch

F_Port FL_Port
E_Port F_Port

N_Port
N_Port

Copyright IBM Corporation 2004


Switch Port Initialization

U_Port What is plugged into the port?

FL_Port Loop Device?

G_Port

Point-to-Point
E_Port F_Port Device?
Another Switch?
Copyright IBM Corporation 2004
E_Port Functions

Connects two switches to create a Fabric

Uses Virtual Channels within the ISL for performance

E E

ISLs

E E

Switch Switch

Copyright IBM Corporation 2004


F_Port Functions

Connects N_Ports to Fabric


Server

Assigns 24-bit Port_ID


N_ Port Supports Class 2 and Class 3 Services

Registers N_Port to Name Server

F_ Port
Switch

F_ N_

Copyright IBM Corporation 2004


FL_Port Functions
NL_Port
Connects FC_AL Ports to Fabric

Registers public and private devices


to Name Server
FL_Port

Provides Translative Mode Switch


Public host <==> Private device
Hub

Supports QuickLoop NL_Port


Private host <==> Fabric device

NL_Port

Copyright IBM Corporation 2004


FL_Port Translative Mode
S_ID x'011400' NL_Port
D_ID x'02153A'

N_Port AL_PA x'04'


x'021500'
FL_Port
F_Port
Switch
Switch
E_Port
F_Port Hub

D_ID x'000008'
NL_Port
N_Port

NL_Port

S_ID x'00003A'
AL_PA x'IF'

AL_PA x'3A'
Copyright IBM Corporation 2004
QuickLoop Mode

A B C

Server Server
Server

3534/2109

X Y

Copyright IBM Corporation 2004


Private Host Communicating
with Fabric Device

A B C D

Server Server Server


Server

3534/2109

2109 Switch

X Y Z
S

Copyright IBM Corporation 2004


Name Server - Distributed Model

Name Server db Name Server db

Switch Switch
Distributed
Name Server
Switch
Switch
(FC - CT)

Name Server db db
Name Server
Fabric

Copyright IBM Corporation 2004


Name Server - Functional View

Copyright IBM Corporation 2004


Name Server - Switch View

ATSSAN_fabric2:admin> nsshow
The Local Name Server has 9 entries {
Type Pid COS PortName NodeName TTL(sec) Remote
*N 011f00; 2,3;10:00:00:00:c9:22:ae:68;20:00:00:00:c9:22:ae:68; 885 Entry
FC4s: FCP
PortSymb: [28] "EMULEX FIREFLY "
Fabric Port Name: 20:0f:00:60:69:10:41:b6
N 021a00; 3;21:00:00:e0:8b:02:1b:69;20:00:00:e0:8b:02:1b:69; na
Fabric Port Name: 20:0a:00:60:69:10:3a:ce
N 021b00; 2,3;10:00:00:00:c9:20:d8:5f;10:00:00:00:c9:20:d8:5f; na
Fabric Port Name: 20:0b:00:60:69:10:3a:ce
N 021c00; 2,3;10:00:00:00:c9:22:ae:a7;20:00:00:00:c9:22:ae:a7; na Local
FC4s: FCP [EMULEX FIREFLY ] Entries
Fabric Port Name: 20:0c:00:60:69:10:3a:ce
N 021d00; 2,3;10:00:00:00:c9:22:72:48;20:00:00:00:c9:22:72:48; na
FC4s: FCP [EMULEX FIREFLY ]
Fabric Port Name: 20:0d:00:60:69:10:3a:ce
N 021e00; 2,3;10:00:00:00:c9:22:af:a3;20:00:00:00:c9:22:af:a3; na
FC4s: FCP [EMULEX FIREFLY ]
Fabric Port Name: 20:0e:00:60:69:10:3a:ce
N 021f00; 2,3;10:00:00:00:c9:22:af:ae;20:00:00:00:c9:22:af:ae; na
FC4s: FCP [EMULEX FIREFLY ]

*N
Fabric Port Name: 20:0f:00:60:69:10:3a:ce
031700; 2,3;10:00:00:00:c9:24:60:0b;50:05:07:63:00:c0:0b:96; 885
Remote
FC4s: FCP Entries
PortSymb: [28] "IBM 2105F20 1003"
Fabric Port Name: 20:07:00:60:69:10:39:6a
*NL 0318ef; 3;20:01:00:60:45:16:15:2f;10:00:00:60:45:16:15:2f; 885
FC4s: FCP
PortSymb: [28] "PATHLGHTSAN Gateway 329V"
Fabric Port Name: 20:08:00:60:69:10:39:6a
}

Copyright IBM Corporation 2004


Dual Fabric

Server 1 Server 2 Server N

Switch Switch

Disk Storage

Copyright IBM Corporation 2004


Multiswitch Fabric

Copyright IBM Corporation 2004


Fault Tolerant Fabric

Switch Switch Switch Switch

k
Lin er
ilo v
Fa

Switch Switch

Copyright IBM Corporation 2004


Multiple Interswitch Links

Switch 1 Data Traffic Switch 2

Data Traffic

Data Traffic
Data Traffic

Switch 3
Copyright IBM Corporation 2004
Cross-connected Fabric

Edge Edge
switches switches

Cross-connect
switches

Copyright IBM Corporation 2004


Exercise 1: To Cascade or Not?

Server 1 Server 2 Server 3 Server 4 Server 5

8-port
switch

Disk Storage

Copyright IBM Corporation 2004


Fabric Shortest Path First (FSPF)

(2 Hops)

(3 Hops)

Copyright IBM Corporation 2004


FSPF - Link Cost Metric

1Gbps
2Gbps

(2 Hops)
Cost metric = 2000

(3 Hops)
Cost metric = 2000

Copyright IBM Corporation 2004


FSPF - Load Sharing

(2 Hops)

(2 Hops)

Loading Sharing

Copyright IBM Corporation 2004


Display All Paths to Domains - topologyShow
topologyShow

ATSSAN_fabric1:view> topologyShow

4 domains in the fabric; Local Domain ID: 1

Domain Metric Hops Out Port In Ports Flags Name


-----------------------------------------------------------------
2 2000 2 0 0x0000a800 D "ATSSAN_fabric2"
1 0x00005000 D

3 1000 1 0 0x0000f802 D "ATSSAN_fabric3"

4 1000 1 1 0x0000f801 D "ATSSAN_fabric4"

Copyright IBM Corporation 2004


Fabric Topology GUI

Copyright IBM Corporation 2004


Fabric Topology from Domain 1 to Domain 2

11 12 15 13 14

1
1 0

Intermediate
switch

Copyright IBM Corporation 2004


Fabric Topology from Domain 1 to Domain 3

11 12 15 13 14

1
1 0

Copyright IBM Corporation 2004


Fabric Topology from Domain 1 to Domain 4

11 12 15 13 14

1
1 0

Copyright IBM Corporation 2004


Exercise 2: ATSSAN_fabric1 Topology
Fabric Topology for Domain 1

11 12 13 14 15
2 hops
1 2
1 0

4 3

Copyright IBM Corporation 2004


Fabric Topology from Domain 4 to Domain 1

1 0

Copyright IBM Corporation 2004


Fabric Topology from Domain 4 to Domain 2

Copyright IBM Corporation 2004


Fabric Topology from Domain 4 to Domain 3

Intermediate
switch

Copyright IBM Corporation 2004


Exercise 3: ATSSAN_fabric4 Topology
Fabric Topology for Domain 4

11 12 13 14 15
2 hops
1 2
1 0

4 ? 3

Copyright IBM Corporation 2004


InterSwitch Link Trunking

Individual
2 Gb Links
A 2.0 Gb
Congestion 2.0 Gb
A E
B 1.5 Gb B 1.5 Gb
C 0.5 Gb C 0.5 Gb
D 1.0 Gb D 1.0 Gb
E 2.0 Gb 2.0 Gb

2.0 Gb
Single 2.0 Gb
1.5 Gb 1.5 Gb
0.5 Gb 0.5 Gb
1.0 Gb 1.0 Gb
2.0 Gb 8 Gb Trunk 2.0 Gb

Copyright IBM Corporation 2004


Enabling Ports for Trunking

Trunk group = quads (octals for 2005-B32)

Copyright IBM Corporation 2004


Trunk Information

Before

After

Copyright IBM Corporation 2004


Routing Topology - Before Enabling Trunking

10 9

21
4 5

Before

Copyright IBM Corporation 2004


Routing Topology - After Enabling Trunking

10 9

21
4 5

After

Copyright IBM Corporation 2004


Trunking: CLI Output Examples
3800_21:admin> fabricShow
Switch ID Worldwide Name Enet IP Addr FC IP Addr Name
-----------------------------------------------------------------------
9: fffc09 10:00:00:60:69:50:11:53 10.255.255.209 0.0.0.0 "3800_9"
21: fffc15 10:00:00:60:69:50:10:85 10.255.255.221 0.0.0.0 "3800_21"
109: fffc6d 10:00:00:60:69:20:54:e4 10.255.255.109 0.0.0.0 >"2400_109"
The Fabric has 3 switches

3800_21:admin> islShow
1: 4 -> 4 10:00:00:60:69:50:11:53 3800_9 sp: 2G bw: 4G TRUNK
2: 9 -> 1 10:00:00:60:69:20:54:e4 2400_109 sp: 1G bw: 1G

3800_21:admin> trunkshow
1: 4 -> 4 10:00:00:60:69:50:11:53 deskew 15 MASTER
5 -> 5 10:00:00:60:69:50:11:53 deskew 16

3800_21:admin> topologyShow
3 domains in the fabric; Local Domain ID: 21

Domain Metric Hops Out Port In Ports Flags Bandwidth Name


-----------------------------------------------------------------------
9 500 1 4 0x00000600 D 4 (Gbs) "3800_9"
109 1000 1 9 0x00000410 D 1 (Gbs) "2400_109"

Copyright IBM Corporation 2004


Trunking Exercise
PULSAR5:admin> trunkshow
1: 0 -> 15 10:00:00:60:69:80:04:ee deskew 15 MASTER

2: 3 -> 80 10:00:00:60:69:80:04:ee deskew 15 MASTER

3: 4 -> 0 10:00:00:05:1e:34:13:4a deskew 15 MASTER

4:10 -> 29 10:00:00:60:69:80:43:b7 deskew 15 MASTER

5:25 -> 15 10:00:00:05:1e:34:13:4a deskew 15 MASTER

6:26 -> 13 10:00:00:60:69:80:43:b7 deskew 15 MASTER

PULSAR5:admin> islshow
1: 0-> 15 10:00:00:60:69:80:04:ee Asteroid sp: 2G bw:2G TRUNK
2: 3-> 80 10:00:00:60:69:80:04:ee Asteroid sp: 2G bw:2G TRUNK
3: 4-> 0 10:00:00:05:1e:34:13:4a SANBladeFC2 sp: 2G bw:2G TRUNK
4: 10-> 29 10:00:00:60:69:80:43:b7 sp: 2G bw:2G TRUNK
5: 25-> 15 10:00:00:05:1e:34:13:4a SANBladeFC2 sp: 2G bw:2G TRUNK
6: 26-> 13 10:00:00:60:69:80:43:b7 sp: 2G bw:2G TRUNK

Copyright IBM Corporation 2004


Identify Route using the pathInfo Command
DAZZ16A:admin> pathinfo 10,7,7 -r Host
7
Target port is Embedded 6
Hop In Port Domain ID (Name) Out Port BW Cost
----------------------------------------------------------
DAZZ16A
0 E 6 (DAZZ16A) 8 8G 500 8
1 64 1 (Meteor) 80 4G 500
2 4 10 (DAZZ8B) E - -

Reverse path
3 E 10 (DAZZ8B) 4 4G 500
4 80 1 (Meteor) 64 8G 500 64
5 8 6 (DAZZ16A) E - - 1
Meteor
80

DAZZ16A:admin> islshow
1: 8-> 64 10:00:00:60:69:e2:01:38 Meteor sp: 2G bw: 8G TRUNK
DAZZ16A:admin> trunkshow
1: 8 -> 64 10:00:00:60:69:e2:01:38 deskew 15 MASTER 4
9 -> 65
10 -> 66
10:00:00:60:69:e2:01:38
10:00:00:60:69:e2:01:38
deskew
deskew
16
15 10
11 -> 67 10:00:00:60:69:e2:01:38 deskew 16 DAZZ8B
7
Device
Copyright IBM Corporation 2004
Domain 1 islShow and trunkShow
Meteor:admin> islshow Host
1: 1-> 3 10:00:00:60:69:50:04:a7 IOTL120 sp: 2G bw: 4G TRUNK 7
2: 16-> 2
3: 32-> 4
10:00:00:60:69:50:03:fd
10:00:00:05:1e:34:11:ad
IOTL118
DAZZ16C
sp:
sp:
2G
2G
bw:
bw:
4G
2G
TRUNK
TRUNK 6
4: 33-> 4
5: 34-> 1
10:00:00:05:1e:34:10:5a
10:00:00:60:69:50:03:e5
DAZZ8A
IOTL119
sp:
sp:
2G
2G
bw:
bw:
2G
2G
TRUNK
TRUNK DAZZ16A
6: 48-> 8 10:00:00:05:1e:34:11:9a DAZZ16B sp: 2G bw: 2G
7: 49-> 9 10:00:00:05:1e:34:11:9a DAZZ16B sp: 2G bw: 2G 8
8: 50-> 6 10:00:00:60:69:c0:06:d5 Mojo1 sp: 2G bw: 2G TRUNK
9: 64-> 8 10:00:00:05:1e:34:11:8e DAZZ16A sp: 2G bw: 8G TRUNK
10: 80-> 4 10:00:00:05:1e:34:10:5d DAZZ8B sp: 2G bw: 4G TRUNK
11: 97-> 14 10:00:00:60:69:10:6f:4a IOTL104 sp: 1G bw: 1G
12: 98-> 16 10:00:00:60:69:90:03:60 IOTL128 sp: 1G bw: 1G
13: 99-> 17 10:00:00:60:69:90:03:60 IOTL128 sp: 2G bw: 2G TRUNK 64
14: 109-> 5
15: 111-> 13
10:00:00:05:1e:34:55:78
10:00:00:05:1e:34:55:6c
pulsar3
Pulsar4
sp:
sp:
2G
2G
bw:
bw:
2G
2G
TRUNK
TRUNK 1
16: 112-> 0 10:00:00:60:69:80:43:b6 SecFab1 sp: 2G bw: 8G TRUNK
Meteor
Meteor:admin> trunkshow 80

7:64 -> 8 10:00:00:05:1e:34:11:8e deskew 16 MASTER


67 -> 11 10:00:00:05:1e:34:11:8e deskew 15
66 -> 10 10:00:00:05:1e:34:11:8e deskew 16 4
65 -> 9 10:00:00:05:1e:34:11:8e deskew 17 10
DAZZ8B
8:80 -> 4 10:00:00:05:1e:34:10:5d deskew 16 MASTER
81 -> 5 10:00:00:05:1e:34:10:5d deskew 15 7
Device
Copyright IBM Corporation 2004
Identify Route GUI - Host to Device (1 of 2)
Domain 6 to Domain 1 Host
7
6
DAZZ16A
8

64
1
Meteor
?

?
10
DAZZ8B
7
Device
Copyright IBM Corporation 2004
Identify Route GUI - Host to Device (2 of 2)
Domain 1 to Domain 10 Host
7
6
DAZZ16A
Slot 7 Port 0 = port 64 8

64
1
Meteor
80

4
10
DAZZ8B
7
Copyright IBM Corporation 2004
Device
Multipathing: Review Exercise
Storage
Server 1
FC HBA1 FC port

FC Switch
FC HBA2

LUN1

FC port
FC Switch

FC port

Copyright IBM Corporation 2004


Multipath Example: Assign LUNs to Host Port

Copyright IBM Corporation 2004


Example: Assign Same LUNs to Other Port

Windows
Host

SAN

LUNs for
Windows
Host

Copyright IBM Corporation 2004


Example: Name Server Adapter Entries

Copyright IBM Corporation 2004


Example: LUNs Reported by Both HBAs

8 SCSI
devices

2 SDD
devices

2 HBAs

Copyright IBM Corporation 2004


Example: LUNs Reported by HBA Connection

4 SCSI
devices

4 SCSI
devices

2 SDD
devices

Copyright IBM Corporation 2004


Example: Disks Seen by OS Logical Layer

2 disks
for
OS use

Copyright IBM Corporation 2004


Example: Disks Managed by SDD

Copyright IBM Corporation 2004


AIX Exercise: Assign LUNs to Host Ports

Copyright IBM Corporation 2004


AIX Exercise: Assigned LUNs to AIX Ports

Copyright IBM Corporation 2004


AIX Exercise: AIX Host Bus Adapters
# lscfg -vl fcs0
fcs0 P1-I12/Q1 FC Adapter
Network Address.............10000000C9295563
ROS Level and ID............02903331
Device Specific.(Z0)........4002206D
Device Specific.(Z1)........10020193
Device Specific.(Z2)........3001506D
Device Specific.(Z3)........03000909
Device Specific.(Z4)........FF101493
Device Specific.(Z5)........02903331
Device Specific.(Z6)........06113331
Device Specific.(Z7)........07113331
Device Specific.(Z8)........20000000C9295563
# lscfg -vl fcs1
fcs1 P1-I11/Q1 FC Adapter
Network Address.............10000000C92953F2
ROS Level and ID............02903331
Device Specific.(Z0)........4002206D
Device Specific.(Z1)........10020193
Device Specific.(Z2)........3001506D
Device Specific.(Z3)........03000909
Device Specific.(Z4)........FF101493
Device Specific.(Z5)........02903331
Device Specific.(Z6)........06113331
Device Specific.(Z7)........07113331
Device Specific.(Z8)........20000000C92953F2
Copyright IBM Corporation 2004
AIX Exercise: Configuration of Fabric Ports
AIX Host

Name Server

11 12 30

LUN
5705

LUNs for AIX Host


Copyright IBM Corporation 2004
AIX Exercise: Discovered Hdisks
# lsdev -Cc disk
hdisk0 Available 11-08-00-2,0 16 Bit LVD SCSI Disk Drive
hdisk1 Defined 11-08-00-4,0 16 Bit LVD SCSI Disk Drive
hdisk2 Available 31-08-01 IBM FC 2105
hdisk3 Available 31-08-01 IBM FC 2105
hdisk4 Available 31-08-01 IBM FC 2105
hdisk5 Available 31-08-01 IBM FC 2105
hdisk6 Available 31-08-01 IBM FC 2105
hdisk7 Available 31-08-01 IBM FC 2105
hdisk8 Available 31-08-01 IBM FC 2105
hdisk9 Available 31-08-01 IBM FC 2105 # lsattr -El vpath0
hdisk10 Available 31-08-01 IBM FC 2105
active_hdisk hdisk17/70527840 Active hdisk
hdisk11 Available 31-08-01 IBM FC 2105
hdisk12 Available 34-08-01 IBM FC 2105 active_hdisk hdisk2/70527840 Active hdisk
hdisk13 Available 34-08-01 IBM FC 2105 active_hdisk hdisk12/70527840 Active hdisk
hdisk14 Available 34-08-01 IBM FC 2105 active_hdisk hdisk7/70527840 Active hdisk
hdisk15 Available 34-08-01 IBM FC 2105 policy df Scheduling Policy
hdisk16 Available 34-08-01 IBM FC 2105 pvid none Physical volume identifier
hdisk17 Available 34-08-01 IBM FC 2105 serial_number 70527840 LUN serial number
hdisk18 Available 34-08-01 IBM FC 2105
hdisk19 Available 34-08-01 IBM FC 2105
hdisk20 Available 34-08-01 IBM FC 2105
hdisk21 Available 34-08-01 IBM FC 2105
vpath0 Available Data Path Optimizer Pseudo Device Driver
vpath1 Available Data Path Optimizer Pseudo Device Driver
vpath2 Available Data Path Optimizer Pseudo Device Driver
vpath3 Available Data Path Optimizer Pseudo Device Driver
vpath4 Available Data Path Optimizer Pseudo Device Driver

Copyright IBM Corporation 2004


AIX Exercise: SDD vpath0
# datapath query adapter

Active Adapters :2
Adpt# Adapter Name State Mode Select Errors Paths Active
0 fscsi0 NORMAL ACTIVE 11575868 10 10 10
1 fscsi1 NORMAL ACTIVE 11806860 5 10 10

# datapath query device

Total Devices : 5
DEV#: 0 DEVICE NAME: vpath0 TYPE: 2105800 POLICY: Optimized
SERIAL: 70527840
=================================================================
Path# Adapter/Hard Disk State Mode Select Errors
0 fscsi0/hdisk2 OPEN NORMAL 1060007 6
1 fscsi0/hdisk7 OPEN NORMAL 1125014 0
2 fscsi1/hdisk12 OPEN NORMAL 1114922 3
3 fscsi1/hdisk17 OPEN NORMAL 1177652 0

Copyright IBM Corporation 2004


AIX Exercise: FSCSI0 Hdisks for vpath0
# lscfg -vl hdisk2
hdisk2 P1-I12/Q1-W5005076300C9AA58-L5705000000000000 IBM FC 2105

Manufacturer................IBM
Machine Type and Model......2105800
Serial Number...............70527840
EC Level.....................245
Device Specific.(Z0)........10
Device Specific.(Z1)........002C
Device Specific.(Z2)........0075
Device Specific.(Z3)........01504
Device Specific.(Z4)........05
Device Specific.(Z5)........00
# lscfg -vl hdisk7
hdisk7 P1-I12/Q1-W5005076300CDAA58-L5705000000000000 IBM FC 2105

Manufacturer................IBM
Machine Type and Model......2105800
Serial Number...............70527840
EC Level.....................245
Device Specific.(Z0)........10
Device Specific.(Z1)........00AC
Device Specific.(Z2)........0075
Device Specific.(Z3)........01504
Device Specific.(Z4)........05
Device Specific.(Z5)........00
Copyright IBM Corporation 2004
AIX Exercise: FSCSI1 Hdisks for vpath0
# lscfg -vl hdisk12
hdisk12 P1-I11/Q1-W5005076300C9AA58-L5705000000000000 IBM FC 2105

Manufacturer................IBM
Machine Type and Model......2105800
Serial Number...............70527840
EC Level.....................245
Device Specific.(Z0)........10
Device Specific.(Z1)........002C
Device Specific.(Z2)........0075
Device Specific.(Z3)........01504
Device Specific.(Z4)........05
Device Specific.(Z5)........00
# lscfg -vl hdisk17
hdisk17 P1-I11/Q1-W5005076300CDAA58-L5705000000000000 IBM FC 2105

Manufacturer................IBM
Machine Type and Model......2105800
Serial Number...............70527840
EC Level.....................245
Device Specific.(Z0)........10
Device Specific.(Z1)........00AC
Device Specific.(Z2)........0075
Device Specific.(Z3)........01504
Device Specific.(Z4)........05
Device Specific.(Z5)........00
Copyright IBM Corporation 2004
AIX Exercise: Hdisks Detail for vpath0
# lsattr -El hdisk2
lun_id 0x5705000000000000 Logical Unit Number ID True
lun_reset_spt yes Support SCSI LUN reset True
node_name 0x5005076300c0aa58 FC Node Name False
scsi_id 0x1e0b00 SCSI ID True
ww_name 0x5005076300c9aa58 FC World Wide Name False

# lsattr -El hdisk7


lun_id 0x5705000000000000 Logical Unit Number ID True
lun_reset_spt yes Support SCSI LUN reset True
node_name 0x5005076300c0aa58 FC Node Name False
scsi_id 0x1e0c00 SCSI ID True
ww_name 0x5005076300cdaa58 FC World Wide Name False

# lsattr -El hdisk12


lun_id 0x5705000000000000 Logical Unit Number ID True
lun_reset_spt yes Support SCSI LUN reset True
node_name 0x5005076300c0aa58 FC Node Name False
scsi_id 0x1e0b00 SCSI ID True
ww_name 0x5005076300c9aa58 FC World Wide Name False
# lsattr -El hdisk17
lun_id 0x5705000000000000 Logical Unit Number ID True
lun_reset_spt yes Support SCSI LUN reset True
node_name 0x5005076300c0aa58 FC Node Name False
scsi_id 0x1e0c00 SCSI ID True
ww_name 0x5005076300cdaa58 FC World Wide Name False
Copyright IBM Corporation 2004
Fibre Channel Switch Zoning

Fibre Channel SAN Zoning


Create logical groups within physical fabric
Zones can overlap
Control data access
Nodes with no zones
in common are invisible
to each other
Windows
Zoning management IBM Zone Zone 1
Administrator sets policy 3

Dynamic configuration
Fabric enforces zoning Sun Zone
2

Copyright IBM Corporation 2004


Zoning Concepts and Terminology

Zone
Configuration
Zone 1

Only one active Zone Members:


zone configuration Node WWN
at a given time Port WWN
Alias (optional)
Domain ID and Port
Number

Copyright IBM Corporation 2004


Zoning Example Configurations

Two zones
Blue
Server 5
Green

Server 3
One configuration
Server 1 Server 2
GB_CFG Server 4
Green Blue
Zone Zone

Intelligent
storage server 1 Intelligent
storage server 2

Intelligent
storage server 3

GB_CFG
Copyright IBM Corporation 2004
Zoning Implementation Steps in a Nut Shell

Identify resource access requirements


Step 1: among server and storage ports

Step 2: Planning Step 3: Implementation

a. Determine zone a. Create Alias


configuration Relate to ports

b. Define zones b. Create zone


Add members
c. Identify members
of each zone c. Create zone configuration
Add zones

d. Enable zone configuration

Copyright IBM Corporation 2004


Zone Administration

Switches

Zone Admin

Copyright IBM Corporation 2004


Create an Alias

3 4

Copyright IBM Corporation 2004


Create a Zone

3
4

Copyright IBM Corporation 2004


Search for Member in Selection List

Copyright IBM Corporation 2004


Create a Zone Configuration

3 4

Copyright IBM Corporation 2004


Zone Configuration Analysis

Copyright IBM Corporation 2004


Zone Configuration Action Options

Copyright IBM Corporation 2004


View Effective Configuration

Copyright IBM Corporation 2004


Display Initiator/Target Accessibility

Copyright IBM Corporation 2004


Print Zoning Configuration Summary

Copyright IBM Corporation 2004


Zoning: CLI Command Examples

Switch115:sanadmin aliCreate "DISK_NT", "1,1"


Switch115:sanadmin aliCreate "DISK_AIX", "1,9; 1,10"
Switch115:sanadmin aliCreate "NT1", "1,3"
Switch115:sanadmin aliCreate "NT2", "1,4"
Switch115:sanadmin aliCreate "AIX1", "1,11; 1,12"
Switch115:sanadmin aliCreate "AIX2", "1,13"
Switch115:sanadmin aliCreate "TAPE", "1,8"
Switch115:sanadmin zoneCreate "Zone_AIX", "DISK_AIX; AIX1; AIX2"
Switch115:sanadmin zoneCreate "Zone_AIX_TAPE", "DISK_AIX; AIX1; AIX2; TAPE"
Switch115:sanadmin zoneCreate "Zone_NT", "DISK_NT; NT1; NT2"
Switch115:sanadmin zoneCreate "Zone_NT_TAPE", "DISK_NT; NT1; NT2; TAPE"
Switch115:sanadmin cfgCreate "BKP_AIX_cfg", "Zone_AIX_TAPE; Zone_NT"
Switch115:sanadmin cfgCreate "BKP_NT_cfg", "Zone_NT_TAPE; Zone_AIX"
Switch115:sanadmin cfgShow "BKP_AIX_cfg"
cfg: BKP_AIX_cfg Zone_AIX_TAPE; Zone_NT

Switch115:sanadmin zoneShow "Zone_AIX_TAPE"


zone: Zone_AIX_TAPE
DISK_AIX; AIX1; AIX2; TAPE

Switch115:sanadmin aliShow "TAPE"


alias: TAPE 1,8

Switch115:sanadmin cfgEnable "BKP_AIX_cfg"

Copyright IBM Corporation 2004


Adding a New Switch to the Fabric

Alias data
Zone data
Zone Cfg data
Alias data
Zone data
Principal Switch Zone Cfg data

Alias data
Zone data
Zone Cfg data

Copyright IBM Corporation 2004


Merging Fabrics

Alias data 1 Alias data 2


Zone data 1 Zone data 2
Zone Cfg data 1 Zone Cfg data 2

Principal Switch

Alias data 2
Zone data 2
Zone Cfg data 2
Alias data 1
Zone data 1
Zone Cfg data 1

Copyright IBM Corporation 2004


Domain Overlap

Added switch has the same domain ID as another in the


fabric.
Reconfiguring switch is necessary, issue:
switchdisable
configdefault
cfgclear
switchenable
reboot

Copyright IBM Corporation 2004


Splitting Fabrics

Alias data 1 Alias data 1


Zone data 1 Zone data 1
Zone Cfg data 1 Zone Cfg data 1

Principal Switch

Alias data 1 Alias data 1


Zone data 1 Zone data 1
Zone Cfg data 1 Zone Cfg data 1

Copyright IBM Corporation 2004


Extended Distances

Remote Switch
(WAN)

SAN
SAN Fabric
Fabric
BB_Credit
management

Extended Fabric (MAN)

Copyright IBM Corporation 2004


Extended Fabric

Copyright IBM Corporation 2004


Unit Summary

Having completed this unit, you should be able to:


Plan for the implementation of the IBM TotalStorage SAN
switches and directors (b-type, m-type, n-type), and the Cisco
directors and switches by reviewing default configuration
parameters and tailoring options
List the steps necessary to set up and use the TotalStorage
SAN Switch Specialist, the McDATA EFC Manager, the CNT
Enterprise Manager, or the Cisco Fabric Manager user
interfaces
Describe switch port interfaces and port initialization
Interpret topology, routing, and trunking data displayed by switch
management interfaces
Plan and implement switch zoning to restrict any-to-any data
access and ensure resource access integrity

Copyright IBM Corporation 2004

Vous aimerez peut-être aussi