Académique Documents
Professionnel Documents
Culture Documents
Session ID-BRKDCT-1044
Housekeeping
We value your feedback- don't forget to complete your online session evaluations after each session & complete the Overall Conference Evaluation which will be available online from Thursday Visit the World of Solutions Please remember this is a 'non-smoking' venue! Please switch off your mobile phones Please make use of the recycling bins provided Please remember to wear your badge at all times
Presentation_ID
Cisco Public
Agenda
Datacenter Directions SAN Technology Trends IO Consolidation Fibre Channel Basics Enhanced Ethernet FCoE Technology Primer Translating FC to FCoE Basic Example Designs Q&A
Presentation_ID
Cisco Public
Presentation_ID
Cisco Public
Resource pooling for on demand services Integrated services to reduce footprint New Delivery models for next gen apps; web 2.0, mashups, SaaS Real Time Infrastructure for improved SLAs & instant provisioning Application, Server & Storage mobility for business continuance Higher uptime with simpler upgrade, refresh, & migration maximised asset Utilisation and Reduced carbon Cabling consolidation improve airflow, lower labour & acquisition costs, fewer failures.
Cisco Public
Reduced OPEX Reduced CAPEX Service Agility Higher Availability & Resilience Granular services & tiering Green IT Business to IT synergy Improved data protection Extends the lifetime of the DC Simplifies scaling & technology adoption strategy
5
Virtualised Network
Virtualized Compute
Virtualised Network
Virtualized Compute
Virtualised Storage
Virtualised Storage
The ubiquitous network touches everything, so it is the enabler for the evolving Data Center
Presentation_ID
Tomorrow
Network
Compute
Apps Apps
Network Storage
DR/Compliance
Compliance
Storage
Facilities
Network
Facilities
Presentation_ID
Presentation_ID
Cisco Public
Integrated Call-Home
Non-Disruptive
Online Software Upgrades, instrumentation
Stateful Software
Failover and Re-startable Software Modules
Logical Redundancy
VSANs, VRRP, ISL Bundling, Load Balancing
Physical Redundancy
Supervisors, Power Supplies, Fabrics
Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public
SAN Routing
Inter VSAN, service isolation, Consolidated backup
Storage Virtualization
Virtual SAN fabrics (VSAN) Trunked Fabric ports, NPIV, Multi-Tenancy
Security Services
Encryption, RBAC, VSAN ACL, Binding, AAA
Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public
10
With VSANs
Number of Switches Switch Utilization Simplified Management On-demand Flexibility Overall TCO Fewer Optimal Yes Yes Low
Presentation_ID
Cisco Public
11
IO Consolidation
Presentation_ID
Cisco Public
12
FC
SAN Extension VSAN SAN Security Zoning
FC
FICON
FC FICON
iSCSI
QoS
FCoE
FCIP
SAN Fabric
Presentation_ID
Cisco Public
13
LAN
SAN A
SAN B
Longer lead time for server provisioning Multiple fault domains complex diagnostics Management complexity
Ethernet FC
Presentation_ID
Cisco Public
14
I/O Consolidation
LAN SAN A SAN B
Nexus 5000
N4K-1
N4K-2
Reduction of server adapters Simplification of access layer and cabling Gateway free implementationfits in installed base of existing LAN and SAN L2 Multipathing Access Distribution Lower total cost of ownership Fewer cables Investment protection (LANs and SANs) Consistent operational model
Blade Chassis
Presentation_ID
Cisco Public
15
Benefits
Fewer Cables
Both block I/O & Ethernet traffic co-exist on same cable
Fewer adapters needed Overall less power Interoperates with existing SANs
Ethernet Fibre Channel Traffic
Management SANs remains constant
No Gateway
Presentation_ID
Cisco Public
16
SAN-A
SAN-B
LAN
4
SAN-A
SAN-B
Presentation_ID
Cisco Public
17
Presentation_ID
Cisco Public
18
Presentation_ID
Cisco Public
19
Fibre-Channel is deterministic.
Flow control is source-based (B2B credits) Services are fabric integrated (no loop concept)
Presentation_ID
Cisco Public
20
E_Port
F_Port
NP_Port
NPV Switch
TE_Port
End Node End Node
F_Port
N_Port
F_Port
N_Port
Presentation_ID
Cisco Public
21
22
Target
FC Fabric
Initiator
Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public
23
16
R_RDY Packet
24
Domain ID
FC Fabric
Switch Domain
Area
Device
FSPF performs hop-by-hop routing FSPF uses total cost as the metric to determine most efficient path FSPF supports equal cost load balancing across links
Presentation_ID
Cisco Public
26
Target
FC Fabric E_Port
F_Port N_Port
HBA
Initiator
27
pwwn 50:06:01:61:3c:e0:1a:f6
Target
FC Fabric
pwwn 10:00:00:00:c9:76:fd:31
Initiator
Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public
28
What is NPIV?
N-Port ID Virtualization (NPIV) provides a means to assign multiple FCIDs to a single N_Port Allows multiple applications to share the same Fiber Channel adapter port Different pWWN allows access control, zoning, and port security to be implemented at the application level Usage applies to platforms such as VMWare, MS Virtual Server and Citrix
Application Server FC NPIV Core Switch
Email I/O N_Port_ID 1 Web I/O N_Port_ID 2 File Services I/O N_Port_ID 3
F_Port
F_Port
Web
File Services
Presentation_ID
N_Port
Cisco Public
29
What is NPV?
N-Port Virtualizer (NPV) utilizes NPIV functionality to allow a switch to act like a server performing multiple logins through a single physical link Physical servers connected to the NPV switch login to the upstream NPIV core switch
Physical uplink from NPV switch to FC NPIV core switch does actual FLOGI Subsequent logins are converted (proxy) to FDISC to login to upstream FC switch
No local switching is done on an FC switch in NPV mode FC edge switch in NPV mode Does not take up a domain ID Scalability will be dependent on FC login limitation
Nexus 5000, MDS 91xx, MDS blade switches, UCS Fabric Interconnect
F-Port
Eth1/1
NP-Port
F-Port
Eth1/2
F_Port
Eth1/3
N-Port
Presentation_ID
Cisco Public
30
Enhanced Ethernet
Presentation_ID
Cisco Public
31
Presentation_ID
Cisco Public
32
Low latency 10GE affordability (even optics) Increased adoption of NAS (NFS/CIFS) and iSCSI Consolidation of networks
Unified Fabrics with ethernet
Presentation_ID
Cisco Public
33
Low transceiver latency Low error rate (1017) Thinner cable with higher bend radius
16x10 GE Cables
Application Server Application Server Application Server Application Server Application Server Application Server Application Server Application Server Application Server Application Server Application Server Application Server Application Server Application Server Application Server Application Server
Easier to manage cabling solution reduces deployment time All copper cables are contained within rack
Presentation_ID
16x10 GE Cables
34
Cisco Public
Distance
<10m 15m 10m 100m 82m 300m
55m 100m 30m
Standard
SFF 8431** IEEE 802.3ak none IEEE 802.3ae
X2 CX4
copper
SFP+ USR
MMF, ultra short reach
SFP+ SR
MMF,short reach
RJ45 10GBASE-T
copper
IEEE 802.3an
* Terminated cable
** Draft
Across racks
Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public
35
Ethernet Link
Receive Buffers
One Two
PAUSE
B2B Credits
Presentation_ID
Packet
Eight
2010 Cisco and/or its affiliates. All rights reserved. Cisco Public
36
STOP
Switch A
PAUSE
Queue Full
Switch B
The PAUSE operation is used to inhibit transmission of data frames for a specified period of time
Ethernet PAUSE transforms Ethernet into a lossless fabric, a requirement for FCoE.
Presentation_ID
Cisco Public
37
Offered Traffic
3G/s
3G/s
2G/s
3G/s
3G/s 3G/s 3G/s
3G/s
3G/s
4G/s
6G/s
3G/s
5G/s
t1
Presentation_ID
t2
t3
2010 Cisco and/or its affiliates. All rights reserved. Cisco Public
t1
t2
t3 38
Nexus 5000
Discovers lossless Ethernet Capabilities Responsible for Logical Link Up/Down signaling of Ethernet and FC DCBX negotiation failures will result in:
Per-priority-pause not enabled on CoS values with PFC configuration vfc not coming up when DCBX is being used in FCoE environment
Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public
39
Presentation_ID
Cisco Public
40
Unified Fabric
Fibre Channel over Ethernet (FCoE)
FCoE is Fibre Channel.
Easy to Understand Same Aligned with the Operational Model FC-BB-4 Model, Standardized in FC-BB-5 Same Techniques of Traffic Management Same Management and Security Models
Completely based on the FC model Same host-to-switch and switch-toswitch behavior of FC E.g., in order delivery or FSPF load balancing WWNs, FC-IDs, hard/soft zoning, nameserver, RSCN
Presentation_ID
Cisco Public
41
Protocol Organization
FCoE itself
Is the data plane protocol It is used to carry most of the FC frames and all the SCSI traffic
Device discovery
ENodes discover VF_Port capable FCF-MACs for VN_Port to VF_Port Virtual Links VE_Port capable FCF-MACs discover other VE_Port capable FCF-MACs for VE_Port to VE_Port Virtual Links The protocol verifies the Lossless Ethernet network supports the required Max FCoE Size
43
Encapsulation Technologies
Operating System / Applications SCSI Layer FCP iSCSI TCP IP FC
1, 2, 4, 8, 10 Gbps
FCP
SRP
FCoE IB
10, 20 Gbps
Ethernet
1, 10 . . . Gbps
FCoE is non routable, localised DC transport solution with lower protocol overhead than FCIP or iSCSI
Presentation_ID
Cisco Public
44
Presentation_ID
Cisco Public
45
FCoE Frame
Ethernet Header FCoE Header FC Header
FC Payload
Up to 2112 Bytes 4 Bytes FCoE standard (FC-BB-5) requires jumbo support; 2.5KB = baby jumbo
46
Presentation_ID
Cisco Public
47
10GbE
Link
PCIe
Ethernet
Ethernet Drivers
Operating System
Presentation_ID
Cisco Public
48
sw1
E
sw2
F N
FC Hosts
FCoE_LEP (FCoE link endpoint): The data forwarding component that handles FC frame encapsulation/decapsulation, and transmission/reception of FCoE frames FCoE Controller: the entity that implement the FIP protocol
Presentation_ID
Cisco Public
49
FCoE Forwarding
FCF (Fibre Channel Forwarder) is the forwarding entity inside an FCoE switch
- Fibre Channel login happens at the FCF - contains an FCF-MAC address - consumes a Domain ID
FCoE encap/decap happens within the FCF NPV devices are not FCFs and do not have domains
FCoE Switch
FC Domain ID : 15 FC port FC port FC port FC port Eth port
Presentation_ID
Eth port
Eth port
Eth port
Eth port
Cisco Public
Eth port
Eth port
Eth port
50
FCoE Link
ENode
FC-3/FC-4s FC-3/FC-4s FC-3/FC-4s FC Switching Element
FCF
VN_Port(1) FC-2V
FCoE_LEP
VN_Port(2) FC-2V
FCoE_LEP
VN_Port(3) FC-2V
FCoE_LEP FCoE Controller
VF_Port
FC-2V
FCoE_LEP FCoE_LEP
Ethernet_Port
Virtual Links
Ethernet_Port
MAC VN_Port(1)
MAC VN_Port(2)
MAC VN_Port(3)
FCF-MAC
FCF-MAC
FCF-MAC
51
Enode MAC assigned for each FCID Enode MAC composed of a FC-MAP and FCID
FC Fabric
FC-MAP is the upper 24 bits of the Enodes MAC FCID is the lower 24 bits of the Enodes MAC
FCoE forwarding decisions still made based on FSPF and the FCID within the Enode MAC Fibre Channel FCID Addressing
FC-MAP (0E-FC-xx)
FC-ID 10.00.01
FC-MAC Address
Session_ID Presentation_ID
FC-MAP (0E-FC-xx)
FC-ID 7.8.9
Translating FC to FCoE
Presentation_ID
Cisco Public
53
Target
ENode
Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public
54
FCoE Switch
Presentation_ID
Cisco Public
55
pwwn 50:06:01:61:3c:e0:1a:f6
Target
fcid 0x10.00.01 [pwwn 10:00:00:00:c9:76:fd:31] [tnitiator] fcid 0x11.00.01 [pwwn 50:06:01:61:3c:e0:1a:f6] [target]
pwwn 10:00:00:00:c9:76:fd:31
Initiator
Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public
57
Presentation_ID
Cisco Public
58
Modes of operation describe how native FC traffic is handled and therefore requires an FC module Modes are independent of the Nexus 5000 acting as an FCF or FCoE Pass-Through for FCoE traffic Modes are consistent with current FC edge switches (MDS 9124/9134/9222i)
Presentation_ID
Cisco Public
59
Presentation_ID
Cisco Public
60
Multiple VSANs per F_Port Port-Channel Zoning, DPVM, etc. are not enforced on the Nexus 5000 Domain manager, FSPF, zone server, fabric login server, name server run on NPIV core switch
Presentation_ID
Cisco Public
61
Nexus 4000
embedded FCoE switch for traditional blade systems
Solution Comparison Traditional LAN & SAN in Blade Servers
LAN SAN A SAN B
DCB
Ethernet
FC
62
Unified I/O lowers CapEx by reducing switches, cables & adapters Additional OpEx savings by reduced power & points of management
Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved. Cisco Public
63
VF_Ports VN_Ports
Presentation_ID
Cisco Public
64
VN_Ports VF_Ports
Presentation_ID
Cisco Public
65
10GE Backbone
Presentation_ID
Cisco Public
66
SAN Ops
SAN B
Business Process: Same as today o Configure FC Interface mode, speed, VSAN, Port Channels, Trunks, NPV etc. o Monitor SAN specific MIBs, Syslog, RMON. Box Mgmt: o CLI (Role based) o XML API Network Mgmt System: o Existing tool - Fabric Manager
SAN A
Nexus 5K
LAN
Network Ops
Business Process: Same as today o Configure Ethernet port, VLAN, STP, Port Channels, Trunks etc. o Monitor LAN specific MIBs, Syslog, RMON. Box Mgmt: o CLI (Role based) o XML API Network Mgmt System: o Existing GNCC tools (Smarts, Infovista, Alterpoint, Opnet) o Cisco tool - DCNM
67
Converged Activities
Business Processes: o Switch reboot o Image upgrade o User roles o Initial creation of virtual interfaces (veth, vfc) Box Mgmt: Creation of Mgmt Interface Day-2 System level support: Memory, CPU error, Call Home feature, Span ports.
Presentation_ID 2010 Cisco and/or its affiliates. All rights reserved.
Q&A Wrap Up
Presentation_ID
Cisco Public
68
Recommended Reading
Presentation_ID
Cisco Public
69
Presentation_ID
Cisco Public
70
Dont forget to activate your Cisco Live and Networkers Virtual account for access to all session materials, communities, and on-demand and live activities throughout the year. Activate your account at any internet station or visit www.ciscolivevirtual.com.
Cisco Public
Presentation_ID
71
Presentation_ID
Cisco Public
72