2008 Cisco Systems, Inc. All rights reserved.

Cisco Confidential Cisco Expo 2008 1

Cisco Next
Generation Data
Center:
Nexus 7000
Introduction
Marian Klas, CCIE #5933
mklas@cisco.com
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 2 Cisco Expo 2008
Agenda
Introduction
Nexus 7000 Chassis
Nexus 7000 Modules
Nexus 7000 Fabric & Bandwidth
NX-OS Overview
Data Center Network Manager
Data Center Network Design Evolution
Q & A
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 3 Cisco Expo 2008
Operational
Limitations
Data Centers Are Under Increasing Pressure
New Business
Pressures
Collaboration SLA Metrics Empowered User Global Availability Reg. Compliance
Power & Cooling Provisioning Asset Utilization Security Threats Bus. Continuance
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 4 Cisco Expo 2008
Scale of Current Problems Demands a New
Approach
Infrastructure Scalability Infrastructure Scalability
By 2009, 50% of large businesses will spend more on power By 2009, 50% of large businesses will spend more on power
and cooling then on new servers and cooling then on new servers (Gartner, 2006) (Gartner, 2006)
Quad Quad- -cores and octal cores and octal - -cores will drive significantly more traffic cores will drive significantly more traffic
Storage is expected to continue to grow at a 40 Storage is expected to continue to grow at a 40- -70% CAGR 70% CAGR
(Gartner, 2006) (Gartner, 2006)
Operational Continuity
Expectation of 24x7 application availability
54% of network downtime is caused by human error
(Uptime Institute, 2007)
Operational Continuity Operational Continuity
Expectation of 24x7 application availability Expectation of 24x7 application availability
54% of network downtime is caused by human error 54% of network downtime is caused by human error
(Uptime Institute, 2007) (Uptime Institute, 2007)
Transport Flexibility
Continued deconstruction of the server increases demands on
the network
Market transitions between transport technologies and
application architectures
Transport Flexibility Transport Flexibility
Continued deconstruction of the server increases demands on Continued deconstruction of the server increases demands on
the network the network
Market transitions between transport technologies and Market transitions between transport technologies and
application architectures application architectures
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 5 Cisco Expo 2008
Critical Infrastructure for Data Center 3.0
Unified Fabric
and I/O
Interfaces
Cisco

Nexus
Switching
Platforms
NX-OS
Operating
System
Data Center
Network Manager
Simply infrastructure (reduce capex) and
operational complexity (lower opex)
Lowers overall data center power draw
Forward Investment Protection
Engineered the most stringent availability
requirements
Designed with features that improve
operational continuity
Delivers virtualized network services
Provides holistic view of the network to
simplify management and facilitate
troubleshooting
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 6 Cisco Expo 2008
Agenda
Introduction
Nexus 7000 Chassis
Nexus 7000 Modules
Nexus 7000 Fabric & Bandwidth
NX-OS Overview
Data Center Network Manager
Data Center Network Design Evolution
Q & A
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 7 Cisco Expo 2008
Nexus 7000: First In Class
Data Center
Class Platform
Data Center
Class Operating
System
Data Center
Network Manager
(DCNM)
Multi-Terabit system
550Gb/slot capable
Optimized for 10 / 40 / 100 Gbps interfaces
Extreme availability
Multi-protocol (Ethernet, Storage and
Unified I/O)
Self Healing Operating system
Graceful system operation
Virtualized Control Plane and Data Plane
Fully Modular
Security
Unified Data Center Manager
Configuration / Provisioning / Service
Enablement / Network Ops / Status /
Statistics / Event Management
Powerful feature rich web services API (XML)
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 8 Cisco Expo 2008
Nexus 7010 10-Slot Chassis
First chassis in Nexus 7000 product
family
Optimized for data center environments
High density
256 10G interfaces per system
High performance
1.2Tbps system bandwidth at initial
release
80Gbps per slot
60Mpps per slot
Future proof
Initial fabric provides up to 4.1Tbps
Product family scaleable to 15+Tbps
40/100G and Unified Fabric ready
33.1-38
(84-96.5cm)
17.3 (43.9cm)
21 RU
36.5
(92.7cm)
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 9 Cisco Expo 2008
Nexus 7010 Chassis Front
Lockable front doors (removable)
System status LEDs
Integrated cable management with door
Air intake with optional filter
8 payload slots (1-4, 7-10)
2 supervisor slots (5-6)
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 10 Cisco Expo 2008
Nexus 7010 Chassis Back
Air exhaust
5 crossbar fabric modules
2 fabric fan trays
2 system fan trays
3 power supplies
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 11 Cisco Expo 2008
System Power
6000W AC power supply for Nexus
7000 series chassis
Dual inputs at 220/240V or 110/120V
Proportional load-sharing among
supplies
Hot swappable
Blue beacon LED for easy identification
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 13 Cisco Expo 2008
Cable Management
Integrated cable management
tray with straps
No interference with servicing
of common equipment
Cable grooming to right, left, or
split
Can route up to 384 Cat6A
cables to one side of chassis
worst-case scenario
Cable tray cover and lockable
front doors prevent accidental
interference
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 16 Cisco Expo 2008
Agenda
Introduction
Nexus 7000 Chassis
Nexus 7000 Modules
Nexus 7000 Fabric & Bandwidth
NX-OS Overview
Data Center Network Manager
Data Center Network Design Evolution
Q & A
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 17 Cisco Expo 2008
Compact Flash cover
Supervisor Engine
Dual-core 1.66GHz Intel Xeon processor with 4GB DRAM
Connectivity Management Processor (CMP) for lights-out
management
2MB NVRAM, 2GB internal bootdisk, 2 external compact flash
slots
10/100/1000 management port with 802.1AE LinkSec
Console & Auxiliary serial ports
USB ports for file transfer
Blue beacon LED for easy identification
Beacon
LED
Console Port
AUX Port
Management
Ethernet
USB Ports CMP Ethernet
Reset Button Status
LEDs
Compact Flash
Slots
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 18 Cisco Expo 2008
Management Ethernet Interface
10/100/1000 interface used
exclusively for system
management
Belongs to dedicated
managementVRF
Prevents data plane traffic from
entering/exiting from mgmt0
interface
Cannot move mgmt0 interface to
another VRF
Cannot assign other system ports
to management VRF
Capable of IEEE 802.3ae LinkSec
encryption (not enabled in 4.0
release)
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 19 Cisco Expo 2008
Out-of-band
management
network
CMP
CMP
CMP
CMP
Data
Network
CMP
CMP
CMP
CMP
Connectivity Management Processor (CMP)
Standalone, always-on microprocessor on
supervisor engine
Provides lights out remote management and
disaster recovery via 10/100/1000 interface
Removes need for terminal servers
Monitor supervisor and modules, access log
files, power cycle supervisor, etc.
Runs lightweight Linux kernel and network stack
Completely independent of NX-OS on main CPU
Data
Network
console cables
Terminal Servers
(out-of-band
console connecti vity)
Out-of-band
management
network
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 20 Cisco Expo 2008
32-Port 10GE I/O Module
32 10GE ports with SFP+
transceivers
80G full duplex fabric connectivity
Integrated 60Mpps forwarding
engine for fully distributed
forwarding
4:1 oversubscription at front panel
Virtual output queueing (VOQ)
ensuring fair access to fabric
bandwidth
802.1AE LinkSec on every port
Buffering:
Dedicated mode: 100MB ingress,
80MB egress
Shared mode: 1MB/port +100 MB
ingress, 80MB egress per 4 ports
Queues: 8q2t ingress, 1p7q4t
egress
Blue beacon LED for easy
identification
SFP+
SR at initial release 300m over MMF
LR post-release 10km over SMF
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 21 Cisco Expo 2008
Shared versus Dedicated Mode
9 11 13 15
9 11 13 15
Dedicated mode
One interface gets 10G bandwidth
Three interfaces disabled
Shared mode
Four interfaces share 10G bandwidth
10G
To fabric
10G
To fabric
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 22 Cisco Expo 2008
48-Port 1GE I/O Module
48 1GE 10/100/1000 RJ -45 ports
40G full duplex fabric connectivity
Integrated 60Mpps forwarding
engine for fully distributed
forwarding
Virtual output queueing (VOQ)
ensuring fair access to fabric
bandwidth
802.1AE LinkSec on every port
Buffer: 7.5MB ingress, 6.2MB
egress
Queues: 2q4t ingress, 1p3q4t
egress
Blue beacon LED for easy
identification
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 24 Cisco Expo 2008
Agenda
Introduction
Nexus 7000 Chassis
Nexus 7000 Modules
Nexus 7000 Fabric & Bandwidth
NX-OS Overview
Data Center Network Manager
Data Center Network Design Evolution
Q & A
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 25 Cisco Expo 2008
I/O Module Bandwidth Capacity
Initially shipping I/O module bandwidth: 80Gbps per slot
Assumes 8 * 10G ports in dedicated mode per module
In Nexus 7000 10-slot chassis:
(80Gbps/slot) * (8 payload slots) = 640Gbps
(640Gbps) * (2 for full duplex operation) = 1280Gbps =
1.2Tbps system bandwidth
1.2 Terabits per second initial system bandwidth
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 26 Cisco Expo 2008
Fabric Bandwidth Capacity
Initially shipping fabric bandwidth: 230Gbps per payload
slot, 115Gbps per supervisor slot
Initially shipping modules cannot fully leverage fabric bandwidth
Assumes future modules that can leverage full bandwidth
In Nexus 7000 10-slot chassis:
(230Gbps/slot) * (8 payload slots) = 1840Gbps
(115Gbps/slot) * (2 supervisor slots) = 230Gbps
(1840 + 230 = 2070Gbps) * (2 for full duplex operation) =
4140Gbps = 4.1Tbps system bandwidth
4.1 Terabits per second fabric bandwidth capacity
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 27 Cisco Expo 2008
Future Vision for Platform Series
Future goal to double fabric bandwidth
500+Gbps bandwidth per slot
Requires future fabric module
10 slot chassis will scale to 9+Tbps system bandwidth
18 slot chassis will scale to 15+Tbps system bandwidth
15+ Terabits per second platform bandwidth capacity
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 28 Cisco Expo 2008
Fabric Module
Provides 46Gbps per I/O
module slot
Also provides 23G per
supervisor slot
Up to 230Gbps per slot with 5
fabric modules
Initially shipping I/O modules
do not leverage full fabric
bandwidth
Load-sharing across all fabric
modules in chassis
Multilevel redundancy with
graceful performance degradation
Non-disruptive OIR
Blue beacon LED for easy
identification
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 29 Cisco Expo 2008
46Gbps 92Gbps 138Gbps 184Gbps 230Gbps
Fabric Capacity and Redundancy
Per-slot bandwidth capacity increases with each fabric module
1G module requires 2 fabrics for N+1 redundancy
10G module requires 3 fabrics for N+1 redundancy
4
th
and 5
th
fabric modules provide additional level of redundancy
Future modules will leverage additional fabric bandwidth
Fabric failure results in reduction of overall system bandwidth
Fabrics
Module
Slots
40G
1G Module
80G
10G Module
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 30 Cisco Expo 2008
Access to Fabric Bandwidth
Supervisor engine controls access to fabric bandwidth
using central arbitration
Fabric bandwidth represented by Virtual Output
Queues (VOQs)
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 32 Cisco Expo 2008
What Is VOQ?
Ingress module
Module 1
Module 2
(1G module)
Module 3
(10G module)
Module 4
(10G module)
VOQs for
Module 2
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
VOQs for
Module 3
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
VOQs for
Module 4
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
Egress modules
Fabric
module
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
Destination 1
Destination 2
Destination 3
Destination 4
Destination 5
Destination 6
Destination 7
Destination 8
Destination 1
Destination 2
Destination 3
Destination 4
Destination 5
Destination 6
Destination 7
Destination 8
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
Destination 1
Destination 2
Destination 3
Destination 4 0 1 2 3
0 1 2 3
0 1 2 3
0 1 2 3
Egress
Capacity
(ability to receive traffic
from fabric)
VOQ Buffers correspond
to Egress Capacity
(send traffic into fabric based
on destination)
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 33 Cisco Expo 2008
Centralized Fabric Arbitration
Access to fabric bandwidth on ingress module controlled
by central arbiter on supervisor
In other words, access to the VOQ for the destination across the fabric
Arbitration works on credit request/grant basis
Modules communicate egress fabric buffer availability to central arbiter
Modules request credits from supervisor to place packets in VOQ for
transmission to destination over fabric
Supervisor grants credits based on egress fabric buffer availability for
that destination
Arbiter discriminates among four classes of service
Priority traffic takes precedence over best-effort traffic across fabric
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 34 Cisco Expo 2008
Central
Arbiter
Module 2
Fabrics
VOQ Operation
Supervisor
Buffer
Credits
VOQ for
e2/1,3,5,7
VOQ for
e1/1,3,5,7
0 1 2 3
VOQ for
e3/1,3,5,7
0 1 2 3 0 1 2 3
Capacity
available!
Capacity
available!
Capacity
available!
Module 1 Module 3
0 1 2 3
Egress
Destination
Capacity
Egress
Destination
Capacity
0 1 2 3
Egress
Destination
Capacity
0 1 2 3
Egress modules have
capacity to receive traffic
from fabric
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 35 Cisco Expo 2008
Fabrics
VOQ Operation
Supervisor
Module 1 Module 2 Module 3
0 1 2 3
VOQ for
e3/1
0 1 2 3
Egress
Destination
Capacity
0 1 2 3
Egress
Destination
Capacity
0 1 2 3
VOQ for
e2/1
INGRESS MODULE EGRESS MODULES
VOQs on ingress module
correspond to capacity
on egress modules
Central
Arbiter
Buffer
Credits
VOQ for
e2/1,3,5,7
VOQ for
e1/1,3,5,7
0 1 2 3
VOQ for
e3/1,3,5,7
0 1 2 3 0 1 2 3
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 36 Cisco Expo 2008
Fabrics
VOQ Operation
Supervisor
Module 1 Module 2 Module 3
0 1 2 3
VOQ for
e3/1
Destined to
e3/1, priority
level 1
Request to
transmit to
e3/1, priority 1!
Request
granted!
0 1 2 3
Egress
Destination
Capacity
Buffer for VOQ
priority 1 now
available!
0 1 2 3
Egress
Destination
Capacity
0 1 2 3
VOQ for
e2/1
INGRESS MODULE EGRESS MODULES
Central
Arbiter
Buffer
Credits
VOQ for
e2/1,3,5,7
VOQ for
e1/1,3,5,7
0 1 2 3
VOQ for
e3/1,3,5,7
0 1 2 3 0 1 2 3
Deduct credit
from VOQ
priority 1
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 37 Cisco Expo 2008
Benefits of Central Arbitration and VOQ
Ensures fair access to bandwidth for multiple ingress
ports transmitting to one egress port
Prevents congested egress ports from blocking ingress
traffic destined to other ports
Priority traffic takes precedence over best-effort traffic
across fabric
Engineered to support Unified I/O
Can provide no-drop service across fabric for future FCoE
interfaces
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 40 Cisco Expo 2008
Agenda
Introduction
Nexus 7000 Chassis
Nexus 7000 Modules
Nexus 7000 Fabric & Bandwidth
NX-OS Overview
Data Center Network Manager
Data Center Network Design Evolution
Q & A
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 41 Cisco Expo 2008
NX-OS
SAN-OS
IOS
NX-OS: Purpose Built for the Data Center

Cisco
Nexus
Operational
Continuity
Infrastructure
Scalability
Transport
Flexibility
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 42 Cisco Expo 2008
NX-OS
Software
Architecture
Next-generation operating system that brings 3 fundamental technologies into a single platform:
Layer-2 classical (now) and unified I/O switching (future)
Layer-3 multi-protocol routing (now)
Storage protocols and SAN switching (future)
100% features for 80% of the customers
NX-OS is not all things to all people
But is state of the art for targeted environments
Design Philosophy
Invest in sophisticated software infrastructure so that multiple features can leverage it
Dealing with software complexity that is growing all the time
Focus on Serviceability
Provide comprehensive management that extends well beyond CLI using a Wizard-based GUI
Modularity is paramount
Layer-2 Protocols Storage Protocols Layer-3 Protocols
Interface Management
Chassis Management
Kernel
S
y
s
m
g
r
,

P
S
S

&

M
T
S
S
N
M
P
,

X
M
L
,

C
L
I

M
a
n
a
g
e
m
e
n
t
Chip/Driver Infrastructure
VLAN mgr
STP
OSPF
BGP
EIGRP
GLBP
HSRP
VRRP
VSANs
Zoning
FCIP
FSPF
IVR
UDLD
CDP
802.1X IGMP snp
LACP PIM CTS SNMP
Other Services
Future Services
Possibilities

Protocol Stack (IPv4 / IPv6 / L2)
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 43 Cisco Expo 2008
New NX-OS Feature Navigator
http://www.cisco.com/cdc_content_elements/flash/dataCenter/ciscofeaturenavigator/index.html
Available
NOW
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 44 Cisco Expo 2008
NX-OS Licensing
Simple, Flexible Licensing Model
There are three levels of enforced licensing: Base,
Enterprise Services, and Advanced Services
Grace periods facilitate feature testing and trials without
buying a license (for example, 120 days), with some
restrictions. The Cisco Trusted Security does not have a
grace period because of export restrictions on strong
cryptography
Advanced
Services
Enterprise
Services
Base
GRE PBR MSDP
ACLs TACACS+ NAC
Call
Home
Cisco
GOLD
EEM
Storm
control
UDLD
J umbo
Frames
802.1x IPSG DAI
DHCP
snooping
CoPP VRF lite VRRP GLBP HSRP
Cisco
Trusted
Security
VDCs
IGMP PIM-SSM
Bidirectio
nal PIM
PIM-SM
Graceful
Restart
BGP IS-IS EIGRP OSPF
RADIUS SNMP RBAC SSHv2
Port
Security
uRPF
check
DHCP
helper
IGMP
snooping
RIP/RIPng
QoS SPAN NetFlow PVLANs LACP 802.1Q MSTP+ PVRST+ ISSU
Note: Enterprise Services is NOT included with Advanced Services license
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 45 Cisco Expo 2008
Stateful Fault Recovery
Linux Kernel
B
G
P
O
S
P
F
P
I
M
T
C
P
/
U
D
P
I
P
v
6
S
T
P
H
S
R
P
L
A
C
P
e
t
c
HA Manager
Restart process!
If a fault occurs in a process
HA manager determines best recovery action (restart process,
switchover to redundant supervisor)
Process restarts with no impact on data plane
State checkpointing (PSS) allows instant, stateful process recovery
Software utilizes Graceful Restart where appropriate
Nexus Data Plane
PSS
NX-OS services checkpoint their
runtime state to the PSS for
recovery in the event of a failure
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 46 Cisco Expo 2008
Hardware FIB
Software RIB
Stateless Fault Recovery
Linux Kernel
B
G
P
O
S
P
F
P
I
M
T
C
P
/
U
D
P
I
P
v
6
S
T
P
H
S
R
P
L
A
C
P
e
t
c
HA Manager
Restart process!
Graceful restart Graceful restart
Routing updates Routing updates
If a fault occurs in a non checkpointing process (L3 routing):
Process restarts with no impact on data plane
Software utilizes Graceful Restart where appropriate (OSPF,
EIGRP, IS-IS, BGP)
Otherwise periodic updates (RIPv2, PIM, IGMP, MSDP, MLD)
Table
Update
Nexus Data Plane
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 47 Cisco Expo 2008
Release
4.0
Release
4.1
In-Service Software Upgrade
Linux Kernel
O
S
P
F
B
G
P
P
I
M
e
t
c
.
HA Manager
Nexus Data Plane
Linux Kernel
HA Manager
Active
I/O Module Images
Upgrade and reboot
Release
4.0
Release
4.1
O
S
P
F
B
G
P
P
I
M
e
t
c
.
Standby
Initiate stateful failover
Upgrade and reboot
Upgrade and reboot I/O modules
Nexus7k# install all kickstart bootdisk:4.1-kickstart system bootdisk:4.1-system
Nexus7k#
Release
4.0
Release
4.1
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 48 Cisco Expo 2008
Virtual Device Contexts (VDCs)
VDC Virtual Device Context
Flexible separation/distribution of
Software Components
Flexible separation/distribution of
Hardware Resources
Securely delineated
Administrative Contexts
Infrastructure
Layer-2 Protocols Layer-3 Protocols
VLAN mgr
STP
OSPF
BGP
EIGRP
GLBP
HSRP
VRRP
UDLD
CDP
802.1X IGMP sn.
LACP PIM CTS SNMP
RIB RIB
Protocol Stack (IPv4 / IPv6 / L2)
Layer-2 Protocols Layer-3 Protocols
VLAN mgr
STP
OSPF
BGP
EIGRP
GLBP
HSRP
VRRP
UDLD
CDP
802.1X IGMP sn.
LACP PIM CTS SNMP
RIB RIB
Protocol Stack (IPv4 / IPv6 / L2)
Kernel
VDC A
VDC B
VDC A
VDC A
VDC B
VDC B
VDC n
VDCs are not
The ability to run different OS levels
on the same box at the same time
based on a hypervisor model; there
is a single infrastructure layer that
handles h/wprogramming
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 50 Cisco Expo 2008
Virtual Device Contexts (VDCs)
Network Consolidation:
Multiple logical nets/single physical net
Maintain clear delineation between nets
Independent Topologies
Clear Management Boundaries
Fault Containment
Service Velocity:
In-line tests
Rapid deployment and rollback
e.g. Enable Utility Computing
Device Consolidation:
Logical Appliances
Multi-switch emulation
Pwr, Cooling & Real-Estate efficiencies
Physical network
islands are virtualized
onto common
datacenter networking
infrastructure
VDC
Extranet
VDC
Prod
VDC
DMZ
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 51 Cisco Expo 2008
Agenda
Introduction
Nexus 7000 Chassis
Nexus 7000 Modules
Nexus 7000 Fabric & Bandwidth
NX-OS Overview
Data Center Network Manager
Data Center Network Design Evolution
Q & A
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 52 Cisco Expo 2008
DCNM Solution Components
DCNM is a Client Server Solution
DCNM Server communicates with the NX-OS devices
DCNM Client communicates with the DCNM Server
NX-OS
Device(s)
DCNM
Server
DCNM
Client
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 53 Cisco Expo 2008
DCNM Discovery
Discovers NX-OS and Cisco IOS devices
Discovers adjacent devices if CDP enabled
Server collects extensive switch inventory and
configuration details. Based on the collected
information, DCNM Server builds a virtual network
model.
As part of discovery process, DCNM establishes an
SSH session with each NX-OS device managed by
DCNM and each Cisco IOS device discovered
SSH session is left in place after discovery. DCNM
relies on the SSH session to gather information at
regular intervals.
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 54 Cisco Expo 2008
DCNM Server Network Model
DCNM Server builds an intelligent Network data model that enables
the server to intelligently serve user requests.
NX-OS Devices
Network
DCNM
Server
DCNM Server
Network Data
Model
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 55 Cisco Expo 2008
Communications
DCNM Server connects to the NX-OS devices over SSH.
DCNM Client communicates to the DCNM server over J ava RMI.
No direct communication between DCNM Client and the Nexus
devices.
DCNM Server notifies DCNM Client of asynchronous events as
J MS messages.
Nexus
DCNM
Server
DCNM
Client
SSH
Java RMI
JMS
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 56 Cisco Expo 2008
Get Requests
Get requests are served by DCNM Server without having to retrieve
the information from the device(s).
NX-OS Device(s)
Network
DCNM
Server
Client
DCNM Server
Network Data
Model
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 57 Cisco Expo 2008
Set Requests
Set requests make changes to the device configuration. Request is first applied to
the DCNM Server network model to validate request.
Validation rules applied are the same as what NX-OS does to validate CLI
commands.
Request forwarded to device(s) only if validation is successful.
+
Change
Request
=
Yes
No
Client
DCNM
Server
NX-OS Device(s)
Network
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 58 Cisco Expo 2008
Feature
Selector
Feature
Filter
Selection Details
Associated
Features
Selection
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 59 Cisco Expo 2008
Agenda
Introduction
Nexus 7000 Chassis
Nexus 7000 Modules
Nexus 7000 Fabric & Bandwidth
NX-OS Overview
Data Center Network Manager
Data Center Network Design Evolution
Q & A
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 60 Cisco Expo 2008
DC Core
Unified Fabric Evolution (2007)
CBS 3100
Blade
Catalyst 49xx
Rack
Catalyst 6500
End-of-Row
Catalyst 49xx
Rack
CBS 3100
MDS 9124e
Blade
1GbE Server Access 1GbE and 4Gb FC Server Access
DC Access
Catalyst 6500
10GbE Core
Catalyst 6500
10GbE VSS Agg
DC Services
Catalyst 6500
10GbE VSS Agg
DC Services
MDS 9500
Storage
SAN A/B
DC Aggregation
Catalyst 6500
End-of-Row
Storage
IP+MPLS WAN
Agg Router
WAN
MDS 9500
Storage Core
Gigabit Ethernet
10 Gigabit Ethernet
10 Gigabit DCE
4Gb Fibre Channel
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 61 Cisco Expo 2008
DC Core
Unified Fabric Evolution (H1 2008)
CBS 3100
Blade
Catalyst 49xx
Rack
Catalyst 6500
End-of-Row
Catalyst 49xx
Rack
CBS 3100
MDS 9124e
Blade
10GbE and 4Gb FC Server Access
DC Access
Catalyst 6500
10GbE Core
Catalyst 6500
10GbE VSS Agg
DC Services
Catalyst 6500
10GbE VSS Agg
DC Services
MDS 9500
Storage
SAN A/B
DC Aggregation
Catalyst 6500
End-of-Row
Storage 1GbE Server Access
IP+MPLS WAN
Agg Router
WAN
MDS 9500
Storage Core
Nexus 7000
10GbE Core
Nexus 7000
10GbE Agg
Catalyst 6500
DC Services
Nexus 7000
End-of-Row
Gigabit Ethernet
10 Gigabit Ethernet
10 Gigabit DCE
4Gb Fibre Channel
Introduce Nexus 7000 In the Core
Introduce Nexus 7000 For 10GbE Server Access
Introduce Nexus 7000 in the Aggregation Layer
with Catalyst 6500 for DC Services
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 62 Cisco Expo 2008
DC Core
CBS 3100
Blade
Catalyst 49xx
Rack
Nexus 7000
End-of-Row
Gigabit Ethernet
10 Gigabit Ethernet
10 Gigabit DCE
4Gb Fibre Channel
Nexus 5000
Rack
DC Access
Nexus 7000
10GbE Agg
Catalyst 6500
DC Services
MDS 9500
Storage
Catalyst 6500
End-of-Row
Storage
IP+MPLS WAN
Agg Router
WAN
10GbE and 4Gb FC Server Access
CBS 3100
MDS 9124e
Blade
Catalyst 49xx
Rack
10GbE and 4Gb FC Server Access
10Gb FCoE Server Access
10 Gigabit FCoE/DCE
SAN A/B
MDS 9500
Storage Core
1GbE Server Access
Nexus 7000
10GbE Core
Unified Fabric Evolution (H2 2008)
Catalyst 6500
10GbE VSS Agg
DC Services
DC Aggregation
Introduce Nexus 5000 For Rack Server Access
and Server I/O Consolidation with FCoE
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 63 Cisco Expo 2008
DC Core
CBS 3100
Blade
Catalyst 49xx
Rack
Nexus 7000
End-of-Row
Nexus 5000
Rack
10Gb DCE Server Access
DC Access
MDS 9500
Storage
Catalyst 6500
End-of-Row
Storage
IP+MPLS WAN
Agg Router
WAN
MDS 9500
Storage Core
Gigabit Ethernet
10 Gigabit Ethernet
10 Gigabit DCE
4Gb Fibre Channel
Nexus 3000
Blade
CBS 3100
MDS 9124e
Blade
10 Gigabit FCoE/DCE
Catalyst 6500
10GbE VSS Agg
DC Services
Nexus 7000
10GbE Core
Unified Fabric Evolution (Summer 2009)
Nexus 7000
10GbE Agg
Catalyst 6500
DC Services
DC Aggregation
SAN A/B
1GbE Server Access
Introduce Nexus 3000 and Nexus 7000 DCE I/O Module
and Interconnect Access Layers to MDS with FCoE
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 64 Cisco Expo 2008
MDS 9500
Storage Core
DC Core
Unified Fabric Evolution (2H 2009)
CBS 3100
Blade
Catalyst 49xx
Rack
Nexus 5000
Rack
Nexus 3000
Blade
10Gb DCE Server Access
DC Access
MDS 9500
Storage
Catalyst 6500
End-of-Row
Storage
IP+MPLS WAN
Agg Router
WAN
Gigabit Ethernet
10 Gigabit Ethernet
10 Gigabit DCE
4Gb Fibre Channel
10 Gigabit FCoE/DCE
Nexus 7000
End-of-Row
SAN A/B
Nexus 7000
10GbE Core
Nexus 7000
10GbE Agg
Catalyst 6500
DC Services
Catalyst 6500
10GbE VSS Agg
DC Services
1GbE Server Access
DC Aggregation
Introduce Nexus 7000 DCE I/O Modules in Aggregation Layer
for Network-Wide Unified Fabric
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 65 Cisco Expo 2008
Q and A
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 66 Cisco Expo 2008
Please, complete
the evaluation
form for this
session.
Thank You !!!
2008 Cisco Systems, Inc. All rights reserved. Cisco Confidential 67 Cisco Expo 2008