Académique Documents
Professionnel Documents
Culture Documents
Objectives
Introduction to Troubleshooting
Methodology
Best Approach when
Troubleshooting the E-Series
Common Configuration
Oversights
Get used to Basic Troubleshooting
Tools
How to use and interpret them
to comfortably be able to
identify specific feature and
protocol messages using
show and debug
Troubleshooting Physical Layer
Issues
4-2
What is Troubleshooting?
A form of problem solving
Systematic search for a source of a problem
Use a process of elimination
Start with most probable possible cause and work your way back
Usually used in response to an event where something stopped working
Focus on what changed
Try not to jump to conclusions early
Only feasible if knowledge of the item is prevalent
Conceptual
What is it supposed to do?
Physical
Is it correctly set up?
What is it not doing?
How do you know it is a problem?
4-3
Methods of Troubleshooting
K.I.S.S. Keep it Short and Simple
Check all the basics
Physical
Substitute known good components for suspect ones
Logical
If you understand the theory of operation, go through a cognitive
walkthrough to try and trace the problem
Checklists
Systematic procedure that is made in response to most-likely human or
developmental flaws
4-4
4-7
4-8
Force10#ping 172.16.1.250
Type Ctrl-C to abort.
Sending 5, 100-byte ICMP Echos to 172.16.1.250, timeout is 2 seconds:
!!!!!
Success rate is 100.0 percent (5/5), round-trip min/avg/max = 0/0/0
(ms)
Force10#ping
Target IP address
: 172.16.1.250
Repeat Count [5]
:
Datagram size [100] :
Timeout in secs [2] :
Extended commands [n] : y
Source address or interface : 172.16.1.177
Type of service [0]
:
Set DF bit in IP header [n] :
Validate reply data [n] :
Data pattern [0xABCD]
:
Sweep range of sizes [n]:
Type Ctrl-C to abort.
Sending 5, 100-byte ICMP Echos to 172.16.1.250, timeout is 2 seconds:
!!!!!
Success rate is 100.0 percent (5/5), round-trip min/avg/max = 0/0/0
(ms)
4-9
Show Mac-Address-Table
Command used to view Layer-2 Bridging table
Force10#show mac-address-table
VlanId
Mac Address
Type
20 00:01:e8:0f:41:06
Dynamic
21 00:01:e8:0f:41:06
Dynamic
22 00:01:e8:0f:41:06
Dynamic
23 00:01:e8:0f:41:06
Dynamic
24 00:01:e8:0f:41:06
Dynamic
25 00:01:e8:0f:41:06
Dynamic
4-10
Interface
Po 31
Po 31
Po 31
Po 31
Po 31
Po 31
State
Active
Active
Active
Active
Active
Active
4-11
Force10#traceroute 172.16.1.205
Type Ctrl-C to abort.
-------------------------------------------------------------Tracing the route to 172.16.1.206 from 172.16.1.177, 30 hops
max, 40 byte packets
-------------------------------------------------------------TTL Hostname
Probe1
Probe2
Probe3
1 172.16.1.206
016.667 ms
*
000.000 ms
Force10#traceroute
Target IP address
Source IP address
Timeout in secs [5]
Probe count [3]
Minimum TTL [1]
Maximum TTL [30]
Port number [33434]
: 172.16.1.206
: 172.16.1.177
:
:
:
:
:
4-12
4-13
What It Means
Down
Up
Down
Up
Up
Down
4-14
Link Protocol
State
4-15
Show ARP
Shows which IP address are associated to a particular MAC address
and outgoing interface
Force10#show arp
Protocol
Address
Age(min) Hardware Address
Interface VLAN
CPU
-------------------------------------------------------------------------------Internet
10.10.43.3
75
00:01:e8:0f:40:9f
Gi 4/32
CP
Internet
10.10.43.4
00:01:e8:0f:1e:90
Gi 4/32
CP
Internet
10.10.94.4
00:01:e8:0f:1e:77
Gi 4/7
CP
Internet
10.10.94.9
59
00:00:07:c7:84:20
Gi 4/7
CP
Internet
10.11.130.252
1
00:01:e8:d5:c6:f5
Ma 0/0
CP
Internet
10.11.130.253
0
00:01:e8:d5:c6:0a
Ma 0/0
CP
Force10#
4-16
4-17
Duplex mismatch the collisions seen on the half-duplex side of the link are often
late collisions.
The full-duplex side usually will register FCS (frame check sequence) errors, or
runts.[2] Viewing this standard Ethernet statistic can help diagnose this problem.
A duplex mismatch can be fixed by either enabling autonegotiation (if available and
working) on both ends or by forcing the same settings on both ends
If there is no option but to have a locked setting on one end and autonegotiation the
other half duplex must be used.
4-18
4-19
4-20
4-21
Loss of Signal
Indicates that the interface has not detected the required number of digital bit transitions (from 1
to 0 and 0 to 1) on the incoming signal
A 10-Gigabit link must see a certain number of such transitions to ensure proper synchronization
Rx Signal Lock Error
Indicates a loss-of-timing condition. The receive clock must be recovered from the incoming data
stream to allow the receiving physical layer to synchronize with the incoming electrical pulses
PCS Link State
Displays the state of the Physical Coding Sublayer (PCS).
The value can be "Up" or "Down"
Link Fault Remote
Indicates that the remote device has detected a fault, is inhibiting the transmission of frames, and
is continuously transmitting idle messages
Link Fault Local
Indicates that the switch has detected a fault condition, is inhibiting the transmission of frames,
and is continuously transmitting remote fault signals
Link Fault - Idle Error
Indicates that the switch has detected a non-idle symbol during an idle period
Link Fault - Illegal Symbol
Indicates that the switch has detected an illegal symbol other than an error symbol while receiving
data frames
Link Fault - Error Symbol
Indicates that the switch has detected an error symbol while receiving data frames
4-23
4-24
4-25
Transceiver Troubleshooting
If the switch port is using a transceiver and reports Media type is unknown, you
may need to investigate a transceiver issue
Force10#show interface ten 0/0
TenGigabitEthernet 0/0 is up, line protocol is up
Hardware is Force10Eth, address is 00:01:e8:02:b7:8e
Pluggable media present, Media type is unknown
The show interfaces command with the transceiver keyword to display the serial
EEPROM of any installed transceivers on both 1-Gig (SFPs) and 10-Gig interfaces
(XFPs)
4-26
Default configuration of an
interface UNSET
4-27
Terminal Monitoring
Severity messages can be viewed on the terminal line
From Console it is enabled by default
It can be disabled
From Telnet/SSH it is disabled by default
It can be enabled
Force10#terminal monitor
Force10#conf
Force10(conf)#
Force10(conf)#Sep 28 18:19:16: %RPM0-P:CP %IFMGR-5-OSTATE_DN: Changed
interface state to down: Gi 3/42
Sep 28 18:19:25: %RPM0-P:CP %IFMGR-5-OSTATE_UP: Changed interface state
to up: Gi 3/42
Force10(conf)#ex
Sep 28 18:21:03: %RPM0-P:CP %SYS-5-CONFIG_I: Configured from console by
console
Force10#terminal no monitor
Force10#
4-28
Gi3/41
Gi4/31
Gi3/42
Gi4/32
Force10(conf)#Sep 28 18:19:16:
%RPM0-P:CP %IFMGR-5-OSTATE_DN:
Changed interface state to down: Gi
3/41
Force10(conf-if-gi-4/32)#shutdown
Force10(conf-if-gi-4/32)#Sep 28
18:33:51: %RPM0-P:CP %IFMGR-5OSTATE_DN: Changed interface state
to down: Gi 4/32
Force10(conf-if-gi-4/32)# no
shutdown
Force10(conf-if-gi-4/32)#Sep 28
18:34:01: %RPM0-P:CP %IFMGR-5OSTATE_UP: Changed interface state
to up: Gi 4/32
Miscabled!
4-29
4-30
Force10#debug ?
aaa
AAA debug information
arp
IP ARP debug information
call-home
Call-home debug information
fvrp
FVRP debugging commands
ip
IP debug information
ipv6
IPv6 debug information
isis
IS-IS debug information
lacp
LACP debugging commands
mac
MAC debugging commands
radius
RADIUS debug information
spanning-tree
Spanning tree debug information
vrrp
VRRP debug information
Force10#debug ip ?
bgp
BGP protocol transactions
dhcp
DHCP relay transactions
icmp
ICMP transactions
igmp
IGMP protocol transactions
msdp
MSDP protocol transactions
ospf
OSPF protocol transactions
packet
General IP transactions
Force10#debug ip ospf ?
event
OSPF protocol event
packet
OSPF protocol packet
spf
OSPF protocol shortest path
<cr>
Force10#
1.
Turn on a specific
debug filter
Force10#debug ip ospf
All OSPF debugging has been turned on
Force10#23:07:30 : OSPF(44444:00):
Rcv. v:2 t:1(HELLO) l:48 rid:10.10.93.3
aid:0 chk:0x8363 aut:0 auk: keyid:0
from:Gi 4/32
netmask:255.255.255.0 pri:1 N-, MC-,
E+, T-,
hi:10 di:40 dr:10.10.43.4
bdr:10.10.43.3
Nbr: 10.10.94.4
23:07:30 : OSPF(44444:00):
Xmt. v:2 t:1(HELLO) l:48 rid:10.10.94.4
aid:0 chk:0x8363 aut:0 auk: keyid:0 to:Gi
4/32
dst:224.0.0.5
netmask:255.255.255.0 pri:1 N-, MC-,
E+, T-,
hi:10 di:40 dr:10.10.43.4
bdr:10.10.43.3
Nbr: 10.10.93.3
23:07:40 : OSPF(44444:00):
Force10#undebug all
All possible debugging has been turned off
Force10#
4-31
3.
4.
5.
1
2
Force10#terminal monitor
Force10#debug ip packet gi 4/7 count 2
IP packet debugging is on for gigabitethernet 4/7
Force10#show debug
Generic IP:
IP packet debugging is on for (Count 5)
GigabitEthernet 4/7
Force10#22:05:57 : IP: s=10.10.94.4 (local), d=224.0.0.5 (Gi
4/7), len 64, sending proto=89
22:06:06 : IP: s=10.10.94.4 (local), d=224.0.0.5 (Gi 4/7), len
64, sending proto=89
Sep 28 18:00:21: %RPM0-P:RP1 %IPMGR-5DEBUG_IP_PACKET_COUNT_REACHED: ip debug count reached, ip
debugging turned off
Force10#show log
Syslog logging: enabled
Console logging: level debugging
Monitor logging: level debugging
Buffer logging: level debugging, 123 Messages Logged, Size
(40960 bytes)
Trap logging: level informational
Last logging buffer cleared: 22:33:21
Nbr: 10.10.93.3
hi:10 di:40 dr:10.10.43.4 bdr:10.10.43.3
netmask:255.255.255.0 pri:1 N-, MC-, E+, T-,
aid:0 chk:0x8363 aut:0 auk: keyid:0 to:Gi 4/32
dst:224.0.0.5
Force10#clear log
Clear logging buffer [confirm] yes
Force10#show log
Syslog logging: enabled
Console logging: level debugging
Monitor logging: level debugging
Buffer logging: level debugging, 0 Messages Logged, Size
(40960 bytes)
Trap logging: level informational
Last logging buffer cleared: 23:30:46
Going Forward
Feature and Protocol specific troubleshooting commands will be
presented in their respective modules
Understand how the protocol/feature works in order to best
interpret the show commands and debug output
Look at the running configuration and compare it with the working
examples in each chapter
In this class, errors will usually occur at the interface between the
keyboard and chair
4-33
Summary
Troubleshooting Methodology
involves a step-by-step approach
starting with the basics
Common Configuration
Oversights are common and
should be checked first
Basic Troubleshooting Tools can
help to solve the majority of
configuration related issues
Operational knowledge of the
feature or protocol will help map
the troubleshooting steps to be
taken
4-34