08-Troubleshooting of The Packet Feature of MSTP+ Products

INTERNAL
01/18/15
08-Troubleshooting of
the Packet Feature of
MSTP+ Products
MSTP Product Team, Network
Product Service Dept.
www.huawei.com
HUAWEI TECHNOLOGIES CO., LTD.
Huawei Confidential
Contents
Maintenance Methods for the MSTP+ Packet

Feature
Locating Faults of the MSTP+ Packet Feature
MSTP+ Data Collection
Precautions About the MSTP+ Maintenance
Huawei Confidential
Page 3
Layered Maintenance Structure

RNC
RNC
BSC
Physical layer: board/ETH port

OSN
3500
10GE
OSN
3500
Link layer: LAG
STM-X6/64
Tunnel layer: Tunnel/PW/MPLS APS

Convergence node
Service layer: ETH/SDH
STM-X/4
GE Ring
E1
FE
BTS
eB
Nod
OSN 1500
Metro1000
OSN 1500
Metro1000
FE
NodeB
E1
FE
BTS NodeB
Huawei Confidential
Page 4
Locating Method of Ethernet Faults
Maintenance Method of Physical Layer Faults
Maintenance Method of Link Layer Faults
Maintenance Method of Tunnel Layer Faults
Maintenance Method of Service Layer Faults
Huawei Confidential
Page 5
Board Indicator
Meaning
Working status
Service status
Activation status
Clock
synchronization
Program status
indication
Indicator
STAT
SRV
ACT/ACT
X/ACTC
SYNC
PROG
Color
Red/green/yellow
Red/green/yellow
Green
Red/green
Red/green
Status
Indication Suggestion
On (green)
The board is working normally.
On (red)
The board hardware is faulty.
Off
The board is not working, not created, or not powered on.
On (green)
The service is in normal condition and there is no alarm.
On (red)
A critical or major alarm is generated.
On (yellow)
A minor or remote alarm is generated.
Off
Services are not configured.
On (green)
Services are activated and the board works normally.
Off
In normal state, it means that services are unavailable.
100 ms on, 100 ms off

(green)
In protection system, it means the system database is backed

up in batches.
On (green)
The clock works normally.
On (red)
The clock source is lost or the clock source is switched.
On (green)
The upper layer software is initialized (when the board is

powered on or reset) or the software is working normally.
On (red)
The self-check of memory flash fails, loading the upper layer

software fails, or files are lost.
Off
N/A
100 ms on, and 100 ms off

(green)
The board is writing the FLASH or loading software (when the

board is powered on or reset).
300 ms on, and 300 ms off

(green)
The board is in the BIOS boot state (when the board is powered
on or reset).
100 ms on, 100 ms off (red)
The BOOTROM self-check fails (when the board is powered on

or reset).
Huawei Confidential
Page 6
Alarms Related to Hardware Faults

DBMS_ERROR
Database error
NB 1
ETH
MSTP+
HARD_BAD
Hardware fault
STM-X
MSTP+
GE/FE
NB2 MSTP+ ETH
TEMP_OVER
Working temperature
threshold crossing
SDH
SDH
STM-X
MSTP+
or ETH
RNC
or ETH
Core
network
MSTP+
GE
COMMUN_FAIL
Failure of communication
between boards
BD_STATUS
Board offline
MSTP+
RNC
Failure
Fault Causes:
Causes:
Components
(1)
The
Operations
ambient
communication
boardonis
ontemperature
the
not
theboard
installed.
database
chip
areisor
faulty.
excessively
fail.
(2)
component
The
(2) The
board
high.
database
is
socket
faulty.
(2) The
isis(2)
damaged.
loose.
cooling
Pin bending
(3)
equipment
(3)
The
The
communication
orboard
failure
is faulty.
is
(3)
faulty.
occurs.
between
The air
(3)
boards
filter
Theisbackplane
is
blocked.
faulty. (4)
bus
The
The
is board
sub-card
faulty.is faulty.
is not installed. (5) The sub-card socket is
loose.
Huawei Confidential
Page 7
GE/FE Port Fault

ETH_LOS
Loss of optical signal
NB 1
ETH
MSTP+
ETH_LINK_DOWN
Network port connection fault
MAC_FCS_EXC
Error code threshold
crossing
ETHDROP
Packet loss event
ETHCRCALI
Error packet loss
count
STM-X
MSTP+
GE/FE
NB2 MSTP+ ETH
SDH
SDH
STM-X
MSTP+
or ETH
RNC
or ETH
Core
network
MSTP+
GE
MSTP+
RNC
Fault Causes:
Packet
(1) Working
Bit
errors
loss
occurs
atcut.
the
MAC
due
to
layer
lack
cross
of(FCS)
resources.
thedifferent
threshold.
(2)
Signals
in the
line
are degraded.
There
Theare
fiber
frame
modes
is
check
(2)
of
the
The
sequence
two
optical
ends
module
are
errors
is faulty.
or and
alignment
(3)
this
The
causes
optical
errors
attenuation
(non-integer
negotiation
isbytes).
failure.
(3)
Performance
of connection,
fibers is degraded.
The optical
interface is not clean.
(2)
excessively
The
cable,
high.
fiber
or peer(4)
equipment
is faulty.
Huawei Confidential
Page 8
SDH Port Fault

R_LOS
Loss of optical signal
NB 1 ETH
MSTP+
R_LOC
Loss of clock
R_LOF
Loss of frame
GE/FE
ETH
AUPJCHIGH
AU pointer positive
justification
RSBBE
Regenerator
section error
STM-X
MSTP+
NB2
J0_MM
Trace identifier
mismatch
SDH
SDH
STM-X
MSTP+
or ETH
RNC
or ETH
MSTP+
Core
network
MSTP+
GE/FE
GE
NB3
ETH
MSTP+
MSTP+
RNC
Fault Causes:
B1
TheThe
byte
J0 byte
monitoring
to
transmitted
detects
error
from
codes.
the
opposite
end is
inconsistent
with
the
J0 byte
(1)
Clocks
fiber
received
attenuation
of
NEs
is be
on
cut.
signals
the
(2)
of
SDH
received
The
fail.
network
line
(2)
attenuation
signals
The
are
clock
is
not
excessively
extracting
is
synchronized.
excessively
module
high.
high.
(2)isThe
(3)
faulty.
The
signals
transmit
transmitted
of theto be
received
at
theislocal
end.
from
opposite
the opposite
end
faulty
end
and
contains
the line
notransmission
frame structure.
fails.
(3) Fault occurs in the receive
direction of the local station.
Huawei Confidential
Page 9
Port Loopback on the Physical Layer--Packet

Boards Supporting Loopback
OSN3500
MAC Layer
MAC Layer
PHY Layer
PHY Layer
Outloop
Inloop
Outloop
Inloop
N1PEX1
Not supported
Supported
Not supported
Supported
N1PEG16
Not supported
Supported
Not supported
Supported
N1PETF8
Supported
Not supported
Not supported
Supported
OSN1500
MAC Layer
MAC Layer
PHY Layer
PHY Layer
Outloop
Inloop
Outloop
Inloop
R1PEGS1
Supported
Not supported
Not supported
Supported
R1PEFS8
Supported
Not supported
Not supported
Supported
Q1PEGS2
Supported
Not supported
Not supported
Supported
Huawei Confidential
Page 10
Maintenance Method of Physical Layer

Faults
Huawei Confidential
Page 11
LAG Fault
LAG_MEMBER_DOWN
Member ports are
unavailable
NB 1
ETH
MSTP+
LAG_DOWN
LAG group
invalid
STM-X
MSTP+
GE/FE
NB2 MSTP+ ETH
SDH
SDH
STM-X
MSTP+
or ETH
RNC
or ETH
MSTP+
LAG
MSTP+
RNC
Fault Causes:
1.
The
The
number
port isofinactivated
the link down
members
or disable
in the state.
aggregation group is 0.
2. The port fails to receive the LCAP packets.
3. The port is in the half-duplex mode.
4. The port is in the self-loop state.
Huawei Confidential
Page 12
Core
network
Fault Locating Method--EFM Function
The ETH Link Layer OAM supports the fault discovering and fault
locating of the Ethernet link (FE and GE). Based on the 802.3AH,
the MSTP+1500&3500 supports the following functions:
Link discovering
Link monitoring
Remote fault indicating
Remote loopback
Note: Only the MSTP+ 3500 supports the EFM function.
Huawei Confidential
Page 13
Fault Locating Method--EFM Function

OAM Function
Description
Alarm and Action
Application
Scenario
Discovering
Detects whether the

peer equipment
supports the 802.3AH
OAM function.
When the protocol negotiation fails, an

alarm is reported to indicate the cause
of the failure.
Fault detecting
and fault locating
Detects the
performance status of
a link and informs the
remote end of the
status.
When the Ethernet interface OAM

function is enabled, the performance
events on the link are automatically
detected and reported, if any.
Errored Symbol Period Event
Errored Frame Event
Errored Frame Period Event
Errored Frame Seconds Summary
Event
Fault detection
Detects the critical

events on a link and
informs the remote end
of the events.
When the Ethernet interface OAM

function is enabled, the critical events
on the link are automatically detected
and reported, if any.
Link fault
Fault detection
Detects the bi-directional

continuity of the link and
then loops back all data
packets of the remote port.
It is initiated manually; the remote port

reports a loopback status alarm.
Fault locating
Link monitoring
Critical link events
Remote loopback
Huawei Confidential
Page 14
Huawei Confidential
Page 15
MPLS OAM-Continuity Check (CC)
NB 1
MPLS_TUNNEL_
LOCV
ETH
GE/FE
MSTP+
SDH
GE/FE
NB2
ETH
GE
MSTP+
MPLS
MSTP+
RNC
or ETH
MSTP+
MSTP+
GE
MSTP+
Huawei Confidential
RNC
Page 16
Core
network
MPLS OAM-Mismatch
MPLS_TUNNEL_LOCV
NB 1
ETH
MSTP+
GE/FE
MSTP+
MPLS
ETH
MSTP+
RNC
MPLS
GE/FE
NB2
GE
MSTP+
MSTP+
GE
MSTP+
RNC
MPLS_TUNNEL_
MISMATCH
Huawei Confidential
Page 17
Core
network
MPLS OAM-Mismerge
NB 1
MPLS_TUNNEL_
MISMERGE
ETH
MSTP+
GE/FE
MSTP+
GE/FE
NB2
ETH
MPLS
MPLS
GE
MSTP+
RNC
MSTP+
GE/FE
MSTP+
GE
NB3
ETH
MSTP+
MSTP+
RNC
MPLS_TUNNEL_LOC
V
Huawei Confidential
Page 18
Core
network
MPLS OAM-BDI
MPLS_TUNNEL_BDI
MPLS_TUNNEL_LOCV
Bind the reverse tunnel

NB 1
ETH
GE/FE
Bind the reverse tunnel
MSTP+
MSTP+
GE/FE
NB2
ETH
MPLS
MPLS
GE
MSTP+
RNC
MSTP+
MSTP+
GE/FE
GE
NB3
ETH
MSTP+
MSTP+
Huawei Confidential
RNC
Page 19
Core
network
MPLS OAM-FDI
NB 1
MPLS_TUNNEL_FDI
ETH
GE/FE
MSTP+
GE
MSTP+
GE/FE
NB2
ETH
MPLS
MPLS
MSTP+
RNC
MSTP+
MSTP+
GE/FE
GE
NB3
ETH
MSTP+
MSTP+
Huawei Confidential
RNC
Page 20
Core
network
LSP Ping
NB 1 ETH
GE/FE
MSTP+
GE
MSTP+
GE/FE
NB2
ETH
MPLS
MPLS
MSTP+
RNC
MSTP+
MSTP+
GE/FE
GE
NB3
ETH
MSTP+
MSTP+
Huawei Confidential
RNC
Page 21
Core
network
LSP TraceRoute
NB 1 ETH
MSTP+
STM-X
STM-X
MSTP+
GE/FE
NB2
ETH
MSTP+
MPLS
MPLS
RNC
MSTP+
MSTP+
GE/FE
GE
NB3
ETH
MSTP+
MSTP+
Huawei Confidential
RNC
Page 22
Core
network
MPLS APS
ETH_APS_TYPE_
The protection types
1. The 1+1 or 1:1 modes configured at both ends are
MISMATCH
are inconsistent.
different.
2. The single-end or dual-end protection switching modes
configured at both ends are different.
3. The revertive or non-revertive modes configured at both
ends are different.
ETH_APS_PATH_M The APS working
1. The working and protection trails configured at both ends
ISMATCH
and protection trails
are inconsistent.
are inconsistent.
2. Some physical links are incorrectly connected.
ETH_APS_SWITC
The protection
1. The protection switching fails.
H_FAIL
switching fails.
ETH_APS_LOST
The APS frame is
1. The peer end is not configured with the protection function.
lost.
2. Services in the protection channel are interrupted.
Huawei Confidential
Page 23
Huawei Confidential
Page 24
ETH Service
Maintenance of the ETH service is mainly based on the ETH service

OAM, which is defined in the 802.1AH/Y.1731. The OAM
maintenance methods are as follows:
Continuity check (CC), which is used for the proactive continuity check
Loopback (LB), which is used for the on-demand continuity check
Link trace (LT), on-demand Ethernet link trace, which is used for locating the fault
Ethernet remote defect indication (RDI)
Note: Only the MSTP+ 3500 supports the ETH function.
Huawei Confidential
Page 25
ETH OAM(CC)
ETH_CFM_LOC
NB 1 ETH
MSTP+
STM-X
MSTP+
GE/FE
NB2
ETH
ETH
ETH
GE
MSTP+
RNC
MSTP+
GE/FE
NB3
MPLS
Core
network
MSTP+
STM-X
MSTP+
MSTP+
RNC
MEP
MD
Huawei Confidential
Page 26
ETH OAM(LB)
NB 1 ETH
MSTP+
STM-X
MSTP+
GE/FE
NB2
ETH
ETH
ETH
GE
MSTP+
RNC
MSTP+
GE/FE
NB3
MPLS
Core
network
MSTP+
STM-X
MSTP+
MSTP+
RNC
MEP
MD
Huawei Confidential
Page 27
ETH OAM(LT)
NB 1 ETH
STM-X
MSTP
+
MSTP
+
GE/FE
NB2
ETH
ETH
ETH
GE
MSTP
+
RNC
MSTP
+
GE/FE
NB3
MPLS
Core
network
MSTP
+
STM-X
MSTP
+
MSTP
+
RNC
MIP
MEP
MD
Huawei Confidential
Page 28
Contents
Maintenance Methods for the MSTP+

Packet Feature
Locating Faults of the MSTP+ Packet

Feature
Huawei Confidential
Page 29

Principles for the Fault Locating
To locate faults of the MSTP+ packet feature, you can follow the principle
of "external to internal, alarm to performance event, and bottom to top".
Thus, you can locate the faults step by step as planned based on the
alarms, performance events, loopback, ETH_OAM, and MPLS_OAM.
In addition, you can take other emergency measures (such as providing
protection links and switching services to protection links) to restore the
services in the shortest time possible.
There is no fixed method for fault locating, you can use the
previous methods flexibly based on your own experiences and
familiarity with these methods.
Huawei Confidential
Page 30

Layers for Fault Locating
External
Eth Service
External
PW
Physical port
FE/GE
Physical port
Tunnel
PE1
PE2
Tunnel
CE1
Interconnected
equipment
FE/GE
AC
Fibers or
cables on the
physical layer
Provider
Edge 1
Fibers or cables
on the physical
layer
CE2
Provider
Edge 2
Huawei Confidential
Fibers or
cables on
the physical
layer
Interconnected
equipment
Page 31
Contents

Packet Feature

Feature
Huawei Confidential
Page 32
Data Collection--Performance Statistics
Service-related performance statistics
SDH-related performance
ETH-related performance (RMON)
PW/Tunnel-related performance
Board-related performance events
CPU and memory flash usage
Board temperature
Huawei Confidential
Page 33
Data Collection--Performance Detection
The performance detection function is used to detect the end-to-end

virtual Ethernet connections or end-to-end performance of the tunnel.
Currently, the following performance detection are supported:
Packet loss ratio at the local and remote ends
Basic principles: At the two ends of an end-to-end connection, transmit

protocol packets that carry packets statistics or performance value
marked for receiving/transmitting to each other. After the protocol
packets are received, the packet loss ratio is calculated based on
specified algorithm.
Huawei Confidential
Page 34
Data Collection--Alarm Information

Collection
Collecting related
alarm information:
Huawei Confidential
Page 35
Data Collection--Log Record
GSCC (3500), XCS (3500), and CXLN (1500) boards:
All files in ofs1/log/ and ofs2/log/
All files in ofs2/log/ion/
Files of working and protection SCC, all files in /stdby/ofs1/log/, /stdby/ofs2/log/, and
stdby/ofs2/log/ion/
EG16 (3500), EX1 (3500), EGS2 (1500), EGS1 (1500), and EFS8 (1500)
boards:
All files in ofs1/log/
Note: Before the data collection, log in to the target NE through Navigator and run the
command :mon-backup-bb:bid (bid: ID of the SCC or board) to back up the black box.
Huawei Confidential
Page 36
Contents

Packet Feature
Feature
Precautions About the MSTP+
Maintenance
Huawei Confidential
Page 37
The MSTP+ does not support downloading data from the T2000. Therefore, for data
restoration, the database should be backed up and restored.
The MSTP+ does not support the pre-configuration.
The MSTP+ does not support the NE initiation.
Warm reset of the SCC of the MSTP+ can cause protection switching.
The LAG and MSTP protocols of packet services run on the SCC. When the warm
reset of the SCC occurs, if the protection switching is not performed, during the
reset, which lasts for minutes, the peer equipment considers the link to the local
equipment is down and deletes related links, which interrupts services. To solve
this problem, in the MSTP+ version, warm reset of the SCC triggers protection
switching.
The protection switching is triggered based on a software scheme; therefore, reset

of the SCC through pressing a button does not trigger protection switching.
Huawei Confidential
Page 38
Thank You
www.huawei.com

08-Troubleshooting of The Packet Feature of MSTP+ Products

Transféré par

Informations du document

Titre original

Copyright

Formats disponibles

Partager ce document

Partager ou intégrer le document

Options de partage

Avez-vous trouvé ce document utile ?

Ce contenu est-il inapproprié ?

Droits d'auteur :

Formats disponibles

08-Troubleshooting of The Packet Feature of MSTP+ Products

Transféré par

Droits d'auteur :

Formats disponibles

INTERNAL

HUAWEI TECHNOLOGIES CO., LTD.

Maintenance Methods for the MSTP+ Packet

Locating Faults of the MSTP+ Packet Feature

MSTP+ Data Collection

Precautions About the MSTP+ Maintenance

HUAWEI TECHNOLOGIES CO., LTD.

Layered Maintenance Structure

Physical layer: board/ETH port

Link layer: LAG

Tunnel layer: Tunnel/PW/MPLS APS

Service layer: ETH/SDH

HUAWEI TECHNOLOGIES CO., LTD.

Locating Method of Ethernet Faults

Maintenance Method of Physical Layer Faults

Maintenance Method of Link Layer Faults

Maintenance Method of Tunnel Layer Faults

Maintenance Method of Service Layer Faults

HUAWEI TECHNOLOGIES CO., LTD.

HUAWEI TECHNOLOGIES CO., LTD.

The board is working normally.

The board hardware is faulty.

The board is not working, not created, or not powered on.

The service is in normal condition and there is no alarm.

A critical or major alarm is generated.

A minor or remote alarm is generated.

Services are not configured.

Services are activated and the board works normally.

In normal state, it means that services are unavailable.

100 ms on, 100 ms off

In protection system, it means the system database is backed

The clock works normally.

The clock source is lost or the clock source is switched.

The upper layer software is initialized (when the board is

The self-check of memory flash fails, loading the upper layer

100 ms on, and 100 ms off

The board is writing the FLASH or loading software (when the

300 ms on, and 300 ms off

100 ms on, 100 ms off (red)

The BOOTROM self-check fails (when the board is powered on

Alarms Related to Hardware Faults

NB2 MSTP+ ETH

HUAWEI TECHNOLOGIES CO., LTD.

GE/FE Port Fault

NB2 MSTP+ ETH

HUAWEI TECHNOLOGIES CO., LTD.

SDH Port Fault

HUAWEI TECHNOLOGIES CO., LTD.

Port Loopback on the Physical Layer--Packet

HUAWEI TECHNOLOGIES CO., LTD.

Locating Method of Ethernet Faults

Maintenance Method of Physical Layer

Maintenance Method of Link Layer Faults

Maintenance Method of Tunnel Layer Faults

Maintenance Method of Service Layer Faults

HUAWEI TECHNOLOGIES CO., LTD.

NB2 MSTP+ ETH

Fault Locating Method--EFM Function

Remote fault indicating

Note: Only the MSTP+ 3500 supports the EFM function.

HUAWEI TECHNOLOGIES CO., LTD.

Fault Locating Method--EFM Function

Alarm and Action