IP Video Quality Testing

Oct 2008
 Agenda
•Video Networks
•IP Video QoS
•QoS and QoE mapping vs Network
Segments
•IPTV testing
•Trouble-shooting
•Noise Analysis
•Summary

2
 Service Delivery

ONT: Optical Network Terminal ONU: Optical Network Unit OLT: Optical Line Terminal
RG: Residential Gateway VOD: Video On Demand IAD: Integrated Access Device

3
 Triple Play Network/Service Challenges
Complex
Video Hub Network Environments
Signaling and require
Core Ntwk Service Assurance
Last Mile Systems
Cust Prem
Head
toEnd Media Gateways
minimize expensive dispatches
Mistakes here Signal  Customer Data
 Poor content  Mis-provisioning catastrophic degradation. Traffic victimizes
Head End Hub Office VoIP/Video
quality from creates
content provider. incorrectly VoD D/A Impulse noise
routed calls Misprovisioned Copper pair:  Misconfigured
 PCR Jitter from tributaries and imbalanced lines, Premise
encoder, splicer 
IPSignaling
MPLS/ routes Eth Aggr Bridge taps, etc. SplitterEquipment
POTS
or VOD source. translations
ATM Core and Network
incompatibilities. Routing/Link over Data applications RG  Firewalls
STB TV
 PID mappings or GbE GbE
utilization….poor don’t
GbE experience
LOCAL ADS  Inside wiring
TVtable DVB
data  Echo Canceller traffic engineering. these problems
DEMUX & CONTENT
RF
mappings from configurations
QT-600 QT-600 because
xDSLof TCP. Cat 3, Coax
PC
video source Poor circuit
QT-1100  IGMP and
QT-1100 routing…..creates
QT-1100 Voice and video  In-home
 Proper Trans- RTSP Latency excessive delays QT-200
experiences Networking,
coding issues because of HPNA, MoCA,
real-time nature. Wireless, BPL
HST-3000
15-20% of NetComplete 25% of 50% of
Problems 5-10% of Problems Problems Problems

4
 QoS and QoE mapping for Video Services
Video QoS
QoE Parameters
Video QoS parts
Picture: blocking,
V-MOS
blurring, edge distortion,
Content Quality Error Indicator Count visual noise
IP Packet Loss
Transport Quality IP Packet Jitter
Audio: Lip sync, drop
outs
RTP Packet Loss
Video Stream Quality
RTP Packet Jitter
Transaction Quality TCP Re-transmissions Pixelization, tiling
Continuity Error frame freezes, Blue
PCR Jitter screen
PSI Table Data (Error)
Service Provisioning
Service accessibility,
Note 1: requires IGMP Latency Channel Change
payload decode latency Pause, Play
analysis RTSP Latency
Latency

5
 IP Video Network Segment Test Focus-Broadcast

HE QoS Network Access Total QoS @

QoS QoS STB
Content Quality Local Content Content Quality
Insertion

Video Stream Video Stream Video Stream Video Stream

Quality Quality Quality Quality
Transport Transport Transport
Quality Quality Quality
PCR Jitter, PSI Transaction Transaction Transaction
Data, Error Ind, Quality Quality Quality
Compression –
GOP, Type of
Coder, Bit Rate,
PCR Jitter Packet IGMP Latency, PCR
Profile
Loss Packet, Jitter, PSI data, Error
Jitter Ind, BW, MPEG-TS Pkt
Loss, Jitter, Period,
Distance, Period Distance, MOS

6
 IP Video Network Segment Test Focus-VOD

Hub Office QoS Network Access Total QoS @

QoS QoS STB
Content Quality Content Quality
Video Stream Video Stream Video Stream Video Stream
Quality Quality Quality Quality
Transport Transport Transport
Quality Quality Quality
Transaction Transaction
Quality Quality

PCR Jitter, PSI RTSP (Trick) Latency,

Data, Compression PCR Jitter Packet
PCR Jitter, PSI data,,
(GOP, Type of Loss Packet Jitter
BW, MPEG-TS Pkt
Coder, Bit Rate, Loss, Jitter, Period,
Profiles), Trick Play Distance, Period Distance, MOS
Latency

7
 IP TV Installation
Test Set
 STB/Modem emulation
 IP Video QoS check
 Broadcast & VOD

MDF
Gathering Core
DSLAM Network Network
STB
(IP) (ATM, IP)
ATU-R

TV Program TV Program
IGMP signal
Broadcaster Providers

IP

Video
Local Service
Content Platform
Added

Network Specific Thresholds

8
 xDSL Verification

TE Replacement
xTU-C ISP
Replacement

ATM/IP
1
1
xTU-R DSLAM IP Routing
RAS
Replacement

 Focus on showing end service functionality

• Connectivity to the DSLAM
• Connectivity to ATM network
• Connectivity to IP network and beyond

9
 Video QoS – Network Specific Thresholds
Thresholds can be set in the
HST for Pass, Fail, Marginal
If Error Indicator count =
>0 then content problem
If all items = Pass, no further analysis necessary by field tech.
10
The QoS screen shows the critical
quality parameters for a video flow:
PCR jitter measures this key
parameter; if high the decoder can not
properly decode the video payload:
Pass < 100 mS
Latency is the IGMP latency, the time
to change channels for Broadcast
Video: time from IGMP request to Rx
of first video packet: <200 mS
Cont. Err is the analysis of video
Transport Stream packets which show
the Continuity Error indicator set
which = lost packet events: < 0.1%
 MPEG over Ethernet Transmission issues

1) Perfect Video Stream

Inter Frame delay OK
typically 2-4 ms
STB Buffer

Video rate  i.e 3 Mbps 3 Mbps

2) Stream with jitter or rate under run

Inter Frame delay to long
MPEG
Decoder
Buffer underflows
3) Stream with jitter and/or rate over run

Inter Frame delay to short

Buffer overflows
Drop Packet

Ethernet packet  contains up to 7 MPEG packets

MPEG packet  188 Bytes

11
 IP Video Testing

Critical Diagnostic Fault Conditions:

 Video impairments
– All channels?
– One channel?
 Time of day specific
– A pattern?
– Random throughout the
day?
 Temporal component
– Bursts?
– Randomly spaced?

12
 IP Video Testing
IP Fault Resolution: Step #1

 Video pixelizations
– All channels? = yes
• Lost packet events will be seen on
more than one stream
 Lost packets
– Analyze physical layer stats
• Ethernet I/F stats
• ATM stats
• DSL stats
– Sectionalization
• If no errors are seen at the
physical layer of both I/F ‘s, then
packet loss is up-stream of the
DSLAM

13
 IP Video Testing

IP Fault Resolution: Step #2

 Video pixelizations
– Physical layer problems? = yes
– Check DSL stats for errors
• If yes, impulse noise most likely cause, if noise
margin at least 6 dB.
• Review Bits/Tone graphs for notches
– Notches = Noise problems
– Check packet layer stats
• If CRC errors = loop noise problems
• If Length errors, but no CRC then may be network
QoS /Buffer over flow issues, not loop noise
problems
• If both most likely loop noise issues
Evaluate copper loop for narrow band and wide band
issues. Use temporal input to pinpoint sources.

14
 IP Video Testing
IP Fault Resolution: Step #2
 Video pixelizations
– Physical layer problems? = yes
– Check VDSL stats for errors
• FEC errors: Un-correctable FEC errors
• If yes, impulse noise most likely cause, if noise
margin at least 6 dB.
• Review Bits/Tone graphs for notches
– Notches = Noise problems
– Check Packet stats
– RTP Stats
– RFC 3357
– MDI
• If both most likely loop noise issues
Evaluate copper loop for narrow band and wide band
issues. Use temporal input to pinpoint sources.

15
 IP Video Testing
IP Fault Resolution: Step #3
 Video pixelizations
– All channels? = no
Yes
 Lost packets
– Analyze lost packet stats
• Typically none seen when trouble is one
ch.
 Analyze PCR jitter stats
• PCR jitter problems are typically source
issues:
– Head End trans-coding problems
– Local Ad insertion problems No
 Analyze PSI Error stats
– Typically a content issue
 Error Indicator Count
– Analyze count
• Corrupted content leaving the encoder

16
 IP Video Testing
IP Fault Resolution: Step #3
 Analyze PCR jitter stats For each video program
stream the PID’s (Packet
• PCR jitter problems are Identifiers) are shown for
typically source issues: each piece: Video, Audio,
& PSI table data. The Type
– Head End trans-coding and Description data is
problems decoded from the stream
– Local Ad insertion as received. Unknown
data includes data not
problems included in the other
• Report PCR Jitter stats with categories such a Fill/PAD
data or data marked as
Time-of-Day, and Channel “reserved”.
or Program ID
 PSI table data analysis
– PAT and PMT data present
• Present
• Present at or above a
threshold rate, typically
every half second, but in
MSTV network usually only
every second or 1.5
seconds

17
 Impulse Noise Standards Definition

 VDSL is more susceptible to impulse noise events due to it’s use of a

wider frequency spectrum than ADSL. Noise sources are being
analyzed in several forms:
– REIN (Repetitive Electrical Impulse Noise)
• Less than 1 ms in duration
• No bit errors desired
• INP mitigation
– PEIN (Prolonged Electrical Impulse Noise)
• 1 to 10 ms in duration
• No bit errors desired
• INP mitigation
– SHINE (Single Isolated Impulse Noise Event)
• Duration greater than 10 ms
• Due to duration, bit errors will typically occur
• No loss of sync is desired

18
 Impulse Noise Analysis
Sources of Impulse Noise
 Central heating/air - switch on/off
 A neighbour’s Jacuzzi (Motor) 00:00:06 5

 Television sets 15
 Video recorders Impulse count with 3dB
below and above
 PC scanner threshold
15

 Faulty street lights.

Proper Filter
 Faulty Metal Halide lighting
 Faulty fluorescent lighting
 External Hi/Lo Security Lights
 External low voltage lights
 Seasonal Lights Event capture

 Satellite Receiver
 AC Power faults near copper loops

19
 Spectral Noise Analysis

Wider VDSL spectrum

Up to 5 MHz opens loop to new
noise sources

Max Hold shows

Up to 15 MHz transient peak values

Up to 30 MHz

Spectral noise analysis down to -145 dBm/Hz

20
HPNA/VDSL in Home – VDSL2/Cu Noise/TDR
HST as a troubleshooting tool
 HST connects to TWP or Coax, HPNA or VDSL
 Syncs to VDSL2, monitors copper, TDR analysis
 Monitors 0-30MHz spectral analysis: Transient and Impulse noise
0-30MHz
 Interactive or long term monitoring
Copper
Noise

CPE

VDSL2
Sync
Analysis

STB HST-3000
TWP
SAI
VDSL

Coax
Splitter Adapt
IP DSLAM

B-Box / SAI

21
 IP Video Testing
IP Fault Resolution: Step #4
MDF
Gathering Core
DSLAM Network Network
STB
(IP) (ATM, IP)
ATU-R

IGMP signal
 Excessive IGMP Latency
– All channels? = no IP
• Report as program source issue
– All channels? = yes
– Analyze time of day issues
• Random or a pattern
• Report issues Multi-cast
– Review: Platform
» Review IGMP snooping hierarchy
» Review traffic loading, special event issues
» Multi-cast flows, are all channels available at
DSLAM
» Temporal caching plan impacts

22
 Video QoS – Packet Loss Correlation
IP Fault Resolution: Step #5

The Pkt Loss screen shows the status

of the physical layer:
ATM and DSL layer measures provide
insight into the ADSL loop
performance: Errors here indicate
packet loss may be due to loop
problems.
If no errors are seen on the access
loop, then packet loss is North-bound
of the DSLAM (in the network).

If no errors, then problems are typically in the network.

23
 Video QoS Bandwidth & Pkt. Analysis
IP Fault Resolution: Step #6

Individual bit rates are shown

for each portion of the video
stream.

Unknown data defined as any

data, such as PAD bits to
maintain a constant data rate,
or private IP data over MPEG,
that is detected is also shown.

Packet stats parameters are

measured at the IP layer. IGMP
Latency is the measure of the
network components to complete
a program change, i.e. changing
the channel in Broadcast video.
24
 MOS Score Evaluation
IP Fault Resolution: Step #7

MOS score analysis for video and

audio portions:
Video factor is like audio R-Factor
showing a score built from
network elements of the factors
effecting the MOS score .
The same analysis is provided
for the audio portion of the
program.

25
 PID Map & Combined Stream Data
IP Fault Resolution: Step #8

Totals for up to 3 streams:

Combined total data rate for the
streams under analysis, in this
case 3.
Simultaneous analysis of
multiple streams is helpful in
locating problem sources.

26
 IPTV troubleshooting
Putting Physical Analysis Together
ADSL Example: Distribution
box Not twisted
Not shielded pair
DSLAM Street
MDF cabinet
ADSL2+
NID modem

1330 m 280 m 18 m

ADSL tests Passed Copper tests Failed

Copper tests Passed (impulsive noise, spectral)

ADSL tests Failed

(ADSL errors within UP stream)
Copper tests Failed
(impulsive noise, spectral)

27
 IP Video Testing Focus Summary
– Video Services (Broadcast & VOD ) Verification and Quality
analysis at the Video Packet Level and the Transport Stream
(RTP/IP) level
– Features:
• Service verification: Broadcast and VOD services
– GMP signaling emulation for Broadcast Video
– RTSP signaling emulation for VOD
• Video Transport Steam packet flow analysis
– Video QoS, PID map, PSI analysis,
– Packet Loss and Jitter and correlation with physical
layer quality
• Modes:
– Terminate: Res Gateway or STB emulation
– Monitor: Through or Ethernet Bridge
– Integration into Process Improvement programs
• Store and export results
• Standard and custom scripts

28
 Testing
. the Physical Medium is Not Enough

JDSU Application-Aware Solutions

TM

 Equip work force for IP service testing as well as circuit testing

 Minimize customer site visits with centralized fault location
 Meet customer due dates – get to revenue quickly
 Ensure IP service QoS metrics are met producing good QoE – reduce churn

Physical Layer Network Layer

Data Link Layer Application Layer

Signaling
IP
Voice Content
VoIP
ftp
Physical Medium Data IP HTTP
Video

VOD
IP

29