Presented to:

www.accuver.com
 VoLTE Solutions

Preamble

Thorough performance analysis What is possible

• Voice Quality/MOS
(POLQA)
• SIP protocol based
analysis : setup related
performance
• RTP/RTCP protocol based
LTE analysis : throughput,
jitter, delay, packet loss,
etc.
• KPI reports – drop, setup
failure, etc.
• LTE Metrics, RRC/NAS
protocol messages in
Codec Codec parallel
SIP RTP/RTCP RTP/RTCP SIP

TCP/IP TCP/IP

2
 VoLTE Solutions

Accuver VoLTE solutions

XCAL-Mobile XCAL-Solo XCAL-MPm XCAL-S+ XCAL-M

Handheld Yes Yes No No No

Voice MOS (POLQA) DL/UL DL/UL DL/UL DL/UL No
SIP Analysis Yes Yes Yes Yes Yes

RTP/RTCP Analysis Yes Yes Yes Yes Yes

RRC/NAS/LTE PHY Yes Yes Yes Yes Yes

User Interface Phone GUI Phone GUI PC PC PC

XCAL-M License
No No Yes Yes Yes
Required
2 (two S+
Number of Phone 1 1 4 4
required)
3
 VoLTE Solutions

Accuver VoLTE solutions

XCAL-Mobile
• VoLTE ready
• Smartphone based measurement solution
• Runs on Android (Galaxy S2,3,4, HTC One XL, etc.)
• Supports GSM/ GPRS/EDGE/ WCDMA/ HSDPA/
HSUPA/ HSPA+/DC-HSDPA/LTE and WiFi
• Auto call feature for VoLTE, Youtube, iPerf, etc.
• Indoor measurement

4
 VoLTE Solutions

Accuver VoLTE solutions

XCAL-Solo
• VoLTE ready
• Smartphone provides user
interface
• A micro PC with CPU, OS, phone
driver installed, SD memory,
Sound card, Bluetooth and WiFi
with Battery.
• XCAL-Solo software on the device
interfaces with Smartphone to
take LTE, VoLTE traces

5
 VoLTE Solutions

Accuver VoLTE solutions

XCAL-MPm
• VoLTE ready
• Connected to PC with XCAL-M installed
• 4 UE interface with 4 sound cards
embedded -> 4 simultaneous MOS
(POLQA) measurement configurable
• External power supply required to
XCAL-MPm hardware
• Existing XCAL-M license can be used as
it is with no additional upgrade cost
• Call control through Bluetooth available

6
 VoLTE Solutions

Accuver VoLTE solutions

XCAL-S+
• VoLTE ready
• Connected to PC with XCAL-M
installed
• One UE interface with one sound
card embedded
• Two XCAL-S+ can be connected to USB to Phone &
one XCAL-M license -> two MOS Audio Jack
(POLQA) measurement configurable
• Existing XCAL-M license can be
used as it is with no additional
upgrade cost

7
 VoLTE Solutions

Accuver VoLTE solutions

XCAL-M
• VoLTE ready
• RTP/SIP full analysis available
• Suitable for typical VoLTE performance
measurement where no voice MOS (POLQA) is
required
• Four VoLTE calls can be traced at the same time
• Call control through ADB interface

8
 VoLTE Solutions

RTP Analysis

RTP Metrics Available Metrics

• Packet Loss : The number of lost packets.

• RTP Throughput
• Delay : Interval between received RTP packets
• Delta Delay : Average Trend of dynamic change
of Delay of RTP Packet
• Jitter Delay : Jitter on Packet Delay
• One Way Delay : Time Delay from Sender part
to Receiver Part
• RTP Packet Count : Total Packet count received.
• Round Trip Time : Round Trip Time of sender
packet
• R-Factor : An Audio Quality based on VoIP
(VoLTE) Packet.
• MOS mapped based on R-Factor : Conversion
Value of R-Factor on General PESQ MOS
Mapping Table.

9
 VoLTE Solutions

Voice MOS (POLQA) measurement

XCAL-Mobile, Solo,
S+, MPm
• Sends audio
• POLQA is ITU-T.863 recommended voice samples
MOS algorithm
• Calculates voice objective MOS values by • Calculates downlink
comparing received audio waves with the MOS and other
reference waves POLQA
measurements

EUTRAN
Ethernet
/IMS

XCAL-Mobile,Solo,S+,MPm ICG (Internet Call Generator)

• Sends audio samples • Compatible with IMS
• Calculates downlink MOS and • Sends audio samples
other POLQA measurements • Calculates uplink MOS and other
POLQA measurements
10
VoLTE Call Flow & Event Definition

VoLTE Call Flow &

Event Definition

VoLTE Call Flow

VoLTE Call Event Definition
SIP Status Code

VoLTE Event – RTP Drop

11
 VoLTE Call Flow

VoLTE Call Flow : Outgoing Call (MO)

UE(MO) EUTRAN / IMS UE(MT)

Idle start Idle start

Setup start Dialing Start

INVITE
Call start
Service request

Rrc Connection Reqeust

Rrc Connection setup

Rrc connection setup complete

Security Mode Command

Security Mode Complete

Rrc connection reconfiguration

Rrc connection reconfig. comp

100 Trying Paging

12
 VoLTE Call Flow

VoLTE Call Flow : Incoming Call (MT)

UE(MO) EUTRAN / IMS UE(MT)

Paging

Service request

Rrc Connection Reqeust

Rrc Connection setup

Rrc connection setup complete

Security Mode Command

Security Mode Complete

Rrc Connection reconfiguration

Rrc Connection reconfig. comp

INVITE
Setup start
180 Ring

180 Ring Send Pick up

13
 VoLTE Call Flow

VoLTE Call Flow : Answer (MO/MT)

UE(MO) EUTRAN / IMS UE(MT)

200 OK
Pick Up
200 OK for INVITE

ACK
ACK

Rrc Connection reconfig.

Rrc Connection reconfig.
Dedicated bearer context req(QCI1)
Dedicated bearer context req(QCI1)
Rrc Connection reconfig. Comp.
Rrc Connection reconfig. Comp.
Dedicated bearer context accept
Dedicated bearer context accept
Ulinformation Transfer
Ulinformation Transfer

Traffic start
RTP(Voice or Video)

14
 VoLTE Call Flow

VoLTE Call Flow : Answer (MO/MT)

UE(MO) EUTRAN / IMS UE(MT)

200 OK
Pick Up
200 OK for INVITE

ACK
ACK

Rrc Connection reconfig.

Rrc Connection reconfig.
Dedicated bearer context req(QCI1)
Dedicated bearer context req(QCI1)
Rrc Connection reconfig. Comp.
Rrc Connection reconfig. Comp.
Dedicated bearer context accept
Dedicated bearer context accept
Ulinformation Transfer
Ulinformation Transfer

Traffic start
RTP(Voice or Video)
BYE
BYE

200 OK
200 OK

15
 VoLTE Call Events

VoLTE Call Events

VoLTE Events Notes

1 Idle No ‘Rx INVITE’ from MT

• MO : When Request URI of Tx INVITE is different from MIN

Dial error
• MT : When Tx INVITE exists after Rx INVITE

2 Error Setup MO : no Tx INVITE even though SEND was sent

No Traffic MT : no Tx 200 OK even though SEND was sent after 180 RING

3 Setup fail – timeout
4 Call Drop
5 RTP Drop – BYE
6 RTP Drop – Time out
Not the cases above but Setup timer is expired : SIM Resppomse code
shall be indicated (4##, 6##)
When there are no Rx IP Packets during the Dormant time duration
after the following L3/NAS messages
 LTE- RRC Connection Reestablishment Request
 LTE- RRC Connection Reestablishment Reject
 LTE- RRC Connection Reject
 LTE- EPS MM Tracking area update reject
 LTE- EPS MM Authentication reject
 LTE- EPS MM Authentication failure
 LTE- EPS MM Security mode reject
 LTE- EPS SM Reject
BYE Method occurs during Traffic status
No Rx RTP Packets during the predefined time duration

16
 VoLTE Call Flow & Event Definition

SIP Status Codes

Six Classes of SIP Status-Codes <Picked major status codes only below>

1xx (Informational)
180 Ringing
183 Progress
2xx (Success)
200 OK – requested successful
3xx (Redirection)
302 Moved Temporarily – location update of the user
4xx (Client Error)
400 Bad Request - wrong Syntax indicator
401 Unauthorized – user authentication indicator
480 Temporarily not available
486 Busy Here
5xx (Server Error)
500 Internal Server Error
501 Not Implemented
6xx (Global Failure)
603 Decline
606 Not Acceptable

17
 VoLTE Call Flow & Event Definition

RTP Drop & Air Drop

Reason Table
• RTP Drop – BYE : BYE Method occurs during the traffic status
• RTP Drop – Time out : Rx RTP does not exist during the traffic status
• Call Drop – Air interface Drop

XCAP-M indicates the Reason codes

18
VoLTE Call Statistics

VoLTE Call Statistics

SIP Column

SIP Setup Time Examples

Sig setup time Examples

RTP Analysis Examples

HO DATA Interruption Time

19
 VoLTE Call Statistics

VoLTE/VT LTE Call Statistics – SIP Analysis Columns

SIP Analysis Columns

• SIP Setup Time(Invite)
• SIP Setup Time(100Trying)
• SIP Setup Time(180Ringing)
• SIP Setup Time(200OK)
• SIP Setup Time(1st Rx Packet)
• LTE RRC Setup Time
• LTE QoS Setup Time
• Paging Ind(LTE)
• LTE QoS Setup Try Ind(LTE)
• IP Address

XCAP-M gives SIP Analysis result for each call

20
 VoLTE Call Statistics
SIP Setup Times
SIP Setup Time
SIP Setup Time(Invite)
SIP Setup Time(100Trying)
SIP Setup Time(180Ringing)
SIP Setup Time(Virtual 180Ringing)
SIP Setup Time(200OK)
SIP Setup Time(1st Rx Packet)
LTE RRC Setup Time
LTE QoS Setup Time
Paging Ind(LTE)
LTE QoS Setup Try Ind(LTE)
IP AddresIs
MO MT
x Paging ~ Invite
Invite ~ 100Trying Paging ~ 100Trying
Invite ~ 180Ringing(Real) Paging ~ 180Ringing(Real)
Invite ~ 180Ringing(Virtual) x
Invite ~ 200OK Paging ~ 200OK
Invite ~ Traffic Start Paging ~ Traffic Start
rrcConnectionRequest ~ rrcConnectionReconfigurationComplete
QCI 1,2(8) setup time (VoLTE is for QCI 1)
rrc connectionReconfiguration ~ Ul information Transfer
NAS Message(Activqte dedicated EPS bearer context request ~
Activqte dedicated EPS bearer context accept)
Indication information for its own Paging in case of MT
Indication for LTE QoS Setup attempt
IP address of SIP Connecting (its own)
21
 VoLTE Call Statistics

VoLTE/VT LTE Call Statistics – RTP Columns

RTP Columns
• Audio Packet Loss(Tx/Rx)
• Video Packet Loss(Tx/Rx)
• Audio Delta Delay
• Video Delta Delay
• Audio Jitter
• Video Jitter
• Audio One Way Delay(Min/Max/Avg)
• Video One Way Delay(Min/Max/Avg)
• HO Data Interruption Time(Tx/Rx
Audio)(Min/Max/Avg)
• HO Data Interruption Time(Tx/Rx
Video)(Min/Max/Avg)
• HO Audio Packet Loss(Rx)
• HO Video Packet Loss(Rx)
• Intra eNB HO Data Interruption Time(Tx/Rx
Audio)(Min/Max/Avg)

XCAP-M gives RTP Analysis result for each call

22
 VoLTE Call Statistics

VoLTE/VT LTE Call Statistics – RTP Columns

Packet Loss (Tx/Rx)

• Percentage of Packet Loss during the traffic time
𝑁𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝐿𝑜𝑠𝑡 𝑝𝑎𝑐𝑘𝑒𝑡𝑠
• Packet Loss =
𝑇𝑜𝑡𝑎𝑙 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑝𝑎𝑐𝑘𝑒𝑡𝑠

Delay (ms)
• D(i, j) = (Rj – Ri) – (Sj – Si) = (Rj – Sj) – (Ri – Si)

Delta Delay (ms)

• Delta Delay(t) = Delay(t) – Delay(t-1)

Audio/Video Jitter
• J = J + ( |D(i-1, i)| - J ) / 16

Sent regularly

Received irregularly
23
 VoLTE Call Statistics

VoLTE/VT LTE Call Statistics – RTP Column

HO Data Interruption Time (Tx/Rx)

Time difference between the packets before and after the
handover. The detail algorithm to take this metrics is explained
in the next page.

24
V VoLTE Call Statistics

HO Data Interruption Time (Tx/Rx)

Takes maximum time difference between RTP
packets within the time window (currently
500ms before and after) centered on the RRC
Connection Reconfiguration Request message
(Handover attempt)

Intra LTE-HO Attempt

+ - 500ms

RTP HO Data Interruption Time Algorithm

25
RTP Analysis

RTP Analysis

HO DATA Interruption Time & Pack Loss

HO Audio/Video Packet Loss

Packet Loss

Throughput

Delay & Delta Delay

RTT & One Way Delay

26
 RTP Analysis

RTP – HO Data Interruption time

• Displays RTP HO Data Interruption Time for each Hand Over

Event
• Supports both Tx and Rx HO data interruption time.

27
 RTP Analysis

RTP - Delay

RTP Delay(ms) : average RTP Packet delay (ms)

D(i, j) = (Rj – Ri) – (Sj – Si) = (Rj – Sj) – (Ri – Si)

S(i) S(j)

Time = Timestamp / 16000

28
 RTP Analysis

RTP – Delta Delay & Jitter

T1
RTP1
R1
Delta Delay(ms) T2
• Average of RTP Packet Delay variations RTP2
T3
• Delta Delay(t) = Delay(t) – Delay(t-1) R2
RTP3
T4
R3
RTP4
T5
R4

RTP5

Jitter(ms) R5

• Distribution of RTP Packet Delays

• J = J(i-1) + ( |Delay(i)| - J(i-1) ) / 16

Same duration

Various delays

29
 RTP Analysis

RTP One Way Delay

RTT One Way Delay

• Defines based in SR (Sender
Report) and RR (Receiver
Report) in RTCP
• RTT = TS2 – TS1 – DLSR
• Assumes one way delay as
RTT/2
• RTCP occurs every 3 seconds
so compensates based on
Delta Delay

30
VoLTE Event Analysis

VoLTE Event Analysis

RTP Drop – Time out

RTP Drop – BYE

Bluetooth Call - Setup Fail

Bluetooth Call - Drop

Success - CBQ

31
 VoLTE Event Analysis

RTP Drop – Time Out

Setup Success

No Rx Packets for 10 seconds

32
 VoLTE Event Analysis

RTP Drop - BYE

Setup Success

BYE occurs in SIP Packet

33
RTP Drop - BYE

no wave

HO Point

34