QoS SIG Presentation Summary of QoS Requirements

Dr. Parag Pruthi NIKSUN Dr. Ashutosh Dutta NIKSUN

Date: September 27-29, 2011

Copyright 2010 GISFI. All Rights Reserved.

Objective
Develop QoS framework and requirements to support Service Oriented Network in rural environment
Network Characteristics Ad hoc type networks scattered groups of users Lossy links Fluctuating traffic demand Low bandwidth Network heterogeneity (e.g., LTE and WiFi) User mobility pattern (e.g., cell mobility, subnet mobility) Application characteristics Current Application Cellular voice, File transfer (e.g., non-real-time), SMS Future NGN Application Real-time streaming (e.g., IPTV) Interactive (e.g., VoIP) Delay sensitive Distance learning, conferencing, Mobile banking (Priority) Services need QoS reservation
GISFI

Slide 2

QoE Metrics
QoE => Perceived Quality of Service Network Metrics
Bit rate, delay, jitter, packet loss rate Power consumption

Application Metrics
Call setup delay Failed calls, dropped calls, retransmission MOS (Mean Opinion Score)

Several standards groups

ITU-T SG12 ITU X.902 (IP Telephony) IETF IPPM, DIFFSERV 3GPP 3GPP TS 32.409 (IMS performance)
GISFI

Slide 3

QoS in a Service Oriented Network

DNS/E NUM S-CSCF HSS S-CSCF

Invite OK ACK RTP diameter

P-CSCF

P-CSCF

GETSApplication Server

SIP DNS

I-CSCF

Monitoring Agent
Network/ Application Feedback

PCRF

IMS

PCRF

Layer 3 control IMS-layer control

Layer 2 control

Multi-layer SON Controller

Managed IP (Multi-Provider Network)

(EPC)
GW

GW

GETS Call

Wireline Access Cable DSL Fiber Ethernet

RAN

Caller (UE1)

IP CAN

Wireless Access UMTS EvDO WiMAX LTE Satellite 4

RAN

Wireless Access UMTS EvDO WiMAX LTE Satellite

RAN RAN

IP CAN

Called (UE2)

Wireline Access Cable DSL Fiber Ethernet

KPIs (AirTel Presentation)

Performance Standards
Terminal, Customer Service, Tarriff, application contents KPIs, KQI (Key Quality Indicators) Data Performance, KPI, KQI, SLA

Operator control, non-operator control Availability, Retainability, Accessibility, Integrity, Mobility IRAT success rate Global Metrics
GISFI

Slide 5

3G KPI/KQI benchmarking
Call setup time Call setup success rate Call completion success rate MOS Retainability Accessibility Latency Jitter Throughput
GISFI

Slide 6

3G Services
FTP, Context, Performance benchmarking

GISFI

Slide 7

QoE Requirements
QoE is driven by measurements Which layer, which application, how often Require Multi-timescale Measurements Require Multi-Layer Measurements Network layer, application layer Require Session-based Measurements E.g., SIP-based multimedia application Require DPI for Application Classification Classification and Marking Policing and Markdown Queuing and Dropping
GISFI

Slide 8

QoE Requirements
Require mechanisms to provide priority services for signaling and transport of voice services in case of emergency.
e.g., SIP signaling for VoIP use Resource Priority Header (RPH) e.g., Diffserv mechanisms to take care of associated media (e.g., RTP) traffic.

QoS measurements should consider KPIs at several layers including

Data link Layer MAC layer retransmission Network Layer - thruput, goodput, network delay, network retransmission, utilization, packet loss, jitter Transport Layer - TCP connections and RTT Application layers Set up delay, dropped calls, failed calls, retransmission of INVITEs
GISFI

Slide 9

QoE Requirements
Future NGN application requires cross-layer feedback in order to provide desired QoS during handover and due to bandwidth fluctuation IEEE 802.21 Interoperability with Mobility protocols SIP, Mobile IP, Mobile IPv6 Tightly coupled or loosely coupled Require correlation between signaling and media
(e.g., EPC and IMS)

Require Open API to dynamically control the network element in the network
GISFI

Slide 10

KPIs for RTP

KPIs for RTP

Type of KPIs Performance Performance Performance Performance Performance Performance Performance Performance Perfromance Performance KPIs Mos Jitter packetDelay packetLoss dataVolume releaseCauseCode cdrTable faxTable rasTable callVolumeLeaders Remarks Average MOS score for all VoIP calls on the network Average Jitter for all VoIP calls on the network Average Packet Delay for all VoIP calls on the network Average Packet Loss for all VoIP calls on the network Total of all VoIP data traffic on the network Release Cause Code distribution for all VoIP calls List of VoIP CDRs for a given period of time List of Fax(T.38) Records for a given period of time List of RAS Records for a given period of time Top N VoIP Call volume leaders

KPIs for RTP (cont.)

Type of KPIs
Performance Performance Security Security Security Performance

KPIs
callDistribution networkVolume Abnormally Terminated Calls

Remarks
Total of all VoIP calls per given time period Total of all data traffic on the network Total of Abnormally Terminated Calls per time period

Initiated vs. Rejected Total of Initiated vs. Rejected calls per time period Calls Codec Distribution Total Duration Time List of all codecs utilized by VoIP calls Total aggregated Call Duration Time of VoIP Calls per given time period The number of simultaneous calls on the network Total aggregated Setup Time per given time period Error Distribution for VoIP calls Top N VoIP protocols on the network, i.e. SIP, H.323, MGCP/NCS, MEGACO, SCCP, T.38, etc.

Performance Performance Security Performance

Simultaneous Calls Total Setup Time errorDist TopApps

KPIs RTP (contd.)

Type of KPIs
Performance Performance Security Security Performance

KPIs
mediaStream faxStream bounceFlow packetTree callMos

Remarks
List of media streams utilized by a VoIP session List of media streams utilized by a Fax(T.38) session Message Flow(bounce diagram contents) for a given VoIP session List of all packets in the context of a VoIP session Average MOS score for a given VoIP session

Performance

callJitter

Average Jitter for a given VoIP session

Performance

callPacket Delay callPacket Loss

Average Packet Delay for a given VoIP session

Performance

Average Packet Loss for a given VoIP session

KPIs for IMS

KPI NAMES List of all SIP methods Aggregate IMS signaling packets

DESCRIPTION SIP message flows with same Call-ID Sums all the methods and responses.

LOGICAL FORMULA Shows the list all SIP messages. Ratio of total count and all IMS messages Sum of all SIP Registers from all UE to PCSCF

WHY INTERFAC INTERESTING? E Basic functionality for session view. Dos Attack Gm

Gm

Aggregate total Total number of attempted initial registrations registration b/w UEs and PCSCF Aggregate successful initial registration b/w UE & CSCF Count the successful registrations of UEs.

System Load indication, VZW Req, Dos Attack

Gm

Count 200 Ok in response to Register from PCSCF.

Informative

Gm

Aggregate failed initial authenticatio n b/w UE & CSCF Aggregate failed initial registration b/w UE & CSCF Mean IMS initial registration set-up time Aggregate unauthenticat ed initial registration b/w UE & PCSCF

Count the number of failed authenticatio n of UEs. Count the number of failed registrations of UEs. Time taken between register and 200 OK Identify the unauthenticat ed registrations

Count SIP 401 errors from PCSCF in response to Register from PCSCF. Count SIP 4XX (except 401) errors from PCSCF in response to Register. Total time of getting an response after the registration request is sent. Count Registers without nonces that get 200(2XX) responses without 401(4XX) challenges.

Password guessing attack

Gm

Informative

Gm

System Gm Performanc e indication Security Gm risk, allows impersonati on attack, VZW req.

Aggregate total attempted reregistration between UE & P-CSCF Aggregate successful reregistration between UE & P-CSCF Aggregate Failed reregistration between UE & P-CSCF Mean IMS reregistration setup time.

Registers with previously seen Call-IDs.

Counts the total number of reregistered IDs.

System Load Indication

Gm

Registers with previously seen Call-IDs.

Counts the total number of 200 Oks to

Informative

Gm

SIP 4xx errors in response to registration request. Time to set-up the registration

Count SIP 4XX errors

Password guessing attack

Gm

Time between register and 200 OK

System performance indication

Gm

Aggregate Failed re-authentication between UE & PCSCF Aggregate unauthenticated re-registration between UE & PCSCF Aggregate successful deregistration between UE & PCSCF Aggregate Failed de-registration between UE &PCSCF

Calculate the failed number of reauthentication. Total number of unauthenticated registrations.

Count SIP 401 errors in response to Register Count re-register msgs without nonces that get 200 without 401 challenges Count Register with expiry==0 or contact: expiry==0

Total unauthenticated REGs Security risk, allows impersonation attack System load indication

Gm

Gm

Successful deregistrations.

Gm

All the failed deregistration.

Count SIP 4XX errors in response to above register.

Informative

Gm

Aggregate total attempted deregistration b/w UE & PCSCF Mean IMS deregistration time Aggregate failed authentication for de-registration Aggregate unauthenticated de-registration Attempted session establishments

Total of attempted deregistration Mean of deregistration time Total number of failed authentication de-registrations Total number of unauthenticated de-registration How many attempts have been made to establish the session.

SIP

Password guessing attack

Gm

Mean of the time.

System performance indication Total unauthenticated REGs

Gm

Count SIP 401 errors in response to register Count de register msgs with 200 and without 401 challenges. #initial Invite sessions with #INV==1

Gm

Security risk, allows Gm impersonation

System load indication, VZW req.

Gm

Successful session establishments Answered session establishment

Tracking all successful sessions we have. Tracking all successful answered sessions we have. All the failed session establishments. Time taken to have a success in establishment. Number of attempts to have re-established session

Count #180 ringing, not #200 OK, when #INV==1

System load indication

Gm

Count #2XX System load ringing, should be indication 200 but 2XX is fine when #INV==1 Count 4XX messages Time b/w INVITE and 180 response. #INVITE where a 180 has already been seen, or #INV > 1 System performance indication System performance indication System tuning aid

Gm

Failed session establishments Mean time for successful session establishment Attempted session re-establishment.

Gm

Gm

Gm

Aggregate session deestablishments Number of attempted subscription procedures Number of successful subscription procedures Number of failed subscription procedures Number of unauthenticated subscribers

Total deestablishments.

Count BYEs.

Security risk, allows impersonation attack, VZW req. System load indication, VZW Req. System performance indication System performance indication

Gm

Number of attempted procedures requests. Number of successful procedures for subscription. Number of failed subscription procedures Total number of unauthenticated subscribers

PCSCF receives a SIP subscribe

Gm

PCSCF sends a 200 OK

Gm

PCSCF send a 4XX

Gm

Number of subscribers without 401 challenges.

Security risk, allows Gm impersonation attack, VZW req.

Number of emitted notify procedures Number of successful notify procedures Number of failed notify procedures Number of unauthenticated Notifys Number of spoofed notify procedures

Total count of SIP notify messages. Total count of SIP notify messages with OK response. Total count of SIP notify messages. Total count of SIP notify messages. Total count of Spoofed notify messages.

PCSCF sends a SIP Notify PCSCF receives a SIP 200 OK

System load indication, VZW req. System load indication.

Gm

Gm

PCSCF receives a SIP 4XX Number of Notify without a 401 Challenge Count notifys from src!=PCSCF

System performance indication.

Gm

Security risk, allows Gm impersonation attack, VZW req. System load indication, VZW req. Gm

Attempted immediate Messaging procedures Successful immediate Messaging procedures Failed immediate Messaging procedures Number of unauthenticated messages NAIs of top 5 originators of IMS signaling traffic

Procedures attempted to have immediate messaging. Successful procedures attempted to have immediate messaging. Failed procedures attempted to have immediate messaging. Number of all unauthenticated messages . Display associated packets, bytes, exclude CSCF as originator.

PCSCF System load receives a indication SIP message PCSCF sends a SIP 200 OK message System load indication

Gm

Gm

PCSCF System load sends a SIP indication 4XX message in response Messages without 401 challenges From: and #bytes Security risk , allows impersonation attack System load indication, Dos attack

Gm

Gm

Gm

NAIs of top 5 receivers of IMS signaling traffic NAIs of top 5 senders of Instant messages NAIs of top 5 receivers of 4XX errors Top 5 visited n/w IDs in IMS signaling traffic Top 5 access n/w Infos in IMS signaling traffic

Display associated packets, bytes, exclude CSCF as receiver. Display associated packets, bytes, exclude CSCF as originator. Display associated packets, bytes, exclude CSCF as receiver. Display associated packets and bytes Display associated packets and bytes

To: and #bytes

System load indication

Gm

#bytes

System load indication, Dos attack System load indication

Gm

#bytes

Gm

#bytes

System load indication System load indication

Gm

#bytes

Gm

Top 5 sender domains in IMS signaling traffic Receiver domains in IMS signaling traffic NAI of top 5 originators of register request

Display associated packets and bytes Display associated packets and bytes Display associated packets ,bytes exclude CSCF as originator(PCSCF callee) Display associated packets ,bytes exclude CSCF as originator Display associated packets ,bytes exclude CSCF as originator(DUP)

#bytes

System load indication System load indication System load indication

Gm

#bytes

Gm

#bytes

Gm

NAI of top 5 originators of INVITE request NAI of top 5 originators of INSTANT message request

#bytes

System load indication

Gm

#bytes

System load indication

Gm

NAI of top 5 originators of subscribe requests IP Addresses of top 5 originators of register requests IP Addresses of top 5 originators of INVITE requests IP Addresses of top 5 originators of INSTANT message requests IP Addresses of top 5 originators of subscribe requests Top methods & response types sent. Drill down to send UE.

Display associated packets ,bytes exclude CSCF as originator Display associated packets, bytes exclude PCSCF as originator. Display associated packets, bytes exclude PCSCF as originator. Display associated packets, bytes exclude PCSCF as originator. Display associated packets, bytes exclude PCSCF as originator. Calculate the number of UEs

#bytes

System load indication System load indication System load indication System load indication System load indication Informative

Gm

#bytes

Gm

#bytes

Gm

#bytes

Gm

#bytes

Gm

Rate and total counts for UE

Gm

KPIs FOR LTE

KPI Names

Description

Logical Formulae

KPI object

Why interesting?

Interfa ce

Attempted EPS attach procedures

Provides the number of attempted EPS attach procedure within the MME. Number of successfully performed EPS attach within MME.

Sum of all attempts at attach EPS.

Valid for PS

Receipt of ATTACH REQUEST message with ATTACH TYPE information element indicating EPS attach from the MS.

Successful EPS attach procedures

Sum of all successful attaches.

Valid for PS

Transmission of a "ATTACH ACCEPT" message to the MS but retransmission doesnt increase the counter. Transmission by the SGSN of the ATTACH REJECT message to the MS, in response to a "ATTACH REQUEST"

Failed EPS attach procedures

Number of failed EPS attach procedures . It is split into sub counters per the reject cause.

Sum of all failed attach procedures.

Valid for PS

KPI Names

Description

Logical Formulae

KPI object

Why interesting? Gives the total number of attempted detaches.

Interf ace

Attempted EPS detach procedure

Number of attempted EPS detach procedures initiated by UE within the MME. Number of successful EPS detach procedures initiated by UE within the MME. Number of attempted detach procedures by MME.

Receipt of DETACH Valid for REQUEST PS message with detach type information element from UE Transmission of DETACH ACCEPT from MME

Successful EPS detach procedure

Valid for Gives the total PS number successfully of attempted detaches. Valid for All the attempts PS of detach to calculate success

Attempted EPS detach procedure by MME

Transmission of DETACH REQUEST message by UE from the MME.

KPI Names

Description

Logical Formulae

KPI object

Why interesting?

Interf ace

Successful EPS detach procedure by MME

Number of successful detach procedures by MME.

Receipt of DETACH Valid for Calculate ACCEPT message PS success rate by UE from the MME.

Attempted EPS detach procedure by HSS

Number of attempted detach procedures by HSS.

Receipt of CANCEL LOCATION message by MME from the HSS with cancel type information element indicating delete user. Receipt of CANCEL LOCATION ACK message from MME by HSS.

Valid for All the attempts PS of detach by HSS and uses RADIUS.

Successful EPS detach procedure by HSS

Number of successful detach procedures by HSS.

Valid for All the PS successful attempts to detach by MME.

KPI Names

Description

Logical Formulae

KPI object

Why interesting?

Interf ace

Attempted tracking area update procedure with SGW change

Number of attempted tracking area update procedure with SGW change initiated with MME. Successful number of attempted tracking area update procedure with SGW change initiated with MME.

Receipt of TRACKING Valid for Calculate AREA AREA UPDATE PS UPDATE REQUEST message attempts. from the MS, with last registered TAI information element indicating to the MME that it wishes to be served by new SGW. Transmission of TRACKING AREA UPDATE ACCEPT message from the MS, with last registered TAI information element indicating to the MME that it wishes to be served by new SGW Valid for Success rate of PS Area updates.

Successful tracking area update procedure with SGW change

KPI Names

Description

Logical Formulae

KPI object Valid for PS

Why interesting ? Causes of failure.

Interf ace

Failed tracking area update procedure with SGW change

Number of failed tracking area update procedure with SGW change initiated with MME.

Transmission of TRACKING AREA UPDATE REJECT message from the MS, with last registered TAI information element indicating to the MME that it wishes to be served by new SGW. Causes are also defined in the message.

Attempted tracking area update procedure without SGW change

Number of attempted tracking area update procedure without SGW change initiated with MME.

Valid for Receipt of TRACKING AREA UPDATE REQUEST PS message from the MS, with last registered TAI information element indicating to the MME that it wishes to be served by same SGW.

Calculate AREA UPDATE attempts. Without SGW change.

KPI Names

Description

Logical Formulae

KPI object

Why interesti ng? Success rate of Area updates.

Interf ace

Successful tracking area update procedure without SGW change

Successful number of attempted tracking area update procedure without SGW change initiated with MME. Number of failed tracking area update procedure without SGW change initiated with MME.

Transmission of TRACKING Valid for AREA UPDATE ACCEPT PS message from the MS, with last registered TAI information element indicating to the MME that it wishes to be served by same SGW

Failed tracking area update procedure without SGW change

Transmission of TRACKING Valid for AREA UPDATE REJECT PS message from the MS, with last registered TAI information element indicating to the MME that it wishes to be served by same SGW. Causes are also defined in the message.

Causes of failure in case of same SGW.

KPI Names Attempted EPS paging procedures

Description

Logical Formulae

KPI object

Why interesti ng?

Interf ace

Number of attempted PS paging procedures initiated at the MME.

Incremented when an EPS paging procedure is started i.e. at the transmission of first Paging message from MME to the eNodeB, which are counted when paging area is smaller than or equal to one TA. Receipt of SERVICE REQUEST message with Service Type = Paging Response from the UE.

Valid for Initial as PS. well as repeated paging are counted

Successful EPS paging procedures

Number of successful PS paging procedures initiated at the MME.

Valid for Initial and PS repeated are both counted.

Failed EPS Number of paging failed PS procedures paging procedures initiated at the MME.

Valid for Increments when an EPS PS paging procedure times out, PS which are counted when paging area is smaller than or equal to one TA.

Initial and repeated are both counted.

KPI Names

Description

Logical Formulae

KPI object

Why interesting?

Interfa ce

Number of dedicated EPS bearers in active mode(Mean)

Mean number of dedicated EPS bearers.

Sampling at a pre-defined interval, sum of dedicated EPS bearer established by MME in active mode and then taking the arithmetic mean. Sampling at a pre-defined interval, sum of dedicated EPS bearer established by MME in active mode and then taking the maximum.

Valid for PS

The total active mode bearers would give the load. The total active mode bearers would give the maximum load.

Number of dedicated EPS bearers in active mode(Maxim um)

Maximum number of dedicated EPS bearers.

Valid for PS

KPI Names

Description

Logical Formulae

KPI object Valid for PS

Why interestin g? This would let us calculate the mean of set-up time.

Interfa ce

Dedicated bearer set-up time by MME(Mean)

Valid time per dedicated bearer set-up procedure by MME.

Obtained by accumulating the time intervals for every successful dedicated bearer setup by MME B/W ACTIVATE DEDICATED EPS BEARER CONTEXT REQUEST and corresponding ACTIVATE DEDICATED EPS BEARER CONTEXT ACCEPT message receipt by the MME. This time when divide by the total number of successful dedicated bearer gives the mean. Transmission of ACTIVATE DEDICATED EPS BEARER CONTEXT REQUEST message by MME.

Attempted dedicated bearer activation procedure by MME

Number of attempted dedicated bearer activation procedure by MME.

Valid FOR PS

Total number of attempts.

KPI Names

Description

Logical Formulae

KPI object

Why interesting ? Total number of successful attempts.

Interfa ce

Successful dedicated bearer activation procedure by MME

Number of successful dedicated bearer activation procedure by MME.

Receipt of ACTIVATE DEDICATED EPS BEARER CONTEXT ACCEPT message by MME.

Valid FOR PS

Failed dedicated bearer activation procedure by MME Attempted dedicated bearer de activation procedure by MME

Number of failed dedicated bearer activation procedure by MME.

Transmission of ACTIVATE DEDICATED EPS BEARER CONTEXT REJECT message by MME from UE with ESM cause indicating the cause of failure.. Transmission of DEACTIVATE EPS BEARER CONTEXT REQUEST message by MME.

Valid FOR PS

Failure detection.

Number of attempted dedicated bearer deactivation procedure by MME.

Valid FOR PS

Total number of attempts to de activate

KPI Names

Description

Logical Formulae

KPI obje ct Valid FOR PS

Why interesting ? Total number of successful attempts to deactivate.

Interf ace

Successful dedicated bearer de activation procedure by MME Attempted EPS bearer modification procedure by MME Successful EPS bearer modification procedure by MME

Number of successful dedicated bearer de activation procedure by MME.

Receipt of DEACTIVATE EPS BEARER CONTEXT ACCEPT message by MME.

Number of attempted bearer modification procedure by MME.

Transmission of MODIFY EPS BEARER CONTEXT REQUEST message by MME.

Valid FOR PS

Total number of attempts to modify

Number of successful EPS bearer modification procedure by MME.

Receipt of MODIFY EPS BEARER CONTEXT ACCEPT message by MME.

Valid FOR PS

Total number of successful attempts to MODIFY.

KPI Names

Description

Logical Formulae

KPI obje ct Valid for PS.

Why interesti ng? Used to calculate the success rate.

Interf ace

Failed EPS bearer modification procedures by MME

Number of failed EPS bearer modification procedure by MME.

Receipt of MODIFY EPS BEARER CONTEXT REJECT message by MME from UE. With ESM Cause. Total Number of PDNGW created.

Attempted number of PDNGW initiated dedicated bearer creation Successful number of PDNGW initiated dedicated bearer creation

Number of attempted PDN-GW containing multiple bearer IDs, each cumulated to the counter. Number of successful PDN-GW containing multiple bearer IDs, each cumulated to the counter.

Valid for PS

Success rate calculatio n.

Total Number of PDNGW created.

Valid for PS

Success rate calculatio n.

KPI Names

Description

Logical Formulae

KPI objec t Valid for PS

Why interestin g? Failure rate and cause of failure.

Inte rfac e

Failed number of PDNGW initiated dedicated bearer creation

Failed PDN-GW containing multiple bearer IDs, each cumulated to the counter. Number of attempted PDNGW initiated Dedicated Bearer Deletion. Number of successfully PDNGW initiated Dedicated bearer deletion.

Total Number of PDNGW created.

Attempted number of PDNGW initiated dedicated bearer deletion.

Transmission of Delete Bearer REQUEST message may contain multiple bearer ID, each bearer shall be cumulated to the counter. Receipt of Delete Bearer Response message by PDNGW where cause and receives a n ACCEPTNCE RESPONSE

Valid for PS

Attempts of number of deletion.

Successful number of PDNGW Dedicated bearer deletion

Valid for PS

Success rate calculation .

KPI Names

Description

Logical Formulae

KPI objec t

Why interestin g?

Inte rfac e

Failed number of PDNGW initiated dedicated bearer deletion Attempted number of PDNGW initiated modification with QoS update. Successful number of PDNGW Dedicated bearer modification with QoS update

Failed PDN-GW initiated dedicated bearer deletion. Split into sub counters per reject cause. Number of attempted PDNGW initiated Dedicated Bearer modification with QoS update Successfully PDN-GW initiated Dedicated bearer modification with QoS update.

Receipt of Deletion Bearer response MESSAGE where cause is indicated.

Valid Failure for rate and PS cause of failure.

Transmission of Update Bearer Request message from PDNGW with Bearer Level QoS containing all bearer IDs. Response to the request sent.

Valid Attempt s of for PS number of QoS updation . Valid Success for rate PS calculati on.

KPI Names

Description

Logical Formulae

KPI objec t

Why interestin g?

Inte rfac e

Failed PDNGW initiated dedicated bearer with QoS update Attempted number of PDN-GW initiated Dedicated Bearer Modification without QoS update.

Failed PDN-GW initiated dedicated bearer modification with QoS. Split into sub counters per reject cause. Number of attempted PDN-GW initiated Dedicated Bearer Modification without QoS update.

Receipt of Update Bearer response MESSAGE where cause is indicated. Transmission of "Update Bearer REQUEST" message From PDN-GW without Bearer Level QoS IE, this message may contains multiple Bearer IDs

Valid Failure for rate and PS cause of failure.

Valid Attempt s of for number PS of updation without QoS ..

KPI Names

Description

Logical Formulae

KPI object Valid for PS

Why interes ting? Succes s rate calcula tion.

Inte rfac e

Successful number of PDN-GW initiated Dedicated Bearer Modification without QoS update.

Number of successfully performed PDN-GW initiated Dedicated Bearer Modification without QoS update.

Response to the request sent.

Failed number of PDN-GW initiated Dedicated Bearer Modification without QoS update

Number of failed PDN-GW initiated Dedicated Bearer Modification without QoS update. The measurement is split into sub counters per the reject cause

Receipt of Update Bearer Response message by PDN-GW without Bearer Level QoS IE in the Update Bearer Request message which contains the same EPS Bearer ID and where Cause IE identifies a failed bearer handling with Rejection Response

Valid for PS

Failure rate and cause.

Feedback-assisted Dynamic Network Provisioning

Motivation and application scenario

Use of monitoring agent to provide feedback about the network condition and dynamically control the router and assign priority to application traffic under network congestion

EF

BE NetDetector

controller

System architecture of testbed

Automatic configuration of router

EDI: enhanced device interface Provides a comprehensive management interface for various Cisco devices with a standard programmatic interface

Two diffserv queues: Expedited forwarding (EF)

match DSCP 46 assured minimum bandwidth - Best effort match DSCP 0 set maximum bandwidth usage
Commands can be read in the form of CLI and are encapsulated in XML format when issuing edit-config operation of NETCONF

Query NetDetector and mark traffic

Controller polls NetDetector periodically (~ 20 sec)
Alternatively, Netdetector can send alarms

Two kinds of query in form of NIKSUN URI API

Check application type
- /ngen/srvc/dashboardData?recorder=<recorder>&iface=<iface>&startTime=2%20min&endTime=now&layer=Application&dataType=application&customDT=dataFields - trigger Marking traffic to EF class once application appears

Get application bit rate

- /ngen/srvc/dashboardData?recorder=<recorder>&iface=<iface>&startTime=2%20min&endTime=now&layer=Application&dataType=time,bitRate&customDT=dataField s&window=10 - Trigger router configuration when cross traffic exceeds upper threshold

Traffic marking is done by issuing iptables command at application source host

Before marking

After marking

Packet Classification

Before marking

After marking

50

Deliver streaming media and generate cross traffic VLC media player works as both streaming media server and client
Server: RTP unicast is delivered to destination host address using port 1234 (MPEG2) Client: receive the RTP stream and save it as MPEG2 file in local host

Iperf is used to generate cross traffic

Client: sends UDP packets at 10Mb/s Server: receives the UDP packets and provides statistics on bandwidth, loss rate, and time jitter

Experiment results (1)

Snapshots of video

During Congestion Before congestion

After Dynamic Control

Experiment results (2)

Change of quality of video & audio over time
No cross traffic cross traffic
Priority Queue (E/F)

MOS

No cross traffic

Priority Queue (E/F)

Packet loss

Experiment results (3)

Change of traffic received at destination host
Black: streaming media traffic Red: cross traffic bytes

time

Change of bandwidth and time jitter for cross traffic

Response time: ~ 40s

Experiment results (4)

Effect of polling time interval
20s interval: ~ 40s response time

10s interval: ~ 30s response time

Future work
Integrating the controlling program into NetDetector Reducing the response time
Depends on polling interval and time spent in configuring the router Using interruption/alarms rather than polling can further reduce response time

Being more adaptive to various scenarios

Many prerequisite information such as IP address of streaming media server and client is assumed Change of the configuration of the router should not block other normal traffic in practical situation, AF class is necessary to deal with these traffic (control traffic)

QoE Metrics

Require Sessionbased Measurements

GISFI

Slide 57

QoE metrics Driven by measurements

What To Measure?
Which Layer? Which Application? Which User? Hop-by-hop or End-to-end? Etc?
GISFI

Slide 58

QoE Metrics

Require Multitimescale Measurements

GISFI

Slide 59

QoE Metrics

What is Frequency of Measurement?

Duration of Flow? Minutes? Seconds? Sub-seconds? Per-packet?
GISFI

Slide 60

QoE Metrics Time Effect

GISFI

Slide 61

QoE Metrics

Require MultiLayer Measurements

GISFI

Slide 62

QoE Metrics Network/Transport Layer

IP Layer

UDP Layer

GISFI

Slide 63

QoE Metrics Application Specific

Application HTTP

Application SSH

GISFI

Slide 64

QoE Metrics User centric

User 1

User 2

GISFI

Slide 65

QoE Metrics - Application

All Traffic Except Facebook

Facebook Only

GISFI

Slide 66

QoE Metrics

Require DPI for Application Classification

GISFI

Slide 67

QoE Metrics

Require DPI for Application Classification Classification and Marking Policing and Markdown Queuing and Dropping

GISFI

Slide 68

Priority QoS Treatment (Diffserv approach) in the Core IP Transport

DSCP classification and marking at the edge, and class-based priority queuing and assured bandwidth scheduling at the edge and core routers EF Treatment: For Emergency SIP signaling and SIP Register transport (Strict-priority forwarding for bounded bandwidth) AF Treatment: For Emergency VoIP and Video/IP RTP media (Weighted shared bandwidth scheduling of remaining bandwidth among AF classes) BE Treatment: Best-effort traffic forwarding only when bandwidth not in use by higher priority traffic; Drop otherwise
69

Experiencing Quality of Services under congestion Audio Quality Video Quality

Increase Traffic Congestion
70

7 Mbps Cross Traffic

8 Mbps Cross Traffic

9 Mbps Cross Traffic

9.5 Mbps Cross Traffic

70

Applying Diffserv-based QoS to VoIP

VoIP Call (10 Mb/s One-way Cross Traffic)

Priority VoIP 10 Mb/s cross traffic (packet size 1440 bytes)

Non Priority VoIP 10 Mb/s cross traffic (packet size 1440 bytes)

Non Priority VoIP 10 Mb/s cross traffic (packet size 400 bytes)

71

Measurements - IMS
Top N Reports Clients based on SIP Registrations/Re-Registrations/De-Registrations Number of INVITE/NOTIFY/ SUBSCRIBE messages Failed/Successful authentications at P-CSCF/S-CSCF/I-CSCF depending on
Authentication type (SIP Digest, IMS AKA) Message type (INVITE, NOTIFY, BYE)

Malformed messages (SIP, RTP, H.248) identified using protocol grammar, rules Unauthenticated/Un-authorized messages Spoofed messages Session minutes (service usage)

Slide 72

Measurements IMS (Contd.)

Top N Reports Servers based on Excessive Registrations/subscriptions from a given client/proxy Setup requests (e.g., SIP INVITE) Unauthenticated/spoofed messages (e.g, SIP BYE/NOTIFY) Number of data sessions Incoming message/packet rates

Number of authentication challenges/failure messages Malformed signaling/media messages Key exchanges during IMS AKA authentication
Ability to drill down into data sessions - e.g., for given P-CSCF, find all the messages from client X between time T1 to T2.

Slide 73

Measurements - LTE
Insight into signaling and user data volumes Data volume distribution by
Top SGW Top MME Top eNodeB Top IMSI

Volume distribution available by

Data Sessions Packets Bytes Setup time Session duration .. etc

QoE Metrics QoS due to Mobility

Minimize the interruption in QoS during handover Interoperability with Mobility protocols

GISFI

Slide 75

QoE Metrics

Interoperability with Mobility protocols

GISFI

Slide 76

What affects QoE for Rural Users

Network Characteristics Ad hoc type networks scattered group of users Lossy links, Fluctuating Traffic demand Delay tolerant networks (DTN) - not suitable for interactive traffic Low bandwidth > Network congestion Network heterogeneity (e.g., WiMAX and WiFi) Frequent user mobility (e.g., cell mobility, subnet mobility) Application characteristics Current Types of Application Cellular voice, File transfer (e.g., non-real-time), SMS Future NGN Application requires QoS support from lower layers Real-time streaming (e.g., IPTV) Interactive (e.g., VoIP) Delay sensitive Distance learning, Mobile banking Group-based conferencing (e.g., Multicast) (Priority) Services need QoS reservation
GISFI

Slide 77

Next Steps
Baseline Document (June ) Define a set of requirements that is application specific and applicable to Indian rural environment Define a set of methodologies to define end-toend QoS parameters Multi-layer QOS Network, Application Layer Multi-time-scale measurements Granularity of measurement Define a set of APIs to control the network based on measurement Slide 78
GISFI

KPIs FOR LTE

80