3G KPI Guidelines

Appendix U12
UMTS Network KPI

NOTES:
This document can be used as an example of defining KPs in a cont!act" t is in
E!icsson#s inte!est that KPs a!e $ell defined% including:
a KP ta!get &alues '(eep as fe$ $ith ta!gets as possible)
b *o!mula and measu!ement definitions 'fo! d!i&es and stats)
c +he!e and ho$ KP $ill be measu!ed 'locations% setup% tools% d!i&e% statistics)
d ,onditions - p!e!e.uisites% exclusions
e Statistical conside!ations
As much of this as p!actical should be defined in the cont!act% pa!ticula!l/ an/thing
that $ill limit E!icsson#s !is(s and costs"
Some of the mate!ial in this document ma/ best be included in othe! pa!ts of the
cont!act% including the Acceptance P!ocedu!e and associated documents"
KP ta!get &alues ha&e &e!/ little meaning until the conditions of measu!ement a!e
defined as abo&e" ,ommitting to a ta!get $ithout defining ho$% $hen and $he!e it $ill
be measu!ed lea&es E!icsson at g!eat !is("
N"0" The KPs and thei! ta!gets included in this document ma/ not be the ones
!ecommended b/ E!icsson" 1efe! to the KP Technical 2uidelines and KP data base
fo! cu!!ent !ecommendations"
Table of Contents
UMTS NETWORK KPI.........................................................................................................................................................1
1 INTRODUCTION.................................................................................................................................................................3
SUMMARY OF LEVEL-1 KPI AND TARGETS..........................................................................................................................3
2 PERFORMANCE COMMITMENTS AND REQUIREMENTS.....................................................................................6
MILESTONE DEFINITION........................................................................................................................................................6
SCOPE....................................................................................................................................................................................6
GENERAL REQUIREMENTS.....................................................................................................................................................6
CONTRACTUAL KPI COMMITMENTS.....................................................................................................................................7
3 UTRAN LEVEL-1 KEY PERFORMANCE INDICATORS............................................................................................7
CIRCUIT SWITCHED LEVEL-1 KEY PERFORMANCE INDICATORS..........................................................................................7
3.1.1 Circuit Switched Call Setup.............................................................................................................................8
3.1.2 RRC Establishment Causes.............................................................................................................................9
3.1.3 CSV Access Failure.........................................................................................................................................9
In the eent that there are seeral c!nsecutie RRC C!nnecti!n Re"uest !nl# the $irst RRC c!nnecti!n re"uest
shall be ta%en int! acc!unt $!r the &'I calculati!n. .....................................................................................................11
Calls are c!nsidered as $ailed durin( access when a c!nnecti!n is attempted and the )E d!es n!t receie
Alertin(*C!nnect messa(e in case !$ drie test measurement. F!r +SS RA,A'- RA. Assi(nment Resp!nse messa(e
$r!m the R,C t! c!re ,etw!r% is c!nsidered as a call success$ul setup........................................................................11
3.1./ CSV 0r!p.......................................................................................................................................................11
3.1.1 CSV 2ualit#...................................................................................................................................................12
3.1.3 CSV Cell Capacit#.........................................................................................................................................1/
3.1.4 CSV S!$t*S!$ter 5and!er +erhead............................................................................................................11
3.1.8 CSV Inter6Radi! Access 7echn!l!(# 5and!er Failure ..............................................................................13
3.1.9 CSV Call Setup 7ime.....................................................................................................................................18
3.1.18 CS0 Access Failure.....................................................................................................................................19
In case there are seeral c!nsecutie RRC C!nnecti!n Re"uests !nl# the $irst RRC c!nnecti!n re"uest will be
ta%en int! acc!unt $!r the &'I calculati!n.....................................................................................................................28
3.1.11 CS0 0r!p....................................................................................................................................................28
3.1.12 CS0 2ualit#.................................................................................................................................................21
3.1.13 CS0 Call Setup time....................................................................................................................................22
PACKET SWITCHED LEVEL-1 KEY PERFORMANCE INDICATORS.........................................................................................23
3.1.1/ 'ac%et Switched Call Setup.........................................................................................................................23
3.1.11 'S0 Access Failure ....................................................................................................................................2/
3.1.13 'S0 0r!p....................................................................................................................................................23
3.1.14 'S0 9atenc#................................................................................................................................................24
3.1.18 'S0 7hr!u(hput .........................................................................................................................................24
3.1.19 'S0 Call Setup 7ime...................................................................................................................................29
3.1.28 'S0 Inter6Radi! Access 7echn!l!(# 5and!er Failure.............................................................................29
3.1.21 'S0 IRA7 Interrupti!n time........................................................................................................................38
3.1.22 5S0'A Access Failure................................................................................................................................31
3.1.23 5S0'A 0r!p...............................................................................................................................................33
3.1.2/ 5S0'A 9atenc#...........................................................................................................................................3/
3.1.21 5S0'A 7hr!u(hput ....................................................................................................................................31
3.1.23 5S)'A 7hr!u(hput ....................................................................................................................................33
3.1.24 5S0'A 0ata Sessi!n Setup 7ime................................................................................................................34
SYSTEM AVAILABILITY ......................................................................................................................................................3
3.1.28 Aera(e Cell Aailabilit#.............................................................................................................................38
3.1.29 Aera(e Cell ,!n6:aintenance Aailabilit#...............................................................................................39
COMPARISON OF UMTS AND GSM NETWORK PERFORMANCE.........................................................................................3!
IMPACT OF UMTS ON GSM NETWORK PERFORMANCE....................................................................................................."#
4 UTRAN LEVEL-2 KEY PERFORMANCE INDICATORS .........................................................................................40
2 of 34
1 Introduction
The pu!pose of this Appendix U12 is to define Net$o!( Ke/ Pe!fo!mance ndicato!s 'KP) fo! the U5TS
d!i&e test% UT1AN counte! based measu!ements and pe!fo!mance ta!gets and fo!mulas fo! each of the
KP" All capitali6ed te!ms% ac!on/ms% and definitions used in this Appendix U12 a!e listed in eithe! the
U5TS Ac!on/ms and 7efinitions 'Appendix U18)% o! in the O!iginal Ag!eement"
The UT1AN KP definition and de&elopment effo!t is pe!fo!med at the t$o le&els as defined belo$:
9e&el:1 KP: a!e the high:le&el met!ics used fo! o&e!all se!&ice .ualit/ measu!ement and monito!ing
the health of Pu!chase!#s UT1AN Net$o!(" These met!ic definitions shall be ag!eed to b/ Selle!%
and Selle!;s implementation of the 9e&el:1 met!ics shall be in compliance $ith Pu!chase!;s
definitions defined in this Appendix U12"
9e&el:2 KP: a!e the detailed enginee!ing le&el met!ics that shall be used fo! enginee!ing%
dimensioning the Net$o!(% the in&estigation and t!oubleshooting of p!oblem a!eas in the U5TS
Net$o!("
Summary of Level1 KPI and Tar!ets
N"T#$ T%e selection of KPI and t%e tar!et values s%ould use t%e
KPI Tec%nical &uidelines and KPI 'atabase( T%e followin! is an
e)am*le from a real contract and s%ould N"T be seen as
#ricsson recommendation and must not be used in any contract
in t%is form(
KPI Parameter Table
+eference
PreLaunc%
,Milestone 1-
Launc%
,Milestone .-
Post Launc%
,Milestone /-
,S< Access *ailu!e 1ate Table = > 2"4 ? > 2"4 ? > 2"4 ?
,S< 7!op 1ate Table @ > 2"4 ? > 2"4 ? > 2"4 ?
,S< Aualit/ '79) Table 8 B@
th
pe!centile
of samples >
2"4 ? 09E1
B@
th
pe!centile of
samples > 2"4 ?
09E1
B@
th
pe!centile
of samples >
2"4 ? 09E1
,S< Aualit/ 'U9) Table 8 B@
th
pe!centile
of samples >
2"4 ? 09E1
B@
th
pe!centile of
samples > 2"4 ?
09E1
B@
th
pe!centile
of samples >
2"4 ? 09E1
,ell ,apacit/ Table 14 C 34 U# 0M+
1.(.k
'p!o&ided it is
achie&ed in 1*
design)
C 34 U# 0M+
1.(.k 'p!o&ided it
is achie&ed in 1*
design)
5easu!e and
!epo!t
SoftDSofte! Eando&e!
O&e!head
Table 12 > 1"F > 1"F > 1"G
,S< 1AT *ailu!e 1ate Table 13 NDA > @"4 ? > @"4 ?
= of 34
H<oice ,all Setup time
'5obile to PSTN)
Table 1@ B@
th
pe!centile
> F seconds
B@
th
pe!centile > F
seconds
B@
th
pe!centile >
F seconds
H<oice ,all Setup time
'5obile to 5obile)
Table 1@ B@
th
pe!centile
> B seconds
B@
th
pe!centile >
B seconds
B@
th
pe!centile
> B seconds
,S7 Access *ailu!e 1ate Table 1G > ="4 ? > 2"4 ? > 2"4 ?
,S7 7!op 1ate Table 1B > 2"@ ? > 2"@ ? > ="4 ?
',ounte!)
> 2"@ ? '7!i&e
Test)
,S7 Aualit/ '79) Table 21 B@
th
pe!centile
of samples >
1"4 ? 09E1
B@
th
pe!centile of
samples > 1"4 ?
09E1
B@
th
pe!centile
of samples >
1"4 ? 09E1
,S7 Aualit/ 'U9) Table 21 B@
th
pe!centile
of samples >
1"4 ? 09E1
B@
th
pe!centile of
samples > 1"4 ?
09E1
B@
th
pe!centile
of samples >
1"4 ?09E1
H,S7 ,all Setup time Table 22 N"A B@
th
pe!centile > B
seconds
N"A
PS7 Access *ailu!e 1ate Table 23 > 2"4 ? > 2"4 ? > 2"4 ?
PS7 7!op 1ate Table 2F > 2"@ ? > 2"4 ? > 2"4 ?
HPS7 9atenc/ 'an/ 1BB
1A0)
Table 28 N"A B@
th
pe!centile
> 244ms
N"A
PS7 1BB A&e!age 79
th!oughput '(bps)
'Unloaded)
Table =1 C 234 C 234 C 1@4 ',ounte!)
C 234 '7!i&e
Test)
PS7 1BB A&e!age 79
th!oughput '(bps)
'9oaded)
Table =1 C 214 C 214
C 1@4 ',ounte!)
C 214 '7!i&e
Test)
PS7 1BB A&e!age U9
th!oughput '(bps)
'Unloaded)
Table =2 C 244 C 244
C 1@4 ',ounte!)
C 244 '7!i&e
Test)
PS7 1BB A&e!age U9
th!oughput '(bps)
'9oaded)
Table =2 C 184 C 184
C 1@4 ',ounte!)
C 184 '7!i&e
Test)
3 of 34
HPS7 ,all Setup time Table =3 N"A B@
th
pe!centile
sessions > @
seconds
N"A
PS7 1AT *ailu!e 1ate Table =F NDA > @"4 ? > @"4 ?
PS7 1AT nte!!uption time Table =B N"A
B@th pe!centile
> 12 seconds
N"A
PS7 1AT Use! 7ata
nte!!uption time
Table =B N"A
5easu!e and
1epo!t
N"A
ES7PA Access *ailu!e
1ate
Table 31 > 2"4 ? > 2"4 ? > 2"4 ?
ES7PA 7!op 1ate Table 3= > ="4 ? > 2"4 ? > 2"4 ?
HES7PA 9atenc/ Table 3@ N"A B@
th
pe!centile
sessions > 144
ms
N"A
Stationa!/ 5aximum 79
ES7PA 0it 1ate '(bps)
unde! no load 'UE
,atego!/ 12)
Table 3G C 1=44 C 1=44 C1=44
'at 19, 9a/e!
using counte!)
Stationa!/ 5aximum 79
ES7PA 0it 1ate '(bps) $ith
@4? 79 loading 'UE
,atego!/ 12)
Table 3G C 1144 C 1144 N"A
ES7PA A&e!age 79
Th!oughput '(bps) fo! UE
catego!/ 12 unde! no load
Table 38 C G44 C G44 C G44
'at off pea()
ES7PA A&e!age 79
Th!oughput '(bps) fo! UE
catego!/ 12 unde! @4? 79
loading
Table 38
C F44
C F44 N"A
ESUPA Stationa!/ Pea(
th!oughput '(bps) fo! UE
,atego!/ = '1"3@ 5bps)
Table @4 C 1144 C 1144 5easu!e and
1epo!t
ESUPA Stationa!/ A&e!age
th!oughput '(bps) fo! UE
,atego!/ = '1"3@ 5bps)
Table @4 C @44 C @44 5easu!e and
1epo!t
HES7PA Session Acti&ation
time
Table @1 N"A B@
th
pe!centile
sessions > @
seconds
N"A
@ of 34
HA&e!age ,ell A&ailabilit/
KP
Table @= N"A N"A N"AHH
HA&e!age ,ell Non:
5aintenance A&ailabilit/
KP
Table @@ N"A N"A N"AHH
2S5 Pe!fo!mance
7eg!adation due to
nt!oduction of U5TS
Page No:
34
,ell > 14 ?
,luste! > G"@?
5a!(et > @?
,ell> 14 ?
,luste! > G"@?
5a!(et > @?
,ell> 14 ?
,luste! > G"@?
5a!(et > @?
H Selle! shall commit to these KP du!ing the life of the Net$o!( as desc!ibed in Section of this document
HH KP Applicable one '1) /ea! afte! U5TS Net$o!( comme!cial 9aunch"
. Performance Commitments and +e1uirements
Milestone 'efinition
5ilestone desc!iption is p!o&ided in the U5TS S/stem Acceptance 'Appendix U1F)"
Th!ee milestones a!e defined in this Appendix U12 as follo$s:
1" 5ilestone:1 '5S1): Prelaunc%" P!e:launch is defined as the completion of ,luste! Acceptance
testing" The KP ta!get le&els $ill be based on d!i&e tests and not OSS statistics"
2" 5ilestone:2 '5S2): Launc%" 9aunch is defined as the completion of 5a!(et Acceptance testing of the
initial Net$o!( configu!ation" The KP ta!get le&els shall be based on d!i&e tests and not OSS
statistics"
=" 5ilestone:= '5S=): PostLaunc%" Post:9aunch is defined as six 'F) months afte! 9aunch" The KP
ta!get le&els shall be based on OSS statistics at 5a!(et 9e&el o! 7!i&e Test data if the!e is not
sufficient t!affic% as defined in U5TS S/stem Acceptance 'Appendix U1F) in the U5TS Net$o!("
Sco*e
The scope in this Appendix U12 is to define applicable U5TS Net$o!( KPs fo! S/stems and E.uipment
supplied b/ Selle!"
&eneral +e1uirements
Pe!fo!mance 5anagement 5easu!ement Entit/ shall be a&ailable at ,ell% Node:0% ,luste!% 1N,% 5a!(et%
1egion and Net$o!( le&el fo! e&e!/ KP unless othe!$ise stated in this Appendix U12" 1N, 5easu!ement
2!anula!it/ shall be a minimum pe!iod of fifteen '1@) minutes unless othe!$ise stated in this Appendix U12"
All tests fo! KP pu!poses shall be pe!fo!med in 5obile '&ehicle d!i&e) en&i!onment unless othe!$ise specified"
1AT Ea!d Eando&e! *eatu!e shall be s$itched off du!ing KP &e!ification $ithin the U5TS Se!&ice A!ea at
P!e:9aunch" At 9aunch milestone 1AT EEO failu!e !ate in =2:22 1* Se!&ice bounda!/ shall be &e!ified $ith
one dedicated d!i&e pe! 5a!(et unit"
The tests shall be pe!fo!med unde! a multi:supplie! en&i!onment% in $hich nodes f!om diffe!ent supplie!s
ma/ be used 'e"g" S2SN% 22SN% 5S,% 52+ etc)" n the e&ent that a pa!ticula! test is not passed and
Selle! claims the p!oblem is $ith the othe! supplie!% Selle! shall clea!l/ demonst!ate that the element in
.uestion is the sou!ce of the p!oblem" f the p!oblem is confi!med to be in a thi!d:pa!t/ supplie!#s
E.uipment then Selle! shall !e:schedule the indi&idual test cases onl/ afte! the p!oblem has been
!esol&ed b/ the thi!d:pa!t/ supplie!"
The initial UT1AN pa!amete! set shall be mutuall/ ag!eed" No UT1AN pa!amete! shall be changed
du!ing ,luste!D5a!(et Acceptance tests $ithout p!io! app!o&al of Pu!chase! as defined in the U5TS
S/stem Acceptance 'Appendix U1F)" As te!minal pe!fo!mance ma/ also ha&e an impact on the
F of 34
pe!fo!mance% the b!and and model of te!minal to be used fo! the tests shall be mutuall/ ag!eed to b/
Selle! and Pu!chase!"
,ounte! based statistics fo! 9e&el:1 KP shall co&e! all t!affic classes and include all causes of
failu!esDsuccesses to indicate end to end pe!fo!mance as &ie$ed b/ UT1AN"
Contractual KPI Commitments
The follo$ing KPs and ta!gets shall be &alid fo! the lifetime of the Net$o!(% p!o&ided that the!e is a Suppo!t
Ag!eement in place fo! the Selle! p!o&ided S/stems"
Table .$ KPI Parameter Commitment for t%e lifetime of t%e UMTS Network
SN KPI Parameter Tar!et
1 ,S< ,all Setup Time '5obile to PSTN) > F seconds
2 ,S< ,all Setup Time '5obile to 5obile) > B seconds
= ,S7 ,all Setup time '5obile to 5obile) > B seconds
3 PS7 9atenc/ : an/ 1BB 1A0 > 244 ms
@ PS7 ,all Setup Time > @ seconds
F ES7PA 9atenc/ > 144ms
G ES7PA 7ata Session Setup Time > @ seconds
8 ,ell A&ailabilit/ As pe! Table @=
B ,ell A&ailabilit/ 'Non:5aintenance) As pe! Table @@
The U5TS Net$o!( is expected to meet o! exceed the KP ta!gets specified in this Appendix U12 $ithin the
U5TS Se!&ice A!ea $ith o! $ithout loading the U5TS Net$o!("
Selle! commitment applies to 9e&el:1 KP fo! achie&ing ta!get &alues at the milestone applicable to KP"
KP counte! met!ics shall be based on UT1AN &ie$ of Net$o!( Pe!fo!mance" Selle! shall p!o&ide all
9e&el:1 KP counte!s used in the fo!mulas defined in this Appendix U12 at 5ilestone:2 $ith the
exception of S10 counte!s fo! Access *ailu!e" Selle! shall p!o&ide all 9e&el:1 KP !epo!ts fo! KP
Acceptance"
Pu!chase! shall define KP 9e&el:2 !e.ui!ements as outlined in Section 3"
/ UT+0N Level1 Key Performance Indicators
This Section desc!ibes the UT1AN 9e&el:1 KP% o! high le&el se!&ice met!ics" 9e&el:1 KP is sub:
di&ided into t$o basic se!&ice domains: the ,i!cuit S$itched ',S) domain that includes <oice and <ideo
calls% and the Pac(et S$itched 'PS) domain that includes 1BB Pac(et 7ata and ES7PADESUPA 7ata
Sessions"
Circuit Switc%ed Level1 Key Performance Indicators
The t$o '2) t/pes of se!&ices in the ,S domain a!e ,i!cuit S$itched <oice ',S<) and ,i!cuit S$itched
7ata ',S7)"
G of 34
/(1(1 ,i!cuit S$itched ,all Setup
The setup of a ,S se!&ice is comp!ised of th!ee basic steps 'see *igu!e 1)" *i!st% UE must access
the UT1AN and establish an 11, connection" Once this connection is completed the Non Access
St!atum 'NAS) messages a!e exchanged bet$een the UE and the ,o!e Net$o!( ',N) e"g" ,5
Se!&ice 1e.uest% Authentication% Secu!it/% etc" The last step of the call setup is the establishment
of a 1adio Access 0ea!e! '1A0) bet$een the ,N and the UE"
2i!ure 1$ Call Setu* 3lock 'ia!ram
*igu!e 2 illust!ates a call setup flo$ diag!am fo! a ,S mobile o!iginated call" f a p!oblem occu!s
bet$een 11, ,onnection 1e.uest 'step 1)% and 1ANAP: 1A0 Assignment 1esponse 'step 2G)%
Ale!tingD,onnect 'step 2B) in case of d!i&e test% it is conside!ed an Access *ailu!e" An/ 1A0
abno!mal !elease afte! 1A0 Assignment 1esponse 'in case of ,ounte! *o!mula)% Ale!tingD,onnect
message 'in case of 7!i&e Test *o!mula) is conside!ed a d!opped call"
8 of 34
Establish
11,
,onnection
Non
Access
St!atum
5essaging
1adio
Access
0ea!e!
'1A0)
Setup
2i!ure .$ Circuit Switc%ed Call Setu* 2low 'ia!ram
/(1(. 11, Establishment ,auses
Table 1 p!o&ides a list of 11, establishment causes" +hen the UE attempts to setup a 11,
,onnection $ith the UT1AN% the UE sends a 11, ,onnection 1e.uest message" Embedded $ithin
this message is an info!mation element that communicates the establishment cause fo! the
connection !e.uest" This establishment cause shall be utili6ed to diffe!entiate ,S and PS call KP
!elated to Access *ailu!e" Sepa!ate counte!s fo! each t!affic classes fo! e&e!/ 11, ,onnection
1e.uest and 11, ,onnection ,omplete 'as pe! =2PP) shall be made a&ailable in Soft$a!e !elease
at the time of comme!cial launch '5ilestone 2)"
Table 1$ ++C #stablis%ment Causes
++C #stablis%ment
Cause
'escri*tion
4 O!iginating ,on&e!sational ,all
1 O!iginating St!eaming ,all
2 O!iginating nte!acti&e ,all
= O!iginating 0ac(g!ound ,all
3 O!iginating Subsc!ibed t!affic ,all
@ Te!minating ,on&e!sational ,all
F Te!minating St!eaming ,all
G Te!minating nte!acti&e ,all
8 Te!minating 0ac(g!ound ,all
B Eme!genc/ ,all
14 nte!:1AT ,ell !e:selection
11 nte!:1AT ,ell change o!de!
12 1egist!ation
1= 7etach
13 O!iginating Eigh P!io!it/ Signaling
1@ O!iginating 9o$ P!io!it/ Signaling
1F ,all !e:establishment
1G Te!minating Eigh P!io!it/ Signaling
18 Te!minating 9o$ P!io!it/ Signaling
1B Te!minating - cause un(no$n
/(1(/ ,S< Access *ailu!e
Access failu!e is the p!oduct of the 11, ,onnection *ailu!e% NAS Setup *ailu!e and the 1A0
Establishment *ailu!e" 11, ,onnection Success is counted $hen the 1N, !ecei&es a 11, Setup
,omplete f!om the UE" NAS Setup is conside!ed successful $hen the signaling messages in the
call flo$ du!ing call setup flo$ is successfull/ completed b/ !ele&ant Net$o!( Elements" A 1A0 is
conside!ed successfull/ established $hen the 1A0 Assignment 1esponse is sent b/ 1N, to the
,N"
B of 34
#1uation 1$ CS4 0ccess 2ailure +ate ,Counter 2ormula-
144H
1
]
1
,
_
$ % R& '
$ % R& '
(
'
'
(
'
'
1
CSV "uest Assi(nment RA.
CSV sp!nse Assi(nment RA.
SR.Attempt
SR.Success
Attempt C!nnecti!n RRC
Success C!nnecti!n RRC
The abo&e fo!mula definition shall be met $ith the follo$ing Selle!#s counte!s"
144H
1
]
1
,
_
U)*+,C&--$ ./)S/&&01% +2-341A))& /.N5R+2E4)

U)*+,C&--$ &44S/&&01% +2-341S600 /.N5R+2E4)
( !!!3 . # (
--$ C4%U)*+,C& C5,,&0)R&7 /.T5)N5R*0
+,C&--$ C4S600%U)* C5,,&0)R&7 /.T5)N5R*0
1
Selle! shall de&elop S10 counte!s b/ 1AN 1elease P8" Selle! and Pu!chase! ag!eed to use BB"B=?
S10 success !ate until S10 counte!s pe! ,S and PS domain a!e made a&ailable at P8"
As an inte!im solution% it shall be defined as a d!op !ate of 2? o&e! an a&e!age call length of B4
seconds% the p!obabilit/ of d!opping the S10 du!ing the di!ect t!ansfe! phase is =sDB4sH2?I 4"4G?"
f du!ing the deplo/ment% fault !ates highe! than 4"1? a!e obse!&ed% selle! shall de&elop counte!s in
PG"
Measurement Condition$
n case of multiple 11, connection !e.uests onl/ the fi!st 11, connection !e.uest shall be ta(en
into conside!ation fo! KP calculation"
Table .$ CS4 0ccess Term 'efinition
Key Performance Indicator Term 'efinition
#RRC Connection Success (CSV) The numbe! of successful 11, ,onnection ,omplete
$ith an/ establishment cause that lead to ,S< 1A0"
#RRC Connection Attempt (CSV) The numbe! 11, ,onnection 1e.uest 5essages
!ecei&ed $ith an/ establishment cause that leads to a
,S< 1A0"
#RAB Assignment Response (CSV) The numbe! of 1ANAP: 1A0 Assignment 1esponse
messages sent f!om the 1N, to the 5S, fo! a &oice
call"
#RAB Assignment Request (CSV) The numbe! of 1ANAP: 1A0 Assignment 1e.uest
messages sent f!om the 5S, to the 1N, to establish a
&oice call"
# SRB Attempt The numbe! of 11, ,onnection ,ompletes that $ill
lead to an nitial 7i!ect T!ansfe! to the ,S domain and
$ill also lead to a ,S< 1A0 Assignment 1e.uest"
# SRB Success The numbe! of ,S< 1A0 Assignment 1e.uests
#1uation .$ CS4 0ccess 2ailure +ate ,'rive Test 2ormula-
1
1
1
]
1
Calls CSV
Calls CSV
"uest C!nnecti!n RRC
C!nnect Alertin( CC
ailureRate CSVAccessF
8
8
R& 8
9 8
1 ( 1##
14 of 34
n the e&ent that the!e a!e se&e!al consecuti&e 11, ,onnection 1e.uest onl/ the fi!st 11,
connection !e.uest shall be ta(en into account fo! the KP calculation"
,alls a!e conside!ed as failed du!ing access $hen a connection is attempted and the UE does not
!ecei&e Ale!tingD,onnect message in case of d!i&e test measu!ement" *o! OSS 1ANAP: 1A0
Assignment 1esponse message f!om the 1N, to co!e Net$o!( is conside!ed as a call successful
setup"
Table /$ CS4 0ccess 2ailure +ate KPI
PreLaunc% Launc% PostLaunc%
5 .(6 7 5 .(6 7 5 .(6 7
/(1(8 ,S< 7!op
,i!cuit S$itched <oice 7!op measu!es the Net$o!(#s inabilit/ to maintain a call" ,S< 7!op is
defined as the !atio of abno!mal speech disconnects% !elati&e to all speech disconnects 'both no!mal
and abno!mal)"
A no!mal disconnect is initiated b/ a 1A0 7isconnect 1ANAP message f!om the 5S, at the
completion of the call" An abno!mal 1A0 disconnect includes 1adio 9in( *ailu!es% U9 o! 79
inte!fe!ence o! othe! !eason and can be initiated b/ eithe! UT1AN o! ,N"
#1uation /$ CS4 'ro* +ate ,Counter 2ormula-

144H
1
]
1
,
_
$ % R& ' $ % R& '

$ % R& '
1
CSV lease l RA.Abn!rma CSV lease RA.,!rmal
CSV lease ,!rmal RA.
144H
1
]
1
,
_
+,C&--$ S/&&01%U)* R+2R&-&+4& /.N5S:4)&. +,C&--$ S/&&01%U)* R+2R&-&+4& /.N5N5*.+-

+,C&--$ S/&&01%U)* R+2R&-&+4& /.N5N5*.+-
1
,ounte! 7esc!iption
*mNoSystem+ab+eleaseS*eec% Numbe! of s/stem 1A0 !eleases 'Speech 12"2( and
A51 Na!!o$ 0and) fo! the best cell in the Acti&e Set"
*mNoNormal+ab+eleaseS*eec% Numbe! of no!mal 1A0 !eleases 'Speech 12"2( and
A51 Na!!o$ 0and) fo! the best cell in the Acti&e Set"
Table 8$ CS4 'ro* Term 'efinition
Ke/ Pe!fo!mance ndicato! Te!m 7efinition
#RABNormalRelease(CSV) Numbe! of &oice 1A0 no!mall/ !eleased
#RABAbnormalRelease(CSV) Numbe! of &oice 1A0 abno!mall/ !eleased
#1uation 8$ CS4 'ro* +ate ,'rive Test 2ormula-
11 of 34
Calls CSV
Calls CSV
uccess CallSetupS
d Call0r!ppe
e CSV0r!pRat
8
8
( 1##
An/ ,S< call successfull/ handed o&e! f!om =2 to 22 net$o!( $ithin the ,S< Se!&ice A!ea shall be
conside!ed as d!op call fo! 5ilestone 2"
Table 9$ CS4 'ro* +ate KPI
5 .(6 7 5 .(6 7 5 .(67
/(1(9 ,S< Aualit/
<oice .ualit/ shall be measu!ed b/ 09E1
#1uation 9$ CS4 UL :uality ,Counter 2ormula-
144H
$ % '
$ % '
Speech !mbinin( Selecti!nC A$ter )plin% In .l!c%s p!rt 7!tal7rans
Speech !mbinin( Selecti!nC A$ter )plin% In .l!c%s 7ransp!rt Fault#
U9 09E1 is also a&ailable as a&e!age o&e! the $hole 1epo!ting pe!iod '1@ minutes) as a counte!
desc!ibed in the follo$ing fo!mula using 1N, based counte!s:
144H
3; -<U&R0 )B-50=4A0U /.T*+,4/5*
3; R0 0=4A0U-<U& +,4/5*)B-5 /.F+6-):T*
3
3
i '&alue of Ue1c) 1adio ,onnection ,onfigu!ation

2 ,on&entional ,S Speech '12"2D12"2 (bps)
== ,on&entional ,S Speech A51 'G"B@DG"B@ (bps)
=3 ,on&entional ,S Speech A51 '@"BD@"B (bps)
=@ ,on&entional ,S Speech A51 '3"G@D3"G@ (bps)
5easu!ement !esults a!e a&ailable e&e!/ 1@ minutes"
U9 .ualit/ shall be measu!ed in all th!ee '=) 5ilestones 'P!e:9aunch% 9aunch and Post 9aunch)
This KP shall be measu!ed at 1? 09E1 ope!ating point set in UT1AN fo! &oice call"
U9 09E1 is collected and p!esented in the 511:+ '5easu!ement 1esults 1eco!ding +,75A)
featu!e in OSS:1," 1epo!ting pe!iod can be set to bet$een 2 to F3 seconds acco!ding to standa!d"
,ounte!s a!e p!esented in a P7* fo!mat in 511:+" n 2 seconds the!e a!e 144 bloc(s" 1esolution
fo! the P7* is 4"@?" Note that using &e!/ sho!t sampling inte!&als fo! 09E1 measu!ements $ill
!esult in lo$ accu!ac/ fo! each sample"
Table ;$ CS4 UL :uality Terms 'efinition
#Faulty Transport Blocks in plink a!ter
SelectionCombining (Speec")
Numbe! of fault/ Uplin( 7,E t!anspo!t bloc(s fo!
speech afte! selection and combining" Sampling
pe!iod shall be e&e!/ ten '14) seconds"
12 of 34
#Total Transport Blocks in plink a!ter
SelectionCombining (Speec")
Total numbe! of Uplin( 7,E t!anspo!t bloc(s fo!
speech afte! selection and combining" Sampling
pe!iod shall be e&e!/ ten '14) seconds"
#1uation ;$ CS4 'L :uality ,'rive Test 2ormula-
144H
$ % '
$ % '
Speech nin( A$terC!mbi 0!wnlin% In .l!c%s p!rt 7!tal7rans
Speech nin( A$terC!mbi 0!wnlin% In .l!c%s 7ransp!rt Fault#
,P fo! 1ES is found unde! 1AN Pe!fo!mance 5anagement !adio En&i!onment Statistics:
USE1 7ES,1PTON 14FD1@@=:ES7 141 42D@ Uen 0
79 .ualit/ shall be measu!ed in all th!ee '=) 5ilestones 'P!e:9aunch% 9aunch and Post 9aunch)
This KP shall be measu!ed at 1? 09E1 ope!ating point set in UT1AN fo! &oice call"
09E1 shall be a&ailable using counte!s $ith ,ell 9e&el g!anula!it/" KP fo! 5S= shall be calculated
at 5a!(et 9e&el" *o! 5S=% 79 09E1 shall be measu!ed using 1ES counte!s o! d!i&e test as
!e.ui!ed"
79 09E1 is !epo!ted b/ the mobile acco!ding to =2PP specification" 5easu!ement !epo!ts a!e
collected and p!esented in the 511:+ featu!e in OSS:1," 1epo!ting pe!iod can be set to bet$een
2 to F3 seconds acco!ding to standa!d" ,ounte!s a!e p!esented in a P7* fo!mat in 511:+" n 2
seconds the!e a!e 144 bloc(s"
1esolution fo! the P7* is 4"@?" Note that using &e!/ sho!t sampling inte!&als fo! 09E1
measu!ements $ill !esult in lo$ accu!ac/ fo! each sample"
Table <$ CS4 'L :uality Terms 'efinition
#Faulty Transport Blocks in #o$nlink
a!ter Combining (Speec")
Numbe! of fault/ 7o$nlin( 7,E t!anspo!t bloc(s
fo! speech afte! combining" Sampling pe!iod
shall be e&e!/ t$o '2) seconds o! less"
#Total Transport Blocks in #o$nlink a!ter
Combining (Speec")
Total numbe! of 7o$nlin( 7,E t!anspo!t bloc(s
fo! speech afte! combining" Sampling pe!iod shall
be e&e!/ t$o '2) seconds o! less"
#1uation <$ CS4 'L :uality ,'rive Test 2ormula-
Calls CSV
Calls CSV
ples All.9ERSam
et !w.9ER7 Samples.el
t# CSV092uali
8
8
+*>
( 1##
79 .ualit/ shall be measu!ed in all th!ee '=) milestones 'P!e:9aunch% 9aunch and Post 9aunch)
This KP shall be measu!ed at 1? 09E1 ope!ating point set in UT1AN fo! &oice call" The do$nlin( 09E1
&alue shall be collected f!om the UE ha&ing !epo!ting pe!iod of 2 seconds and agg!egated o&e! a pe!iod
of 14 seconds in Post P!ocessing Tool fo! calculation of KP" An/ f!action of 14 seconds shall also be
1= of 34
included in this KP calculation" The 09E1 calculation shall be made f!om the time $hen ,onnect
message is !ecei&ed"
Table =$ CS4 :uality KPI
KPI PreLaunc% Launc% Post Launc%
CS4 :uality ,'L- >9
t%
*ercentile of
sam*les 5 .(6 7
3L#+
>9
t%
*ercentile of
sam*les 5 .(6 7
3L#+
>9
t%
*ercentile of
sam*les 5 .(6 7
3L#+
CS4 :uality ,UL- >9
t%
*ercentile of
sam*les 5 .(6 7
3L#+
>9
t%
*ercentile of
sam*les 5 .(6 7
3L#+
>9
t%
*ercentile of
sam*les 5 .(6 7
3L#+
/(1(; ,S< ,ell ,apacit/
#1uation =$ CS4 Cell Ca*acity ,Counter 2ormula-
ll A(R9'erCa rR9 A('!wer'e
c'!wer Cell7ra$$i
acit# CSVCellCap
(
nel'!wer C!mm!nChan abilit# 0l'!werCap c'!wer Cell7ra$$i .+?

ch'!wer primar#Cpi nel'!wer C!mm!nChan ( @ . 2
7"
#
7"
#
; < 12
; < 12 ( $ @ . # 6 %
i
i
i '!werS$ pm0pchC!de
i '!werS$ pm0pchC!de i
rR9 A('!wer'e
erhead 5and!er+ S!$tS!$ter ll A(R9'erCa
Note the abo&e is an app!oximation as SoftDSofte! Eando&e! O&e!head includes both ,S and PS
connections"
,S< ,ell ,apacit/ shall be calculated based on a&e!age 79 po$e! allocated to A51 12"2 10 fo! this KP"
The abo&e fo!mula is fo! the pu!pose of calculating ,ell ,apacit/ not a guideline fo! 1* PlanningD7esign
pu!poses"
Table >$ Cell Ca*acity 'efinition
CSV CellCapacity A&e!age numbe! of <oice ,alls 'A51 12"2) that can be
suppo!ted b/ cell
CellTra!!ic%o$er Net 79 Po$e! a&ailable in a cell to ca!!/ use! t!affic and
is e.ual to total cell ca!!ie! 1* po$e! 'at s/stem
!efe!ence point) minus ,ommonDsignaling channel
po$e! as pe! 1* Planning 2uidelineD9in( 0udget
AvgRL PerCall A&e!age numbe! of 1adio 9in( used to suppo!t a <oice
,all 'A51 12"2)
A&g%o$er%erR' A&e!age 1* Po$e! used fo! a 1adio 9in( to suppo!t
<oice ,all 'A51 12"2)
#1uation >$ Cell Ca*acity ,'rive Test 2ormula-
13 of 34
ll A(R9'erCa rR9 A('!wer'e
c'!wer Cell7ra$$i
acit# CSVCellCap
(
( 1##
Table 16$ Cell Ca*acity KPI
PreLaunc% Launc% PostLaunc% Units
? 86 ,*rovided it is
ac%ieved in +2
desi!n-
? 86 ,*rovided it is
ac%ieved in +2
desi!n-
? Measure and
re*ort
@ of 0M+1.(. U#As
,S< ,ell ,apacit/ shall be calculated based on a&e!age 79 po$e! allocated to A51 12"2 10 fo! this KP"
The $hole of ,luste!D5a!(et d!i&e data shall be used to calculate this KP"
/(1(< ,S< SoftDSofte! Eando&e! O&e!head
SoftDSofte! Eando&e! O&e!head KP p!o&ides an indication of ho$ man/ ,ells o! Secto!s $e!e in the
acti&e set du!ing the call on an a&e!age basis"
#1uation 16$ SoftBSofter Candover "ver%ead ,Counter 2ormula-
:
AS
:
AS
AS 0urati!n
AS 0urati!n AS
erhead 5and!er+ S!$tS!$ter
1
1
$ %
$ % (
,A0)S&)$ )1"R-4"R-I /.S6.U&4W3 ,A0)S&) )13R-4"R-I /.S6.U&4W3 ,A0)S&) )13R-43R-I /.S6.U&4W3
,A0)S&) )12R-4"R-I /.S6.U&4W3 ,A0)S&) )12R-43R-I /.S6.U&4W3 ,A0)S&) )12R-42R-I /.S6.U&4W3
,A0)S&) )11R-43R-I /.S6.U&4W3 ,A0)S&) )11R-42R-I /.S6.U&4W3 I,A0)S&) 3)11R-41R- %/.S6.U&4W
,A0)S&)$$ )1"R-4"R-I /.S6.U&4W3 ,A0)S&) )13R-4"R-I /.S6.U&4W3 I,A0)S&) 3)12R-4"R- %/.S6.U&4W ( "
,A0)S&)$ )13R-43R-I /.S6.U&4W3 ,A0)S&) )12R-43R-I /.S6.U&4W3 I,A0)S&) 3)11R-43R- %/.S6.U&4W ( 3
,A0)S&)$ )12R-42R-I /.S6.U&4W3 I,A0)S&) 3)11R-42R- %/.S6.U&4W ( 2 I,A0)S&) 3)11R-41R- %/.S6.U&4W
+ + +
+ + +
+ + +
+ + +
+ + +
+ +
erhead 5and!er+ S!$tS!$ter
The counte!s fo! this KP measu!es not onl/ ,S< SoftDSofte! Eando&e! O&e!head fo! all ,S
connections but also fo! PS connections"
The counte!s ha&e a sampling !ate of 1 minute and the counte!s should be agg!egated o&e! a sufficientl/
long pe!iod fo! statistical &alidit/"
Table 11$ SoftBSofter Candover "ver%ead definition
( 5aximum Acti&e Set si6e as defined in 1N,
AS Acti&e Set si6e
#uration(AS) 7u!ation of the call in Acti&e Set si6e of AS 'ASI1 to 5)
1@ of 34
#1uation 11$ SoftBSofter Candover "ver%ead ,'rive Test 2ormula-
:
AS
:
AS
AS 0urati!n
AS 0urati!n AS
5and!er S!$tS!$ter
1
1
$ %
$ % (
Table 1.$ SoftBSofter Candover "ver%ead KPI
5 1(; 5 1(; 5 1(<
/(1(= ,S< nte!:1adio Access Technolog/ Eando&e! *ailu!e
nte!:1adio Access Technolog/ '1AT) Ea!d Eando&e! *ailu!e !ate f!om U5TS and 2S5 S/stem fo!
&oice calls"
#1uation 1.$ CS4 I+0T 2ailure +ate ,Counter 2ormula-
mand !m)tranC!m 5and!erFr
lure !m)tranFai 5and!erFr
ailureRate ;5and!erF ; CSV
'
'
( 1## 2 3
2i!ure /$ I+0T C" Call 2low D CS4 Call
1F of 34
pmNoSuccessOut!atEoSpeech'2sm1elation): the t!igge! is $hen U 1E9EASE ,O55AN7 is
!ecei&ed $ith cause ;No!mal !elease# o! ;Successful !elocation# and based on the ,S 1A0 state"
pmNoAttOut!atEoSpeech'2sm1elation): this counte! is inc!eased $hen 1N, sends EAN7O<E1
*1O5 UT1AN ,O55AN7"
1
]
1

)35,$ 01%G4.R&-+ I*+)H5S/&& /.N5A))O6)
R&-+)35,$ S/&&01%G4. 4O6)I*+)H5 /.N5S600&4
1 ( 1## 2 3 ailureRate ;5and!erF ; CSV
The abo&e fo!mula captu!es speech 12"2( and A51 na!!o$ band"
n o!de! to &e!if/ ,S< 1AT EO pe!fo!mance% some p!e!e.uisites ha&e to be fulfilled such as: definition of
1AT st!ateg/% setting up se!&ices p!io!ities" 0oth =2 and 22 Net$o!(s shall ha&e 1AT neighbo!s
defined" The 2S5 Net$o!( shall ha&e a&ailable !esou!ces $ithout sho$ing congestion" 5utuall/ ag!eed
test UE '$ith the latest a&ailable Soft$a!e% *i!m$a!e and E.uipment) shall be used fo! the 1AT KP
1G of 34
&e!ification" The 22 and =2 Net$o!(s shall be p!ope!l/ configu!ed in acco!dance $ith Pu!chase!#s
Net$o!( design including the definition of the !outing tables th!ough the ,o!e Net$o!(" PU1,EASE1
shall info!m Selle! about maJo! changes in the configu!ation of the 2S5 Net$o!( 'f!e.uenc/ !e:plan% ,ell
pa!amete! changes% etc) that $ill deg!ade the =2 1AT pe!fo!mance. Selle! ma/ !e&ie$ Pu!chase!#s 2S5
Net$o!( changesDplanned acti&ities befo!e% du!ing o! afte! 1AT KP &e!ification d!i&e"
,S< 1AT Ea!d Eando&e! *ailu!e !ate shall be measu!ed b/ a specific d!i&e pe! 5a!(et Unit" The specific
d!i&e shall be a!ound U5TS and 2S5 se!&ice bounda!/" ,S< 1AT EEO failu!e KP does not include
EEO P!epa!ation failu!e" The EEO P!epa!ation failu!e accounts fo! configu!ation mismatch and
a&ailabilit/ of !esou!ces in the 2S5 S/stem"
Table 1/$ CS4 I+0T Term 'efinition
CSV)*+*,an-o&erFailureRate Ea!d Eando&e! failu!e !ate $hen a <oice ,all
fail to hando&e! f!om U5TS net$o!( to 2S5
net$o!(
#,an-o&erFromTRAN !ailure The numbe! of Eando&e! f!om UT1AN *ailu!e
messages sent f!om UE to 1N,
#,an-o&erFromtranComman- The numbe! of Eando&e! f!om UT1AN
command sent b/ 1N, to UE
#1uation 1/$ CS4 I+0T 2ailure +ate ,'rive Test 2ormula-
1
1
1
]
1
Calls CS
Calls CS
5and!er
5and!er
;5and!er ; CSV
8
8
C5..+,A UTRAN F*5.
F+3-6*& UTRAN F*5.
( 1## R+)& F+3-6*& 2 3
T!igge! fo! Eando&e! f!om UT1AN ,ommand is $hen the ,ommand is sent to the UE"
T!igge! fo! Eando&e! f!om UT1AN *ailu!e is $hen it is !ecei&ed f!om the UE"
,S< 1AT EEO failu!e KP does not include EEO P!epa!ation failu!e" Specific d!i&e !oute shall be
identified at the U5TS 1* Se!&ice A!ea bounda!/ to &e!if/ this KP"
Table 18$ CS4 I+0T 2ailure +ate KPI
NB0 5 9(6 7 5 9(67
/(1(> ,S< ,all Setup Time
<oice call set up time indicates Net$o!( !esponse time to a use! !e.uest fo! a &oice
se!&ice" This KP is applicable onl/ fo! d!i&e test"
#1uation 18$ CS4 Call Setu* Time ,'rive Test 2ormula-
Voice Call setup time . CC/Alerting((0C) 1 RRC Connection Request((0C)
*o! mobile to mobile call% calling UE shall be mobile and called UE shall be stationa!/"
Table 19$ CS4 Call Setu* time KPI
18 of 34
4oice Call Setu* time
,Mobile to PSTN-
>9
t%
*ercentile 5 ;
seconds
>9
t%
*ercentile 5 ;
seconds
>9
t%
*ercentile
5 ; seconds
4oice Call Setu* time
,Mobile to Mobile-
>9
t%
*ercentile 5 >
seconds
>9
t%
*ercentile 5 >
seconds
>9
t%
*ercentile
5 > seconds
Selle! ag!ees to the B@
th
pe!centile p!o&ided the impact of non UT1AN E.uipment is $ithin the indust!/
t/pical &alue !ange"
/(1(16 ,S7 Access *ailu!e
Access failu!e is the p!oduct of the 11, ,onnection *ailu!e% NAS setup failu!e and the 1A0
Establishment *ailu!e" 11, ,onnection Success is counted $hen the 1N, !ecei&es a 11, Setup
,omplete f!om the UE" NAS Setup is conside!ed successful $hen the signaling messages in the
call flo$ du!ing call setup flo$ is successfull/ completed b/ !ele&ant Net$o!( elements" A 1A0 is
conside!ed successfull/ established $hen the 1A0 Assignment 1esponse is sent b/ 1N, to the
,N"
#1uation 19$ CS' 0ccess 2ailure +ate ,Counter 2ormula-
144H
1
]
1
,
_
$ % R& '
$ % R& '
(
'
'
(
'
'
1
CS0 "uest Assi(nment RA.
CS0 sp!nse ent RA.Assi(nm
SR.Attempt
SR.Success
Attempt C!nnecti!n RRC
Success C!nnecti!n RRC
The follo$ing fo!mula includes both ,on&entional ,S F3DF3 (bps and St!eaming ,S @G"FD@G"F (bps:
144H
1
1
1
1
1
]
1
,
_
+
+
*+,C&--$ ./)C4@7%U) +2-341A))& /.N5R+2E4)

*+,C&--$ ./)C46"%U) +2-341A))& /.N5R+2E4)
*+,C&--$ &44C4@7%U) +2-341S600 /.N5R+2E4)
*+,C&--$ &44C46"%U) +2-341S600 /.N5R+2E4)
( !!!3 . # (
--$ C4%U)*+,C& C5,,&0)R&7 /.T5)N5R*0
+,C&--$ C4S600%U)* C5,,&0)R&7 /.T5)N5R*0
1
*o! an inte!im solution% it shall be defined as a d!op !ate of 2? o&e! an a&e!age call length of B4
PG"
Table 1;$ CS' 0ccess Term 'efinition
#RRCConnectionSuccess The numbe! of successful 11, ,onnection
Setups $ith ,on&e!sational and St!eaming
,all Establishment ,auses 'both o!iginating
and te!minating)"
#RRCConnectionAttempt The numbe! of 11, ,onnection 1e.uest
5essages !ecei&ed $ith ,on&e!sational and
St!eaming ,all Establishment ,auses 'both
o!iginating and te!minating)"
1B of 34
#RABAssignmentResponse (CS#) The numbe! of 1ANAP: 1A0 Assignment
1esponse messages sent f!om the 1N, to
the 5S, fo! ,S7"
#RABAssignmentRequest(CS#) The numbe! of 1ANAP: 1A0 Assignment
1e.uest messages sent f!om the 5S, to the
1N, to establish a ,S7 call"
# SRBAttempt The numbe! of 11, ,onnection ,omplete
that $ill lead to an nitial 7i!ect T!ansfe! to
the ,S domain and $ill also lead to a ,S7
1A0 Assignment 1e.uest"
# SRBSuccess The numbe! of ,S7 1A0 Assignment
1e.uests
#1uation 1;$ CS' 0ccess 2ailure +ate ,'rive Test 2ormula-
1
1
1
]
1
,
_
Calls CS0
Calls CS0
C!nnect Alertin( CC
ate Failure R CS0 Access
8
8
R&
9 8
1 ( 1##
n case the!e a!e se&e!al consecuti&e 11, ,onnection 1e.uests onl/ the fi!st 11, connection
!e.uest $ill be ta(en into account fo! the KP calculation"
Table 1<$ CS' 0ccess 2ailure +ate KPI
5 /(67 5 .(6 7 5 .(6 7
/(1(11 ,S7 7!op
#1uation 1<$ CS' 'ro* ,Counter 2ormula-
144H
1
]
1
,
_
$ % R& ' $ % R& '

$ % R& '
1
CS0 lease l RA.Abn!rma CS0 lease RA.,!rmal
CS0 lease ,!rmal RA.
The follo$ing fo!mula includes both ,on&entional ,S F3DF3 (bps and St!eaming ,S @G"FD@G"F (bps"
144H
1
1
1
1
1
]
1
,
_
+ +
+
+
)*+,C&--$ C4S)*&+.%U R+2R&-&+4& /.N5S:4)&. )*+,C&--$ C4S)*&+.%U R+2R&-&+4& /.N5N5*.+-

C&--$ C46"%U)*+, R+2R&-&+4& /.N5S:4)&. C&--$ C46"%U)*+, R+2R&-&+4& /.N5N5*.+-
)*+,C&--$ C4S)*&+.%U R+2R&-&+4& /.N5N5*.+- C&--$ C46"%U)*+, R+2R&-&+4& /.N5N5*.+-
1
Table 1=$ CS' 'ro* Term 'efinition
24 of 34
#RABNormalRelease(CS#)
Numbe! of &ideo 1A0s ',on&e!sational and
st!eaming) no!mall/ !eleased
#RABAbnormalRelease(CS#)
Numbe! of &ideo 1A0s ',on&e!sational and
st!eaming) abno!mall/ !eleased
#1uation 1=$ CS' 'ro* ,'rive Test 2ormula-
Calls CS0
Calls CS0
Success CallsSetup
Calls0r!p
0r!pRate CS0
8
8
( 1## 8
Table 1>$ CS' 'ro* +ate KPI
5 .(9 7 5 .(9 7 5 /(6 7 ,Usin! Counter met%od-
5 .(9 7 ,Usin! 'rive Test met%od-
/(1(1. ,S7 Aualit/
This e.uation is simila! to that of ,S<K ho$e&e! it is specific fo! ,S7 1A0"
#1uation 1>$ CS' :uality ,UL-
144H
$ % '
$ % '
CS0 )plin% in(In ti!nC!mbin A$terSelec .l!c%s p!rt 7!tal7rans
CS0 )plin% in(In ti!nC!mbin A$terSelec .l!c%s 7ransp!rt Fault#
144H
3; -<U&R0 )B-50=4A0U /.T*+,4/5*
3; R0 0=4A0U-<U& +,4/5*)B-5 /.F+6-):T*
i '&alue of Ue1c) 1adio ,onnection ,onfigu!ation

= ,on&e!sational ,S F3DF3 (bps
8 St!eaming ,S@G"F (bps
U9 .ualit/ shall be measu!ed in all th!ee '=) 5ilestones 'P!e:9aunch% 9aunch and Post 9aunch)
5easu!ement !esults a!e a&ailable e&e!/ 1@ minutes"
09E1 shall be a&ailable using counte!s $ith ,ell 9e&el g!anula!it/"
U9 09E1 is collected and p!esented in the 511:+ '5easu!ement 1esults 1eco!ding +,75A)
featu!e in OSS:1," 1epo!ting pe!iod can be set to bet$een 2 to F3 seconds acco!ding to standa!d"
,ounte!s a!e p!esented in a P7* fo!mat in 511:+" n 2 seconds the!e a!e 144 bloc(s" 1esolution
fo! the P7* is 4"@?" Note that using &e!/ sho!t sampling inte!&als fo! 09E1 measu!ements $ill
!esult in lo$ accu!ac/ fo! each sample"
E.uation 24: ,S7 79 Aualit/ ',ounte! *o!mula)
144H
$ % '
$ % '
CS0 nin( A$terC!mbi In0!wnlin% p!rt.l!c%s 7!tal7rans
CS0 inin( %A$terC!mb sIn0!wnlin sp!rt.l!c% Fault#7ran
21 of 34
79 09E1 is !epo!ted b/ the mobile acco!ding to =2PP specification" 5easu!ement !epo!ts a!e
collected and p!esented in the 511:+ featu!e in OSS:1," 1epo!ting pe!iod can be set to bet$een
2 to F3 seconds acco!ding to standa!d" ,ounte!s a!e p!esented in a P7* fo!mat in 511:+" n 2
seconds the!e a!e 144 bloc(s"
1esolution fo! the P7* is 4"@?" Note that using &e!/ sho!t sampling inte!&als fo! 09E1
measu!ements $ill !esult in lo$ accu!ac/ fo! each sample"
,P fo! 1ES is found unde! 1AN Pe!fo!mance 5anagement !adio En&i!onment Statistics
79 .ualit/ shall be measu!ed in all th!ee '=) 5ilestones 'P!e:9aunch% 9aunch and Post 9aunch $ith
optional featu!e fo! UE to !epo!t 79 09E1 measu!ement)
09E1 shall be a&ailable using counte!s $ith ,ell 9e&el g!anula!it/" KPs at 5S= shall be calculated
at 5a!(et 9e&el"
Table .6$ CS' :uality Terms 'efinition
#FaultyTransportBlocks2nplink
A!terSelectionCombining(CS#)
Numbe! of fault/ Uplin( 7,E t!anspo!t bloc(s fo! ,S7
afte! selection and combining" Sampling pe!iod shall be
e&e!/ ten '14) seconds
#TotalTransportBlocks2nplinkA!terS
electionCombining(CS#)
Total numbe! of Uplin( 7,E t!anspo!t bloc(s fo! ,S7
afte! selection and combining" Sampling pe!iod shall be
e&e!/ ten '14) seconds "
#FaultyTransportBlocks2n#o$nlinkA!t
erCombining(CS#)
Numbe! of fault/ 7o$nlin( 7,E t!anspo!t bloc(s fo!
,S7 afte! combining" Sampling pe!iod shall be e&e!/
ten '14) seconds
#TotalTransportBlocks2n#o$nlinkA!te
rCombining(CS#)
Total numbe! of 7o$nlin( 7,E t!anspo!t bloc(s fo!
,S7 afte! combining" Sampling pe!iod shall be e&e!/
ten '14) seconds
#1uation .1$ CS' :uality 'L ,'rive Test 2ormula-
Calls CS0
Calls CS0
ples All.9ERSam
et !w.9ER7 Samples.el
09 CS02ualit#
8
8
+*>
( 1##
79 .ualit/ shall be measu!ed in all th!ee '=) 5ilestones 'P!e:9aunch% 9aunch and Post 9aunch)
Table .1$ CS' :uality KPI
CS' :uality
,'L-
>9
t%
*ercentile of
sam*les 5 17 3L#+
>9
t%
*ercentile of
sam*les 517 3L#+
>9
t%
*ercentile of
sam*les 5 17 3L#+
CS' :uality
,UL-
>9
t%
*ercentile of
sam*les 5 17 3L#+
>9
t%
*ercentile of
sam*les 5 173L#+
>9
t%
*ercentile of
sam*les 5 173L#+
This KP $ill be measu!ed at 4"= ? 09E1 ope!ating point set in UT1AN fo! ,S <ideo ,all"
/(1(1/ ,S7 ,all Setup time
,i!cuit S$itched 7ata call set up time indicates Net$o!( !esponse time to a use! !e.uest fo! a &ideo
se!&ice" The test shall be initiated b/ ma(ing a &ideo call f!om one U5TS UE to anothe! U5TS UE"
22 of 34
n case of multiple 11, connection !e.uests the fi!st 11, connection !e.uest $ill be ta(en into
account fo! KP calculation"
#1uation ..$ Mobile to Mobile 4ideo call ,'rive Test 2ormula-
Vi-eo Call setup time . CC/Alerting ((0C) 1 RRC Connection Request ((0C)
Table ..$ CS' Call Setu* time KPI
Parameter PreLaunc% Launc%
4ideo Call Setu* time N(0 >9
t%
*ercentile 5 > seconds
th
pe!centile and B seconds p!o&ided the impact of non UT1AN E.uipment is $ithin
the indust!/ t/pical &alue !ange"
Packet Switc%ed Level1 Key Performance Indicators
1BB 79 1A0 allo$ed: =83 (bps%128 (bps% and F3 (bps% onl/
1BB U9 1A0 allo$ed: =83 (bps% F3 (bps onl/
ES7PA 79 ES:7S,E allo$ed: UE ,at 12 '1844 (bps)
ESUPA U9 allo$ed: UE ,at = '1"3@4 5bps)
/(1(18 Pac(et S$itched ,all Setup
*igu!e 3 is a flo$ diag!am fo! a PS call" f a p!oblem occu!s bet$een 11, ,onnection 1e.uest
'step 1) and the 1A0 Assignment 1esponse 'step 2G)% the !esult is conside!ed Access *ailu!e" An/
1A0 abno!mal !elease afte! the 1A0 Assignment 1esponse is conside!ed a call 7!op"
2= of 34
2i!ure 8$ Packet Switc%ed Setu* 2low 'ia!ram
/(1(19 PS7 Access *ailu!e
The aim is to measu!e Pac(et S$itch 7ata access failu!e f!om a use! pe!specti&e"
#1uation ./$ PS' 0ccess 2ailure +ate ,Counter 2ormula-
144H
1
]
1
,
_
$ % R& '
$ % R& '
(
'
'
(
R& '
'
1
'S0 "uest ent RA.Assi(nm
'S0 sp!nse ent RA.Assi(nm
SR.Attempt
SR.Success
C!mplete C!nnecti!n RRC
The follo$ing fo!mula includes Pac(et nte!acti&e and Pac(et 0ac(g!ound" Please !efe! to Section F
of the ,P document Use! 7esc!iption ,onnection Eandling 3D1@@=:ES7 141 42D@ Uen"
23 of 34
144H
1
]
1
,
_
Rate ishSuccess eRA.Establ Interacti R!! ( !!!3 . # (

--$ P4%U)*+,C& C5,,&0)R&7 /.T5)N5R*0
+,C&--$ P4S600%U)* C5,,&0)R&7 /.T5)N5R*0
1
R!!I,)&*+0)3B&RABE4)+2-341S600&44R+)& &76+-4C
,C&--$ 8F-5D%U)*+ HS28H+*AHO -
--$ H4%U)*+,C& ,)&*+0)3B& ./)P+0=&)I +2-341A))& /.N5R+2E4) - $ %U)*+,C&-- ,)&*+0)3B& ./)P+0=&)I +2-341A))& /.N5R+2E4)
--$ H4%U)*+,C& ,)&*+0)3B& &44P+0=&)I +2-341S600 /.N5R+2E4) - $ %U)*+,C&-- ,)&*+0)3B& &44P+0=&)I +2-341S600 /.N5R+2E4)
+,AE
HS28H+*AHO8F-5D%U)*+,C&--$ F /.O6)>53,>H4H+*AH5A))&./)%U)*+,C&--$ G
/.N5H4H+*AH5R&)6*,O-AC1S56*0&%U)*+,C&--$ G /.I,05.3,H4H+*AH5A))&./)%U)*+,C&--$
*o! an inte!im solution% it shall be defined as a d!op !ate of 2? o&e! an a&e!age call length of B4
f du!ing the deplo/ment fault !ates highe! than 4"1? a!e obse!&ed% selle! shall de&elop counte!s in
PG"
0oth nte!acti&e and 0ac(g!ound t!affic a!e included in the counte! based fo!mula abo&e"
Table ./$ PS' 0ccess 2ailure Term 'efinition
#RRCConnectionComplete The numbe! of successful 11, ,onnection
Setups $ith PS7 Establishment ,auses 'both
o!iginating and te!minating)"
#RRCConnectionRequest The numbe! 11, ,onnection 1e.uest
5essages !ecei&ed $ith PS7 Establishment
,auses 'both o!iginating and te!minating)"
#RABAssignmentResponse (%S#) The numbe! of 1ANAP: 1A0 Assignment
the S2SN PS se!&ice"
#RABAssignmentRequest(%S#) The numbe! of 1ANAP: 1A0 Assignment
1e.uest messages sent f!om the S2SN to
the 1N, to establish PS Se!&ice"
#SRBAttempt The numbe! of 11, ,onnection ,ompletes
the PS domain and $ill also lead to a PS
'1BB) 1A0 Assignment 1e.uest"
#SRBSuccess The numbe! of PS 1BB 1A0 Assignment
1e.uests"
#1uation .8$ PS' 0ccess 2ailure +ate ,'rive Test 2ormula-
2@ of 34
1
1
1
]
1
Calls 'S0
Calls 'S0
'0'
ate Failure R 'S0 Access
8
8
R&
A00&/) C5,)&?) A0)3B+)&
1 ( 1##
Access *ailu!e 1ate shall be measu!ed b/ data session acti&ation 'PS) follo$ed b/ do$nload" n case of
multiple 11, connection !e.uests the fi!st 11, connection !e.uest $ill be conside!ed fo! KP calculation"
Table .8$ PS' 0ccess 2ailure +ate KPI
5 .(6 7 5 .(6 7 5 .(6 7
/(1(1; PS7 7!op
Pac(et session is conside!ed as d!opped $hen associated 1A0 has been !eleased abno!mall/ b/
eithe! UT1AN o! ,N" An/ d!op afte! 1ANAP: 1A0 Assignment 1esponse is conside!ed as PS d!op
call"
#1uation .9$ PS' 'ro* +ate ,Counter 2ormula-
144H
$ % '
$ % '
'S0 mplete RA.SetupC!
'S0 RA.0r!p
144H
1
]
1
,
_
,)&*+0)3B& &44P+0=&)I +2-341S600 /.N5R+2E4)

P+0=&) R+2R&-&+4& /.N5S:4)&.
The fo!mula abo&e calculates d!op !ate fo! Pac(et nte!acti&e and Pac(et 0ac(g!ound 'including ES7PA)"
T!affic classes 0ac(g!ound% and nte!acti&e 'both o!iginating and te!minating) shall be conside!ed in
counte!:based met!ics"
Table .9$ PS' 'ro* Term 'efinition
#RABSetupComplete The numbe! of completed 1A0 setup phase
fo! PS 7ata% $hen the 1N, sends 1ANAP:
1A0 Assignment 1esponses to ,o!e Net$o!(
afte! a successful 1A0 establishment
#RAB#rop The numbe! of 1A0 7!op fo! PS data calls
#1uation .;$ PS' 'ro* +ate ,'rive Test 2ormula-
1
1
1
]
1
$tpSessi!n
$tpSessi!n
uccess CallSetupS
dSuccess $tp0!wnl!a
pRate 'S0Call0r! 1 ( 1##
PS7 d!op 1ate shall be measu!ed afte! sta!t of ftp do$nload " PS7 call is conside!ed as d!opped
$hen ftp session is manuall/Dabno!mall/ disconnected $ithout completing file t!ansfe! due to an/
!eason"
2F of 34
Table .;$ $ PS' 'ro* +ate KPI
5 .(9 7 5 .(67 5 .(6 7
/(1(1< PS7 9atenc/
The follo$ing is ext!acted f!om =2PP Specification 2="14G% Section F"3"="1 fo! !efe!ence:
Transfer delay ,ms-
'efinition: ndicates maximum dela/ fo! B@
th
pe!centile of the dist!ibution of dela/ fo! all deli&e!ed
S7Us du!ing the lifetime of a bea!e! se!&ice% $he!e dela/ fo! an S7U is defined as the time f!om a
!e.uest to t!ansfe! an S7U at one SAP to its deli&e!/ at the othe! SAP"
N"T# /$ T!ansfe! dela/ of an a!bit!a!/ S7U is not meaningful fo! a bu!st/ sou!ce% since the last
S7Us of a bu!st ma/ ha&e long dela/ due to .ueuing% $he!eas the meaningful !esponse dela/
pe!cei&ed b/ the use! is the dela/ of the fi!st S7U of the bu!st"
Table .<$ PS' Latency Term 'efinition
%S# 'atency
1ound t!ip time fo! a =2 0/tes ping fo! an/
1BB PS 1A0
9atenc/ $ill be measu!ed $ith the destination se!&e! fo! ping connected di!ectl/ to the 22SN 'i"e"
the se!&e! on the same nt!anet domain as 22SN)" 1TT $ill be measu!ed in stationa!/ position"
This test $ill be done $ith a single UE $ith 1BB 1A0 PS call $ith Ping application"
Table .=$ PS' Latency KPI
Latency at Launc% +03
>9
t%
*ercentile 5 .66 ms +>> +03 ,;8 Kb*s or 1.= Kb*s or /=8 Kb*s-
th
pe!centile and the 244ms p!o&ided the impact of non UT1AN E.uipment is $ithin
/(1(1= PS7 Th!oughput
Total numbe! of 19, bloc(s sent o&e! the obse!&ation $indo$ including !e:t!ansmission pe!
t!anspo!t t/pe"
#1uation .<$ PS' 0vera!e T%rou!%*ut ,Counter 2ormula-
Call 'S0
Call 'S0
0urati!n S0) R9C A:
%b 0ata S0) R9C A:
hput )ser7hr!u(
8
8
8 8 8
$ % 8 8 8
The abo&e fo!mula is applicable fo! both 7o$nlin( and Uplin(
$ %
$ %
)tranCell r'ac%et7hp ct0lRlc)se pmSamplesA
)tranCell %et7hp Rlc)ser'ac pmSumAct0l
u(hput 0l)ser7hr!
$ %U)*+,C&-- *P+0=&)T1/ 0)U-R-0U4& /.S+./-&4A
+,C&--$ =&)T1/%U)* R-0U4&*P+0 /.S6.A0)U-
u(hput )l)ser7hr!
2G of 34
This met!ic shall be measu!ed onl/ fo! Pac(et S$itch T!affic ,lass 'nte!acti&e and 0ac(g!ound)"
KP 5easu!ement shall be based on 19, 'S7U) la/e! th!oughput $ith fi&e pe!cent '@?) ta!get fo!
79DU9 09E1 fo! 1BB 1A0"
Table .>$ PS' 0vera!e T%rou!%*ut Term 'efinition
A(/R'C/S#/#ata(kb) Total A5 19, S7Us '(b) t!ansfe!!ed excluding !e:
t!ansmission in the do$nlin( o! uplin(
#lserT"roug"put 7o$nlin( A&e!age Pac(et data th!oughput '(bps)
A(/R'C/S#/#uration The total 19, S7U t!ansmission du!ation in seconds" *o!
79DU9% this excludes the pe!iod $hen the 79DU9
t!ansmission buffe! fo! the 19, entit/ is empt/
#1uation .=$ PS' 0vera!e T%rou!%*ut ,'rive Test 2ormula-
Call 'S0
Call 'S0
ati!n Sessi!n0ur
%b ans$erred )ser0ata7r
%bps u(hput 'S0A(7hr!
8
8
%4&0$
$ %
$ %
*o!mula is &alid fo! uplin( and do$nlin("
KP 5easu!ement shall be fo! application la/e! th!oughput $ith fi&e:pe!cent '@?) ta!get 79DU9
09E1 ope!ating point fo! 1BB 1A0" Th!oughput shall be calculated using data f!om the enti!e
,luste!D 5a!(et d!i&e test fo! 5ilestone 1 and 5ilestone 2"
The do$nloadDupload file shall be comp!essed t/pe"
Table /6$ PS' 0vera!e T%rou!%*ut 'efinition
ser#ataTrans!erre-(kb) *TP do$nload in (ilo:bit du!ing one session"
Session#uration(sec) Time du!ation 'seconds) to do$nloadDupload a file"
%S#/T"roug"put(kbps) Pac(et data th!oughput in (bps using 1BB 1A0
measu!ed at application la/e!"
Table /1$ PS' 0vera!e 'L T%rou!%*ut KPI
0vera!e 'L t%rou!%*ut
,Unloaded- kb*s
? .86 ? .86 ? 196 ,Counter-
? .86 ,'rive Test-
0vera!e 'L T%rou!%*ut
,Loaded- kb*s
? .16 ? .16 ? 196 ,Counter-
? .16 ,'rive Test-
Table /.$ PS' 0vera!e UL T%rou!%*ut KPI
28 of 34
0vera!e UL t%rou!%*ut
,Unloaded- kb*s
? .66 ? .66 ? 196 ,Counter-
? .66 ,'rive Test-
0vera!e UL T%rou!%*ut
,Loaded- kb*s
? 1=6 ? 1=6 ? 196 ,Counter-
? 1=6 ,'rive Test-
KP 5easu!ement shall be fo! application la/e! th!oughput $ith fi&e:pe!cent '@?) 09E1 ope!ating
point fo! both U9 and 79" Th!oughput shall be calculated using data f!om the enti!e ,luste!D 5a!(et
d!i&e test fo! 5ilestone 1 and 5ilestone 2 using all a&ailable 1BB 1adio 0ea!e!"
Table //$ PS' 0vera!e T%rou!%*ut 'efinition
ser#ataTrans!erre-(kb) Total ftp si6e do$nload in (ilo:bit in one session
Session#uration(sec) Total time 'seconds) du!ation to do$nload single
fileSession7u!ation'sec) I 'time stamp of Session End o!
Session E!!o! - time stamp of Session Sta!t)
%S#A&gT"roug"put Pac(et S$itched 7ata a&e!age th!oughput using 1BB 1A0
measu!ed at application la/e!
/(1(1> PS7 ,all Setup Time
PS7 call setup time indicates Net$o!( !esponse time to a use! !e.uest fo! a pac(et data se!&ice" n
case of multiple 11, connection !e.uests the fi!st 11, connection !e.uest $ill be conside!ed fo!
KP calculation"
#1uation .>$ PS' Call Setu* Time ,'rive Test 2ormula-
%S Call setup time . %#% Conte3t Acti&ation accept ((0C) 4 RRC Connection Request ((0C)
The UE is al!ead/ attached to the UT1AN net$o!("
Table /8$ PS' Call Setu* time KPI
KPI PreLaunc% 0t Launc% Post Launc%
PS' Session
0ctivation time
N(0 >9
t%
*ercentile
sessions 5 9
seconds
N(0
th
pe!centile and the @ seconds p!o&ided the impact of non:UT1AN E.uipment is
$ithin the indust!/ t/pical &alue !ange"
/(1(.6 PS7 nte!:1adio Access Technolog/ Eando&e! *ailu!e
nte!:1adio Access Technolog/ '1AT) is a ha!d hando&e! bet$een U5TS and 2S5"
*o! Pac(et S$itched hando&e!% the 1N, sends a ,ell ,hange O!de! f!om UT1AN command to the
UE" A successful hando&e! can be monito!ed b/ the 1N, u 1elease message f!om the ,N"
#1uation /6$ PS' I+0T 2ailure +ate ,counter formula-
d 7RA,C!mman +rderFr!m) CellChan(e
e 7RA,Failur +rderFr!m) CellChan(e
te rFailureRa ;'S5and!e ;
'
'
( 1## 2 3
2B of 34
pmNoOut!at,c1etu!nOld,h is inc!eased $hen the ,E99 ,EAN2E O17E1 *1O5 UT1AN
*A9U1E '11,) message is !ecei&ed f!om the UE"
pmNoOut!at,cAtt is inc!eased $hen the ,E99 ,EAN2E O17E1 *1O5 UT1AN '11,) message
has been sent to the UE"
R&-+)35,$ )C0A))%G4. /.N5O6)I*+
-+)35,$ -AC1%G4.R& )C0R&)6*,O /.N5O6)I*+
( 1## 2 3 te rFailureRa ;'S5and!e ;
PS7 1AT EEO failu!e KP does not include EEO P!epa!ation failu!e"
n o!de! to &e!if/ PS7 1AT EO pe!fo!mance% some p!e!e.uisites ha&e to be fulfilled such as: definition of
1AT st!ateg/% setting up se!&ices p!io!ities" 0oth =2 and 22 Net$o!(s shall ha&e 1AT neighbo!s
defined" The 2S5 Net$o!( shall ha&e a&ailable !esou!ces $ithout sho$ing congestion" 5utuall/ ag!eed
test UE '$ith the latest a&ailable Soft$a!e% *i!m$a!e and E.uipment) shall be used fo! the 1AT KP
&e!ification" The 22 and =2 Net$o!(s shall be p!ope!l/ configu!ed in acco!dance $ith Pu!chase!#s
Net$o!( design including the definition of the !outing tables th!ough the ,o!e Net$o!(" PU1,EASE1
shall info!m Selle! about maJo! changes in the configu!ation of the 2S5 Net$o!( 'f!e.uenc/ !e:plan% ,ell
pa!amete! changes% etc) that $ill deg!ade the =2 1AT pe!fo!mance. Selle! ma/ !e&ie$ Pu!chase!#s 2S5
Net$o!( changesDplanned acti&ities befo!e% du!ing o! afte! 1AT KP &e!ification d!i&e"
Table /9$ PS' I+0T 2ailure Term 'efinition
)*+*%S,an-o&erFailureRate Ea!d Eando&e! failu!e !ate $hen a PS 7ata call
'1BB) fail to hando&e! f!om U5TS net$o!( to
2S5 net$o!(
#CellC"ange0r-erFromTRAN Failure(%S) 11,: The numbe! of ,ell ,hange O!de! f!om
UT1AN *ailu!e messages f!om UE to 1N,
#CellC"ange0r-erFromTRAN Comman-(%S) 11,: The numbe! of ,ell ,hange O!de!
5essages f!om 1N, to UE
#1uation /1$ PS' I+0T 2ailure +ate ,'rive Test 2ormula-
Call 'S0
Call 'S0
R,C d 7RA,C!mman +rderFr!m) CellChan(e
)E e 7RA,Failur +rderFr!m) CellChan(e
;'S55+ ;
8
8
8
8
( 1## & F+3-6*&R+) 2 3
11,,ell,hangeO!de!*!omUT1AN*ailu!eLUE message is sent b/ UE"
11,,ell,hangeO!de!*!omUT1AN,ommandL1N, message is sent b/ 1N,"
PS7 1AT EEO failu!e KP does not include EEO P!epa!ation failu!e" Specific d!i&e !oute shall be
identified at the U5TS 1* Se!&ice A!ea bounda!/ to &e!if/ this KP"
Table /;$ PS' I+0T 2ailure +ate KPI
NB0 5 9(6 7 5 9(6 7
/(1(.1 PS7 1AT nte!!uption time
=4 of 34
This KP is an indicato! of inte!!uption time fo! the pac(et s$itch data du!ing nte!:1adio Access
Technolog/ ha!d hando&e!"
#1uation /.$ PS' I+0T Interru*tion time ,'rive Test 2ormula-
%S#/2RAT2nterruptionTime . (TimeRAp-ateComplete/5 1 TimeCellC"ange0r-er/RNC)
#1uation //$ PS' I+0T User 'ata Interru*tion time ,'rive Test 2ormula-
%S#/2RATser#ata2nterruptionTime . (TimeFirst%acket#ataRecei&e-2n+* 1
Time'ast%acket#ataRecei&e-2n)*)
This KP is applicable fo! dedicated d!i&e test !oute on =2:22 1* se!&ice bo!de! a!ea du!ing 5a!(et
Acceptance"
The inte!!uption time shall be measu!ed du!ing =2 to 22 PS7 EEO"
Table /<$ PS' I+0T Interru*tion 'efinition
%S#/2RAT2nterruptionTime 7u!ation of inte!!uption to Pac(et data se!&ice du!ing
Ea!d Eando&e!
TimeRAp-ateComplete/5 The timestamp in d!i&e test Tool $hen UE sends
1outing A!ea Update complete message in the
uplin( to the 22 S2SN
TimeCellC"ange0r-er/RNC The timestamp in d!i&e test Tool $hen UE !ecei&es
,ell ,hange O!de! message f!om 1N, in the
do$nlin(
Table /=$ PS' I+0T User 'ata Interru*tion 'efinition
%S#/2RATser#ata2nterruptionTime 7u!ation in seconds to inte!!uption of Pac(et data
se!&ice f!om Use! pe!specti&e du!ing 1AT Ea!d
Eando&e! f!om =2 to 22
TimeFirstPacketDataReceivedIn2G Timestamp in d!i&e test Tool $hen fi!st data is
1ecei&ed in 22 S/stem afte! successful 1AT
Eando&e!"
TimeLastPacketDataReceivedIn3G Timestamp in d!i&e test Tool $hen UE !ecei&es last
Pac(et 7ata in =2 S/stem befo!e 1AT Eando&e!"
Table />$ PS' I+0T Interru*tion time KPI
KPI Term 0t Launc%
PS' I+0T Interru*tion time >9t% *ercentile 5 1.
seconds
PS' I+0T User 'ata
Interru*tion time
Measure and +e*ort
th
pe!centile and the 12 seconds p!o&ided the impact of non UT1AN E.uipment is
/(1(.. ES7PA Access *ailu!e
=1 of 34
This test shall be done $ith a single UE doing ES7PA call in the ,ell unde! test $ith =83DF3 Kbps
associated 7,E on the uplin("
#1uation /8$ CS'P0 0ccess 2ailure +ate ,Counter 2ormula-
144H
1
]
1
,
_
$ % R& '
$ % '
(
'
'
(
R& '
'
1
0SC5 5S "uest ent RA.Assi(nm
0SC5 5S Success ent RA.Assi(nm
SR.Attempt
SR.Success
C!mplete C!nnecti!n RRC
144H
1
1
1
1
]
1
,
_
--$ H4%U)*+,C& ,)&*+0)3B& ./)P+0=&)I +2-341A))& /.N5R+2E4)

--$ H4%U)*+,C& ,)&*+0)3B& &44P+0=&)I +2-341S600 /.N5R+2E4)
( !!!3 . # (
--$ P4%U)*+,C& C5,,&0)R&7 /.T5)N5R*0
+,C&--$ P4S600%U)* C5,,&0)R&7 /.T5)N5R*0
1
As an inte!im solution% it shall be defined as a d!op !ate of 2? o&e! an a&e!age call length of B4
PG"
Table 86$ CS'P0 0ccess 2ailure Term 'efinition
#RRCConnectionComplete The numbe! of successful 11, ,onnection
Setups $ith Pac(et Establishment ,auses
'both o!iginating and te!minating)"
#RRCConnectionRequest The numbe! 11, ,onnection 1e.uest
5essages !ecei&ed $ith Pac(et
Establishment ,auses 'both o!iginating and
te!minating)"
#RABAssignmentResponse (,S4
#SC,)
The numbe! of 1ANAP: 1A0 Assignment
the S2SN PS se!&ice"
#RABAssignmentRequest(,S4#SC,) The numbe! of 1ANAP: 1A0 Assignment
1e.uest messages sent f!om the S2SN to
the 1N, to establish ES7PA Se!&ice"
#SRBAttempt The numbe! of 11, ,onnection ,ompletes
the PS domain and $ill also lead to a ES7PA
1A0 Assignment 1e.uest"
#SRBSuccess The numbe! of ES7PA 1A0 Assignment
1e.uests
#1uation /9$ CS'P0 0ccess 2ailure +ate ,'rive Test 2ormula-
=2 of 34
1
1
1
]
1
Sessi!n 5S0'A
Sessi!n 5S0'A
'0'
ate ssFailureR 5S0'A Acce
8
8
R&
A00&/) C5,)&?) A0)3B+)&
1 ( 1##
n case of multiple 11, connection !e.uests the fi!st 11, connection !e.uest $ill be conside!ed fo!
KP calculation"
Access *ailu!e 1ate shall be measu!ed b/ data session acti&ation 'ES7PA) follo$ed b/ do$nload"
Table 81$ CS'P0 0ccess 2ailure +ate KPI
5 .(6 7 5 .(6 7 5 .(6 7
/(1(./ ES7PA 7!op
ES7PA session is conside!ed as d!opped $hen associated ES:7S,E has been !eleased
abno!mall/ b/ eithe! UT1AN o! ,N" This test $ill be done $ith a single UE pe!fo!ming ES7PA call
in the ,ell unde! test $ith =83DF3 Kbps associated 7,E on the uplin( and ES:7S,E in the 79 $ith
do$ng!adeDupg!ade toDf!om 1BB 1A0"
#1uation /;$ CS'P0 'ro* +ate ,Counter 2ormula-
144H
44 +)35,S600& DSCH8A--50 - HS '
-6*& 4&D6&T5F+3 DSCH8R&-&+ - HS '
144H
1
1
1
1
]
1
+ +
+
$
&H4 I,)&*+0)3B 0&44P+0=&) )+2-341S60 %/.N5R+2E4
4 R2R&-&+4&H /.N5S:4)&.
ul chSuccessE pm)l)pswit Eul nteractie ess'ac%etI ablishSucc pm,!RabEst
s chSuccess5 pm0l)pswit
pmNoSstemR!Release"s: Numbe! of successful s/stem !eleases of pac(et 1A0s mapped on
ES:7S,E in the Se!&ing ES:7S,E cell" The counte! is stepped fo! the Se!&ing ES:7S,E cell at
1A0D10 combination t!ansition f!om PS nte!acti&e F3DES : ES:7S,E to S10:7,E o! to dle mode
due to the same !easons as fo! stepping the existing counte! pmNoS/stem1ab1eleasePac(et"
pmNoS/stem1ab1eleasePac(et is onl/ inc!eased due to a 1ANAPu 1elease ,ommand o! 1A0
Assignment 1e.uest message $ith M!elease causeM I an/thing except NNo!mal 1eleaseN%
NSuccessful 1elocationN% N1esou!ce Optimisation 1elocationN% NUse! nacti&it/N o! N!elease:due:to:UE:
gene!ated: signalling:connection:!eleaseN" This counte! is inc!emented fo! the best cell in the Acti&e
Set in the S1N, and $hen !eleasing a ES 1A0% this counte! is stepped fo! the Se!&ing ES:7,E
cell"
pmNoRa!#sta!lis$S%ccessPacketInteractive"s: The numbe! of successful 1A0 establishments
fo! PS nte!acti&e 1A0 mapped on ES:7S,E" The counte! is stepped fo! the selected Se!&ing ES:
7S,E cell at 1A0 establishment afte! the successfull/ t!ansition S10:7,E to PS nte!acti&e F3DES
: ES:7S,E"
pmDl&ps'itc$S%ccess"s( Numbe! of successful 79 ups$itches to an/ ES state" The counte! is
stepped fo! successful 79 ups$itch to a 10 combination containing ES" The counte! is inc!emented
in all cells of the acti&e set"
== of 34
pmNoRa!#sta!lis$S%ccessPacketInteractive#%l( The numbe! of successful 1A0
establishments fo! PS nte!acti&e 1A0 mapped on E:7,EDES7PA" ,ounte! is stepped fo! the
Se!&ing E:7,E cell at successful 1A0D10 combination t!ansition to PS nte!acti&e E:7,EDES : ES:
7S,E due to 1A0 establishment" The counte! is t!igge!ed afte! sending of 1A0 Assignment
1esponse 'successful)"
pm&l&ps'itc$S%ccess#%l( Numbe! of successful up:s$itches% t!igge!ed b/ U9 use! acti&it/% to a ta!get
10 combination E:7,EDES7PA" Stepped fo! the ta!get cell" ,ounte! in ta!get cell is stepped at a
successful ups$itch t!igge!ed b/ U9 use! acti&it/"
The Selle! counte! based met!ics fo!mula shall be updated as ne$ functionalit/ is int!oduced in the
S/stem
Table 8.$ CS'P0 'ro* Term 'efinition
,S4#SC,/Release#ueToFailure Numbe! of ES:7S,E allocation !eleases due to !adio
lin( and othe! failu!es
,S4#SC,/AllocationSuccess Numbe! of allocations $hen the 1N, has !ecei&ed
11,: 1adio 0ea!e! 1e:,onfigu!ation ,omplete
message f!om the UE afte! successful ES:7S,E 5A,:
d flo$ setup
#1uation /;$ CS'P0 'ro* +ate ,'rive Test 2ormula-
Call 5S0'A
Call 5S0'A
Success All!cati!n 0SC5 5S
0r!pRate 5S0'A
8
8
8
DSCH8D*5/ - HS
( 1## 8
ES7PA 7!op 1ate shall be measu!ed b/ data session acti&ation 'ES7PA) follo$ed b/ ftp do$nload
Table 8/$ CS'P0 'ro* +ate KPI
5 /(6 7 5 .(6 7 5 .(6 7
/(1(.8 ES7PA 9atenc/
Table 88$ CS'P0 Latency Term 'efinition
,S#%A 'atency
1ound t!ip time fo! a =2 0/tes ping fo!
ES7PA N1T 1A0
9atenc/ shall be measu!ed $ith the destination se!&e! fo! ping connected di!ectl/ to the 22SN 'i"e
the se!&e! on the same nt!anet domain as 22SN)" 1TT shall be measu!ed in a stationa!/ test" This
test shall be done $ith a single UE doing ES7PA call in the ,ell unde! test"
Table 89$ CS'P0 Latency KPI
=3 of 34
KPI Latency at Launc%
CS'P0 Latency >9
t%
*ercentile sessions 5 166 ms
th
pe!centile and the 144ms p!o&ided the impact of non UT1AN E.uipment is $ithin
/(1(.9 ES7PA Th!oughput
Total numbe! of 19, bloc(s sent o&e! the obse!&ation $indo$ including !e:t!ansmission"
#1uation />$ CS'P0 T%rou!%*ut ,Counter 2ormula-
Call 5S0'A
Call 5S0'A
0urati!n '0) R9C A:
%b 0ata '0) R9C A:
7hr!u(hput 5S0'A
8
8
8 8 8
$ % 8 8 8
8
$ R& % ( 2 rames "uiredSubF e pm,!Inacti SubFrames pm,!Actie
.its pmSumAc%ed
hr!u(hput 5S0'ACell7
+
Key Performance Indicator

Term
'efinition
A(/R'C/%#/#ata(kb) Total A5 19, P7Us '(ilo:bit) t!ansfe!!ed excluding !e:
t!ansmission in the uplin(
A(/R'C/%#/#uration The total 19, P7U t!ansmission du!ation 'in seconds)
Table 8;$ CS'P0 T%rou!%*ut Term 'efinition
Term
'efinition
t!ansmission in the do$nlin( o! uplin(
A(/R'C/%#/#uration The total 19, P7U t!ansmission du!ation 'in seconds)"
*o! do$nlin( this du!ation excludes the pe!iod $hen the
do$nlin( t!ansmission buffe! fo! the 19, entit/ is empt/
#1uation 86$ CS'P0 T%rou!%*ut ,'rive Test 2ormula-
Call 5S0'A
Call 5S0'A
ati!n Sessi!n0ur
7hr!u(hput 5S0'A
8
8
%4&0$
$ %
8
5easu!ement shall be fo! Application 9a/e! bit !ate" The ES7PA th!oughput is onl/ applicable $hen
the UE is on ES:7S,E"
Table 8<$ Stationary Ma)imum 'L CS'P0 3it +ate ,kb*s- KPI
=@ of 34
PreLaunc% Launc% PostLaunc% 1=66 kb*s
,usin! U# cate!ory 1.-
? 1/66 ? 1/66 ? 1/66
,at +LC Layer
usin! counter-
Under no load condition
? 1166 ? 1166 N(0 967 of 0vailable Power at
System +eference Point
allocated to CS'P0
UE shall be in Stationa!/ location unde! excellent 1* condition ',P,E 1S,P C :84 d0m and
,P,E EcDNo C : 8 d0)"
The do$nload file shall be comp!essed t/pe"
5easu!ement shall be based on *TP file do$nload of minimum ten '14) 50 file to !educe the
impact of T,P slo$ sta!t"
5easu!ement shall be at application la/e! th!oughout the ES7PA Se!&ice A!ea"
Table 8=$ 0vera!e 'L T%rou!%*ut ,kb*s- KPI
PreLaunc% Launc% PostLaunc% Usin! U# cate!ory 1.
1(= Mb*s
? <66 ? <66 ? <66
,at off *eak-
Under no load condition
? ;66 ? ;66 N(0 967 of 0vailable Power at
System +eference Point
allocated to CS'P0
UE shall be in mobile en&i!onment $ithin designed ES7PA Se!&ice A!ea" The suppo!ted 79 ES:
7S,E du!ing d!i&e test is 1844 (bps fo! UE ,atego!/ 12" The ,ell shall be loaded in such a $a/
that ES7PA is allocated fift/:pe!cent '@4?) of the a&ailable po$e! at S/stem 1efe!ence Point" The
!emaining @4 ? of a&ailable 79 po$e! at S/stem 1efe!ence Point shall include common channels
po$e!% load due to one d!i&e test UE '<oice) and the load simulated b/ O,NS speech mode" The!e
shall be one UE ma(ing sho!t <oice ,all 'A51 12"2() in the same cell as ES7PA call to monito! the
impact of ES7PA on the &oice use!" Selle! shall p!o&ide measu!ement !epo!t on sho!t &oice call fo!
Setup *ailu!e and ,all 7!op 1ate as defined in Section ="1"= and Section ="1"3 !especti&el/" The
a&e!age 79 th!oughput measu!ed du!ing the enti!e d!i&e test !oute $ithin ,luste!D5a!(et A!ea shall
be based on ES:7S,E Application 9a/e! th!oughput" 5easu!ement shall be based on d!i&e test
$ith *TP file do$nload of minimum ten '14) 50 file to !educe the impact of T,P slo$ sta!t"
ES7PA Se!&ice A!ea shall be same as PS7 F3( Se!&ice A!ea"
/(1(.; ESUPA Th!oughput
Total numbe! of 19, bloc(s sent o&e! the obse!&ation $indo$ excluding !e:t!ansmission"
#1uation />$ CSUP0 T%rou!%*ut ,Counter 2ormula-
=F of 34
Sessi!n 5S)'A
Sessi!n 5S)'A
0urati!n '0) R9C A:
%b 0ata '0) R9C A:
7hr!u(hput 5S)'A
8
8
8 8 8
$ % 8 8 8
8
$ 1# ( 1# % l msFramesEu pm,!Actie
l .itsCellEu pmSumAc%ed
hr!u(hput 5S)'ACell7
pmSumAc(ed0its,ellEul: The numbe! of 5edia Access ,ont!ol Enhanced Uplin( 'Eul) bits
!ecei&ed and ac(no$ledged b/ the 10S"
pmNoActi&e14ms*!amesEul: The numbe! of 14ms f!ames containing enhanced uplin( data
t!ansmitted b/ the UE
Table 8>$ CSUP0 T%rou!%*ut Term 'efinition
Term
'efinition
t!ansmission in the uplin(
A(/R'C/%#/#uration The total 19, P7U t!ansmission du!ation 'in seconds)"
#1uation 86$ CSUP0 T%rou!%*ut ,'rive Test 2ormula-
Sessi!n 5S)'A
Sessi!n 5S)'A
ati!n Sessi!n0ur
7hr!u(hput 5S)'A
8
8
%4&0$
$ %
8
5easu!ement shall be at Application 9a/e! bit !ate" The upload file shall be comp!essed t/pe"
ESUPA Se!&ice A!ea shall be same as PS7 F3( Se!&ice A!ea"
UE shall be in Stationa!/ location unde! excellent 1* condition ',P,E 1S,P C :84 d0m and
,P,E EcDNo C : 8 d0)
Table 96$ CSUP0 Stationary UL 3it +ate ,kb*s- KPI
PreLaunc% Launc% PostLaunc% U# Cate!ory / ,1(89 Mb*s-
? 1166 ? 1166 Measure and
+e*ort
Stationary Peak T%rou!%*ut
,kb*s- under no load
? 966 ? 966 Measure and
+e*ort
0vera!e T%rou!%*ut ,kb*s-
under no load
/(1(.< ES7PA 7ata Session Setup Time
ES7PA 7ata Session setup time indicates Net$o!( !esponse time to a use! !e.uest fo! an ES7PA
data se!&ice"
#1uation 81$ CS'P0 session definition ,'rive Test 2ormula-
,S#%A #ata Session setup time . %#% Conte3t Acti&ation accept ((0C) 4 RRC Connection
Request ((0C)
=G of 34
This test shall be done $ith a single UE pe!fo!ming ES7PA call in the cell unde! test" The UE is
al!ead/ attached to the UT1AN Net$o!("
Table 91$ CS'P0 'ata Session Setu* time KPI
KPI PreLaunc% Launc%
CS'P0 Session 0ctivation time N(0 >9
t%
*ercentile sessions 5
9 seconds
th
pe!centile and the @ seconds p!o&ided the impact of non UT1AN E.uipment is
System 0vailability
S/stem A&ailabilit/ is defined as the pe!centage of time the Net$o!( can handle one hund!ed pe!:cent
'144?) of the t!affic it is designed fo! as measu!ed at ,ell 9e&el"
The pu!pose of this met!ic is to calculate the total amount of time 'in pe!centage) out of the total
ope!ating time the 1N, and Node:0 a!e a&ailable to ca!!/ comme!cial t!affic" 5inimum g!anula!it/ fo!
KP pu!poses is total loss of t!affic at ,ell le&el"
Selle! is !esponsible onl/ fo! the Sub:S/stem supplied to Pu!chase!: 1N, and Node:0" This excludes
Antenna S/stems% T!anspo!t S/stems% Po$e!D0atte!/ 0ac(up% non:Selle! ,o!e Net$o!("
The loss of t!affic at ,ell 9e&el can be due to one o! mo!e !easons:
1" E.uipment failu!es
2" Soft$a!e failu!es
=" Selle! o!iginated 'accidental% misuse% !eset etc")
3" Planned e&ents autho!i6ed b/ Selle! 'Soft$a!e upg!ade% E.uipment upg!ade% Pa!amete! change
etc)
*o! A&e!age ,ell A&ailabilit/% Selle! shall be !esponsible fo! se!&ice deg!adation due to 1% 2% = 'caused
b/ Selle!#s pe!sonnel o! sub:cont!acto!s of Selle!) and 3"
*o! A&e!age ,ell Non:5aintenance A&ailabilit/% Selle! shall be !esponsible fo! se!&ice deg!adation due
to 1% 2 and = 'caused b/ Selle!#s pe!sonnel o! sub:cont!acto!s of Selle!)"
The le&el of agg!egation fo! this met!ic is Pu!chase!#s enti!e U5TS Net$o!( fo! $hich Selle! has
supplied the E.uipment and Soft$a!e '1N, and Node:0)" The ala!m agg!egation fo! this met!ics shall
be pe!fo!med on dail/ basis" S/stem A&ailabilit/ KP fo! Selle! shall be calculated on a /ea!l/ basis fo!
the pu!pose of achie&ing KP ta!get sta!ting f!om the Net$o!( comme!cial 9aunch fo! 1N, and Node:0
E.uipment" Selle! shall p!o&ide all the necessa!/ ala!m details to assist Pu!chase! in !eali6ing S/stem
A&ailabilit/ KP mat!ices fo! the sub:S/stems supplied b/ Selle! '1N, and Node:0)" Selle! shall
!ecommend to Pu!chase! $hich ala!ms to use to measu!e these KPs"
7ail/ S/stem A&ailabilit/ shall be measu!ed as follo$s:
/(1(.= A&e!age ,ell A&ailabilit/
#1uation /<$ 0vera!e Cell 0vailability formula
Using Ala!ms and S/stems notification% the follo$ing fo!mula shall appl/
1
1
1
]
1
R,C
R,C
rC!unt 7!talSect! :in 5rs
!wntime 7!talCell0
( %4&0$ 6# ( $ % 6# ( $ % 2"
%4&0$
1 ( 1##
Table 9.$ 0vera!e Cell 0vailability Term 'efinition
=8 of 34
TotalSectorCo%nt Total numbe! of acti&e Node:0 ,ells $ithin 1N,
AvgCellAvaila!ilit A&e!age Node:0 ,ells a&ailabilit/ to ca!!/ use! t!affic
calculated as a pe!centage of total time
Table 9/$ 0vera!e Cell 0vailability KPI
0vera!e Cell 0vailability KPI SubSystem +0N +elease
? >>(>9 ,>>(<- 7 +NC E Node3 P9
? >>(>9 ,>>(=- 7 +NC E Node3 P;
? >>(>9 ,>>(>- 7 +NCE Node3 P<
? >>(>9 ,F>>(>-7 +NCE Node3 ?P=
/(1(.> A&e!age ,ell Non:5aintenance A&ailabilit/
#1uation /=$ 0vera!e Cell NonMaintenance 0vailability 2ormula
1
1
1
]
1
R,C
R,C
rC!unt 7!talSect! :in 5rs
time enance0!wn !n:a 7!talCell,
( %4&0$ 6# ( $ % 6# ( $ % 1
%4&0$ 3,)
1 ( 1##
Table 98$ 0vera!e Cell NonMaintenance 0vailability Term 'efinition
TotalCellNon)aintenanceDo'ntime*sec+ Total du!ation 'in seconds) of Node:0 ,ells $ithin
a 1N, not able to ca!!/ an/ t!affic du!ing no!mal
ope!ation 'excluding planned e&ents) due to 1N,
and Node:0 E.uipment !eason" The du!ation shall
be calculated $hen Ala!mDS/stem notification
clea!s minus $hen Ala!mDS/stem notification
t!igge!s"
TotalSectorCo%nt Total numbe! of acti&e Node:0 ,ells $ithin 1N,
AvgCellNon)aintenanceAvaila!ilit A&e!age Node:0 ,ells a&ailable calculated as a
pe!centage of a&ailable time at ,ell le&el
Table 99$ 0vera!e Cell NonMaintenance 0vailability KPI
0vera!e Cell NonMaintenance 0vailability KPI SubSystem +0N +elease
? >>(>>9 ,>>(<- 7 +NC E Node3 P9
? >>(>>9 ,>>(=- 7 +NC E Node3 P;
? >>(>>9 ,>>(>- 7 +NCE Node3 P<
? >>(>>9 ,F>>(>- 7 +NCE Node3 ?P=
Com*arison of UMTS and &SM Network Performance
Selle! shall collect some 22 measu!ements defined belo$ at the same time as =2 measu!ements
fo! all ,luste! Acceptance and all 5a!(et Acceptance d!i&es"
=B of 34
The 22 measu!ements collected b/ Selle! f!om a 22 te!minal in the &ehicle executing a p!e:defined
call se.uence a!e defined belo$:
a" <oice Access *ailu!e !ate
b" <oice 7!op 1ate
c" <oice Aualit/K 5OS
The 22 te!minal used shall be specified b/ Pu!chase! and shall be a comme!ciall/ a&ailable
te!minal used b/ Pu!chase!s 22 ,ustome!s" ,all se.uences used b/ the 22 te!minals shall be
identical to the call se.uences used b/ the =2 te!minals" To the extent possible% the numbe! of 22
calls made shall be the same as the numbe! of =2 calls made"
Test cases fo! 22 te!minals executed to de!i&e the abo&e stated KP must be executed at the same
time $ithin the test &ehicle as the test cases to de!i&e the same KP fo! the =2 te!minals"
t is a !e.ui!ement fo! ,luste! Acceptance and 5a!(et Acceptance that the =2 KP a!e met" f the
collected 22 KPs do not meet =2 KP ta!get then =2 !esults shall be bette! than o! e.ual to the
obtained 22 !esults% using the same call p!ofiles and call se.uences" f the measu!ed 22 KP#s
exceed the measu!ed =2 KP the Selle! shall onl/ ha&e to meet the =2 ta!get"
Im*act of UMTS on &SM Network Performance
The deplo/ment of the U5TS Net$o!( shall not deg!ade Pu!chase!#s existing 2S5 Net$o!(
pe!fo!mance" Excluding 1AT Ea!d Eando&e! *eatu!e% both U5TS and 2S5 Net$o!(s a!e
conside!ed independent of each othe!" This section add!esses an/ conce!n !elated to U5TS
E.uipment installation on 2S5 Sites and !elated faults fo! $hich Selle! has !esponsibilit/ that could
deg!ade 2S5 pe!fo!mance"
The KP shall be collected fo! the enti!e unde!l/ing 22 Site 's) !ele&ant to =2 Node:0:
5OUDd!op fo! <oice ,alls
Access failu!e !ate fo! &oice calls
7ail/ '23 hou!) <oice E!lang T!affic
Selle! shall ensu!e that int!oduction of the U5TS Net$o!( does not deg!ade Pu!chase!#s existing 2S5
Net$o!( pe!fo!mance b/ no mo!e than '14?) ten pe!cent at ,ell 9e&el% no mo!e than 'G"@?) se&en and a
half pe!cent at ,luste! 9e&el and no mo!e than '@?) fi&e pe!cent at 5a!(et 9e&el" The method of
calculation shall be as desc!ibed in the U5TS S/stems Acceptance 'Appendix U1F)"
8 UT+0N Level. Key Performance Indicators
Pu!chase! shall p!o&ide Selle! a document desc!ibing the KP 9e&el:2 counte! based !e.ui!ements"
Selle! shall p!o&ide Pu!chase! all the a&ailable counte!s do$n to the lo$est cause le&el fo! 1N, and
Node:0" Selle! shall p!o&ide '$ith a collabo!ati&e effo!t b/ Pu!chase!) a document that desc!ibes the
9e&el:2 KPs 'fo!mulas and counte!s) $ithin ten '14) $ee(s afte! !eceipt of the 9e&el 2 !e.ui!ements
f!om Pu!chase!" An/ de&iations on the abo&e mentioned time schedule shall be mutuall/ ag!eed"
*o! counte!s that a!e not li(el/ to be a&ailable at the time of comme!cial launch '5ilestone 2)% Selle!
shall mutuall/ ag!ee $ith Pu!chase! '$ithin '=) months of execution of the *ifth '@
th
) Amendment) on a
!easonable !oadmap to de&elop !e.ui!ed counte!s"
Pe!fo!mance 5anagement 5easu!ement Entit/ shall be a&ailable at ,ell% Node:0% ,luste!% 1N,% 5a!(et%
1egion and Net$o!( le&el fo! e&e!/ KP unless othe!$ise stated in 9e&el:2 KPs"
1N, 5easu!ement 2!anula!it/ shall be a minimum pe!iod of fifteen '1@) minutes unless othe!$ise stated in
the 9e&el:2 KPs"
34 of 34

3G KPI Guidelines

Transféré par

Informations du document

Copyright

Formats disponibles

Partager ce document

Partager ou intégrer le document

Options de partage

Avez-vous trouvé ce document utile ?

Ce contenu est-il inapproprié ?

Droits d'auteur :

Formats disponibles

3G KPI Guidelines

Transféré par

Droits d'auteur :

Formats disponibles

Appendix U12

UMTS Network KPI

U)*+,C&--$ ./)S/&&01% +2-341A))& /.N5R+2E4)

$ % R& ' $ % R& '

+,C&--$ S/&&01%U)* R+2R&-&+4& /.N5S:4)&. +,C&--$ S/&&01%U)* R+2R&-&+4& /.N5N5*.+-

i '&alue of Ue1c) 1adio ,onnection ,onfigu!ation

nel'!wer C!mm!nChan abilit# 0l'!werCap c'!wer Cell7ra$$i .+?

*+,C&--$ ./)C4@7%U) +2-341A))& /.N5R+2E4)

$ % R& ' $ % R& '

)+,C&--$ C4S)&+.%U R+2R&-&+4& /.N5S:4)&. )+,C&--$ C4S)&+.%U R+2R&-&+4& /.N5N5*.+-

i '&alue of Ue1c) 1adio ,onnection ,onfigu!ation

Rate ishSuccess eRA.Establ Interacti R!! ( !!!3 . # (

,)&*+0)3B& &44P+0=&)I +2-341S600 /.N5R+2E4)

--$ H4%U)+,C& ,)&+0)3B& ./)P+0=&)I +2-341A))& /.N5R+2E4)

Key Performance Indicator

Vous aimerez peut-être aussi