Pac JPS SS 4G B 019

LTE NEW SITE PAC DOCUMENT 1 (43)
Prepared No. Program Cluster Name

Rendhita/ Jhon P/Wick/Anang JPS batch 2-2017 JPS_SS_4G_B_019
Approved Checked Date Rev Reference
Waqas/ Kiki Candra
PROVISIONAL ACCEPTANCE CERTIFICATE

(PAC)
LTE JPS PROJECT
Area South Sumatera
City Kayu Agung
Cluster Name JPS_SS_4G_B_019
Abstract
This document is to provide report for XL Axiata on Provisional Acceptance Cluster based for commercial LTE launch.
RND SOM PMO

PT.HUAWEI PT. HUAWEI
PT. XL PT. XL PT. XL
TECH INVESTMENT SERVICE
AXIATA Tbk AXIATA Tbk AXIATA Tbk
Name : Name : Name : Name : Name :

Date : Date : Date : Date : Date :

Waqas/ Kiki Candra
TABLE OF CONTENTS
1. INTRODUCTION 5
1.1 Introduction 5
1.2 General Site Information 5
1.2.1 New Site 5
1.2.2 Drive Test Methodology Mobility Assessment 6
1.3 Drive Test Methodology Stationary Assessment 6
1.4 FTP Server Information 6
1.5 Drive Test tool and Detail 7
2. MAP INFORMATION 7
2.1 Google Earth Snapshot 7
2.2 Drive test route, cluster border and coverage prediction 8
3. Performance Result 9
3.1 NMS KPI LTE 9
3.1.1 Availability 9
3.1.2 Accessibility 9
3.1.3 Retainability 9
3.1.4 Integrity 10
3.1.5 Mobility 10
3.1.6 Utilization 10
3.1.7 CSFB 10
3.1.8 Traffic and Capacity 11
3.2 Drive Test KPI 13
3.2.1 Coverage Map Accuracy 13
3.2.2 Retainability 21
3.2.3 Accessibility 21
3.2.4 CSFB 21
3.2.5 Integrity 22
3.2.6 Mobility 22
3.2.7 Functional 22
3.2.8 PCI Plot 23
3.2.9 RSRQ 24
3.2.10 CQI 25
3.2.11 PS DL Throughput 26
3.2.12 PS UL Throughput 27
3.2.13 Transmission Modes Plot (MIMO) 28

Waqas/ Kiki Candra
3.2.14 Channel Bandwidth Plot 29

3.2.15 Event Failed 29
3.2.16 Sleeping Cell Identification 29
3.2.17 External Interference Identification 30
3.2.18 Cell Overshooting 30
3.2.19 Bad Spot analysis and Improvement 30
3.2.20 Physical Tuning Summary 32
3.2.21 Parameter Tuning Summary 32
4. NMS KPI RAN LTE TREND 33
5. KPI 2G & 3G 35
5.1 List of 2G, 3G & LTE sites inside LTE Polygon 35
5.2 NMS 2G 35
5.3 NMS 3G 36
5.4 MRR 3G 36
6. FEATURE 37
7. Issues, Recommendation and Exclusion: 39
7.1 KPI RAN LTE 39
7.2 DT KPI LTE 40
7.3 KPI 2G & 3G 43
8. Conclusion 43

Waqas/ Kiki Candra
Table of Figure
Figure 1: Cluster Map Information at Google Earth .................................................................................................. 7
Figure 2: Drive Test Route at Google Earth ............................................................................................................... 8
Figure 3: Coverage Prediction using Planning Tools & DT Route ............................................................................... 8
Figure 4: RSRP Coverage Prediction overlaid by Drive Test ..................................................................................... 13
Figure 5: RSRP Coverage MR Data ........................................................................................................................... 15
Figure 6: RSRP IDLE Drive Test Result ...................................................................................................................... 16
Figure 7: RSRP CDF Distribution ............................................................................................................................... 17
Figure 8: SINR-DL Dedicated Drive Test Result ........................................................................................................ 17
Figure 9: CDF Plot on SINR-DL Drive Test ................................................................................................................. 18
Figure 10: Cell Edge Location ................................................................................................................................... 19
Figure 11: Open Signal & Ookla result on Cell Edge Spot 1 ..................................................................................... 20
Figure 14: Downlink QoS Test .................................................................................................................................. 23
Figure 15: PCI Plot .................................................................................................................................................... 23
Figure 16: RSRQ Drive Test Result ............................................................................................................................ 24
Figure 17: CQI Distribution Result ............................................................................................................................ 25
Figure 18: PS DL Throughput Drive Test Result ........................................................................................................ 26
Figure 19: PS UL Throughput Drive Test Result ........................................................................................................ 27
Figure 20: Transmission Mode Plot ......................................................................................................................... 28
Figure 21: Channel Bandwidth Plot ......................................................................................................................... 29
Figure 22 : NMS KPI Trend ....................................................................................................................................... 34


Waqas/ Kiki Candra
1. INTRODUCTION
1.1 Introduction
Provisional Acceptance shall be conducted after all the sites on air within cluster. If there are
some issues that halt the RFS e.g. due to delayed community case, tower strengthening, etc,
PAC can be conducted when at least 85% of sites are on air within a cluster. In the case of
mushroom site where there is only 1 new site only with existing neighbor sites SSO is
conducted for PAC.
This document presents the result of Cluster Drive test and Network Performance KPI based
on active measurement and OSS data collection for JPS_SS_4G_B_019.
The drive-test KPIs are evaluated by drive-test coverage and statistic according to the pre-
defined drive-test route that is mutually agreed by both parties.
The results of the measurements are then compared with the passing criteria agreed upon by
XL and HUAWEI.
1.2 General Site Information

General Site Information
Cluster Name JPS_SS_4G_B_019
Area South Sumatera
Total number of cluster sites 2 Site
Total number of planned sites 2 Site
Total number of On-Air Macro sites: 2 Site
Total number of Pico Site 0 Site
Total number of pending On-Air Macro Sites 0 Site
Total number of pending On-Air Pico Sites 0 Site
1.2.1 New Site

eNB ID LTE Site Name CellID Longitude Latitude TAC PCI Status OA Date
275110 LTE_INDRALAYA 4 104.6457 -3.20967 27007 315 Integrated 1-June-17
275137 LTE_PASARINDRALAYA 4 104.674 -3.25047 27007 99 Integrated 2-June-17

Waqas/ Kiki Candra
1.2.2 Drive Test Methodology Mobility Assessment

Drive test shall be performed under below circumstances:
Cluster is barred / reserved to ensure only single user camp in the cluster using USIM class 11
HotRod Prioritas profile to be used
LTE Mobile
KPI Measured Remark
No. UE Method RAT BAND
RSRP, RSRQ, PCI

Handset1 Idle Lock LTE LTE 1800 1 laptop, separated
Plot
round between UL
Round
& DL Test to
1 HUAWEI Dedicated,
PDCP DL THP, guarantee single
E392 continues Lock LTE LTE 1800
SINR user
(Modem) download
HUAWEI Dedicated,
E392 continues Lock LTE LTE 1800 PDCP UL THP 1 laptop, separated
(Modem) Upload round between UL
Round
& DL Test to
2
Dedicated, IRAT HO on guarantee single
Automatic WCDMA / 1800/
Handset 1 continues edge 4G user
(Unlocked) LTE 2100
download coverage
1.3 Drive Test Methodology Stationary Assessment
Stationary KPIs will be tested based on the agreed-on methodology with XL team. Cell Edge
Performance for Link Budget Verification will be tested on the spot where the RSRP reaches between -
115dBm to -120dBm at the edge of a cluster.
1.4 FTP Server Information
Location : Sumatera
FTP Server information
IP: 112.215.125.194

Waqas/ Kiki Candra
1.5 Drive Test tool and Detail
Samsung Galaxy S5
GENEX Probe v3.16
DT Tools
MSISDN UE : 085922936735
MSISDN MODEM : 085922936734
Date of DT 10 June 2017
DT Team Syariful Anam
2. MAP INFORMATION
2.1 Google Earth Snapshot
Figure 1: Cluster Map Information at Google Earth
1st tier neighbor of surrounding site distance 10 km away.


Waqas/ Kiki Candra
2.2 Drive test route, cluster border and coverage prediction
Figure 2: Drive Test Route at Google Earth
Figure 3: Coverage Prediction using Planning Tools & DT Route
Item Result Target PAC Ref
Site List, Polygon Border, DT Route and Coverage Must be matched with
Match Pass
Prediction match with agreed design agreed design

Waqas/ Kiki Candra
3. Performance Result
3.1 NMS KPI LTE
Cell KPI Aggregate for 7 days, taken at cell busy hours except for Availability.
Availability is measured within 24 hours in a day. Cell busy hour is defined as the hour
when downlink and uplink payload reach the peak value.
Measurement period:
Date (Start - End) 8 June 2017 to 14 June 2017
3.1.1 Availability
No Name Target PAC Result Status

Pass with
1 Cell Availability > 99% 97.26 %
justification
3.1.2 Accessibility

1 Session Setup Success Rate > 99% 99.89% Pass
2 RRC Setup Success Rate > 98% 99.95% Pass
3.1.3 Retainability
1 Session Abnormal Release Rate < 1.4% 0.15% Pass


Waqas/ Kiki Candra
3.1.4 Integrity

1 UL Packet Loss (PDCP ) < 1e-3 0.0000 Pass
2 DL Packet Loss (PDCP ) < 1e-3 0.0000 Pass
> 15 Mbps (3 MHz)
3 Downlink User Throughput (Peak)* > 50 Mbps (10 MHz) 17.69 Mbps Info only*
> 75 Mbps (15 MHz)
> 4.5 Mbps (3 MHz)
4 Uplink User Throughput (Peak)* > 20 Mbps (10 MHz) 1.78 Mbps Info only*
> 33 Mbps (15 MHz)
> 5.1 Mbps (3 MHz)
5 Downlink User Throughput (Average)* > 17 Mbps (10 MHz) 8.45 Mbps Info only*
> 25.5 Mbps (15 MHz)
> 3 Mbps (3 MHz)
6 Uplink User Throughput (Average)* > 10 Mbps (10 MHz) 1.28 Mbps Info only*
> 15 Mbps (15 MHz)
7 DL Uu Latency < 8 ms 3.71 ms Pass
* Depend on user behavior
3.1.5 Mobility

Handover Success Rate Intra-
1 > 98% 99.90% Pass
Frequency
Applicable whereby
Handover Success Rate Inter-
2 > 98% N/A LTE 900/2300 are
Frequency
installed
Handover Success Rate Inter-RAT
3 > 95% 99.75 % Pass
(PSHO, not RwR)
3.1.6 Utilization

1 Maximum eNodeB CPU Utilization < 70% 33 % Pass
3.1.7 CSFB

1 Voice - Outgoing Call Setup Time* <5s 2.36 s Pass
2 Voice - Outgoing Call Setup Success Rate > 97% 100% Pass
3 Voice - Incoming Call Setup Time* < 3.5 s 2.64 s Pass
4 Voice - Incoming Call Setup Success Rate > 97% 100 % Pass
5 Voice - Time to Return to LTE* <5s 3.32 s Pass
6 Voice - Return to LTE Success Rate* > 97% 100 % Pass
* Measured using probe (Smart Care or Anritsu)

Waqas/ Kiki Candra
3.1.8 Traffic and Capacity
3.1.8.1 Payload
Name PAC Result*
UL Volume (Gigabyte) 165.91 Gb
DL Volume (Gigabyte) 1581.12 Gb
*Calculation: Daily (summing all hour in a day for all cell within cluster). Weekly (summing 7 days in a week on each UL & DL).
Provided for information only.
3.1.8.2 PRB Utilization

DL PRB UL PRB
DL PRB UL PRB Utilization Utilization
Site ID Utilization Utilization (%) (%)
LTE Site Name CellID
LTE (%) (%) (BH Daily (BH Daily
Max Max averaged in averaged
a week) in a week)
4274666E LTE_INDRALAYA 4 84.36 54.36 61.60 44.97
4274666E LTE_INDRALAYA 5 72.13 56.49 48.43 42.04
4274666E LTE_INDRALAYA 6 41.95 25.94 27.77 21.95
427D681E LTE_PASARINDRALAYA 4 61.04 44.80 53.34 35.40
*Calculation:
Busy hour is defined as the hour in which sum DL & UL payload reach the highest value
Daily : on busy hour, UL/DL PRB utilization is averaged for each cell on each site
Weekly : averaging daily value
Provided for information only

Waqas/ Kiki Candra
3.1.8.3 Number of RRC Connected User
Site ID RRC Connected User RRC Connected User

LTE Site Name
LTE
(Average Week, Daily Max) (Average Week, Daily Sum)
4274666E LTE_INDRALAYA 194 3064

427D681E LTE_PASARINDRALAYA 136 2417
*Calculation:
3.1.8.4 Number of IRAT HO Attempt

IRAT HO Attempt Preparation
LTE SITE
LTE NODE B NAME CellID (Sum daily, summing on a
ID
week)
*Calculation:
Daily : on busy hour, IRAT HO Attempt is summed for each cell toward its relation
Weekly : summing daily value
Note: Attached xls showing cell relation below:
IRAT ATTEMPT
JPS_SS_4G_B_019.xlsx

Waqas/ Kiki Candra
3.2 Drive Test KPI
3.2.1 Coverage Map Accuracy
PAC
No Name Target Status
Result
RSRP plot from coverage
Must match for 90% of sample. The
1 prediction overlaid by drive test 2 dB Pass
difference shall not greater than 3 dB
results
Pass with
2 RSRP (Idle) -105 dBm > 95% area on the cluster 81.96%
Justification
2 SINR-DL (Dedicated) 3 dB > 85% area on the cluster 92.26% Pass
3.2.1.1 RSRP Coverage Prediction
Figure 4: RSRP Coverage Prediction overlaid by Drive Test
RSRP Criteria (dBm) Legend

RSRP >=-85
-90 <= RSRP <-85
-100 <= RSRP <-90
-105 <= RSRP <-100
-115<= DL RSRP <-105
RSRP <-115

Waqas/ Kiki Candra
Prediction Drive Test PAC

Target Result
(90% Sample) (90% Sample) Deviation
-100 -98 2 dB Accurate within 90% of area with deviation of 3dB Pass
Cluster JPS_SS_4G_B_019
-100.5
-100
-100
-99.5
-99
-98.5
-98
-98
-97.5
Prediction (90% Sample) Drive Test (90% Sample)

-97

Waqas/ Kiki Candra
3.2.1.2 RSRP Coverage MR Data
Figure 5: RSRP Coverage MR Data
MR Collection time start from 19:00 to 21:00 12th May. Only for Information.
MR RSRP Legend Percentage MR Number

DL RSRP (dBm)>=-85 2.15% 39
-90<=DL RSRP (dBm)<-85 7.10% 129
-100<=DL RSRP (dBm)<-90 30.78% 559
-105<=DL RSRP (dBm)<-100 40.69% 739
-115<=DL RSRP (dBm)<-105 14.04% 255
DL RSRP (dBm)<-115 5.23% 95
Total 100.00% 1816
Reference MR Number PAC Result Status

RSRP -105 dBm 1466 80.72% Only for Information

Waqas/ Kiki Candra
3.2.1.3 RSRP IDLE Drive Test
Figure 6: RSRP IDLE Drive Test Result

Min Value (dBm) RSRP Criteria (dBm) Max Value (dBm) Percentage (%) Legend
-85 DL RSRP (dBm)>=-85 Infinity 27.26%
-90 -90<=DL RSRP (dBm)<-85 -85 11.87%
-100 -100<=DL RSRP (dBm)<-90 -90 27.23%
-105 -105<=DL RSRP (dBm)<-100 -100 15.60%
-115 -115<=DL RSRP (dBm)<-105 -105 17.24%
-Infinity DL RSRP (dBm)<-115 -115 0.80%
Target PAC Result Status

Pass With
In 95% of cluster, the RSRP must be -105 dBm -105 dBm @ 51%
Justification
No low RSRP ( < -105 dBm ) is found near site 300m) Not found Pass

Waqas/ Kiki Candra
CDF Plot:
Figure 7: RSRP CDF Distribution
3.2.1.4 SINR-DL Dedicated Drive Test
Figure 8: SINR-DL Dedicated Drive Test Result


Waqas/ Kiki Candra
Min Value (dB) SINR Criteria (dB) Max Value (dB) Percentage (%) Legend
20 SINR (dB)>=20 Infinity 17.98%
10 10<=SINR (dB)<20 20 46.37%
3 3<=SINR (dB)<10 10 27.91%
0 0<=SINR (dB)<3 3 4.88%
-5 -5<=SINR (dB)<0 0 2.26%
-Infinity SINR (dB)<-5 -5 0.60%
SINR 3 92.26% Pass

In 85% of cluster, SINR-DL must be > 3 dB 3dB @ 95% Pass
No Low SINR (<3 dB) is found near site ( 300m) Not found Pass
CDF Plot :
Figure 9: CDF Plot on SINR-DL Drive Test


Waqas/ Kiki Candra
3.2.1.5 Cell Edge Verification

Cell LTE
No eNB ID CellID RSRP longitude latitude PCI Target Status
throughput
-116
1 275110 5 104.64867 -3.324266 316 10.64 Mbps > 1 Mbps Pass
dBm
-116
2 275137 4 104.66902 -3.242666 99 18.31 Mbps > 1 Mbps Pass
dBm
-125
3 275137 5 104.69606 -3.238175 100 6.00 Mbps > 1 Mbps Pass
dBm
Note: Speed test is required at bad spot area (<-115 dBm) which is detected from MR or DT with maximum 3 spots.
Figure 10: Cell Edge Location


Waqas/ Kiki Candra
OOKLA and OpenSignal Cell Edge verification:
Figure 11: Open Signal & Ookla result on Cell Edge Spot 1

Waqas/ Kiki Candra
3.2.2 Retainability
PAC
No Name Target Status Remark
Result
Session Abnormal In PAC, value is measured on mobility or
1 < 1.4% 0.40% Pass
Release Rate stationary on each PCI
3.2.3 Accessibility
No Name Target PAC Result Status Remark
1 Session Setup Success Rate > 99% 100% Pass In PAC, value is measured on
mobility or stationary on
2 RRC Setup Success Rate > 98% 100% Pass
each PCI
3.2.4 CSFB
No Name Target PAC Result Status Remark
1 Voice - Outgoing Call Setup Time 5s 2.66s Pass
In PAC,
Voice - Outgoing Call Setup Success
100% value is
2 Rate > 97% Pass
measured
3 Voice - Incoming Call Setup Time 3.5 s 2.94s Pass
on mobility
Voice - Incoming Call Setup Success
100% or
4 Rate > 97% Pass
stationary
5 Voice - Time to Return to LTE 5s 3.69s Pass
on each PCI
6 Voice - Return to LTE Success Rate > 97% 100% Pass

Waqas/ Kiki Candra
3.2.5 Integrity
RTT Packet Delay (ping) 32/1000 18.20ms/
1 bytes <= 20 ms / 30 ms 27.90ms Pass
2 UL Packet Loss (PDCP ) < 1e-3 0.0000 Pass
3 DL Packet Loss (PDCP ) < 1e-3 0.0000 Pass
> 15 Mbps (3 MHz)
> 50 Mbps (10 MHz)MIMO Info
Downlink Peak User Throughput* 46.53 Mbps
>25 Mbps (10Mhz) SIMO only*
> 75 Mbps (15 MHz)
4
> 4.5 Mbps (3 MHz)
> 20 Mbps (10 MHz)MIMO Info
Uplink Peak User Throughput* 23.25 Mbps
>15 Mbps (10Mhz) SIMO only*
5 > 33 Mbps (15 MHz)
> 4 Mbps (3 MHz)
Downlink Average User Throughput > 15 Mbps (10 MHz) 19.92 Mbps Pass
6 > 22.5 Mbps (15 MHz)
> 3 Mbps (3 MHz)
Uplink Average User Throughput > 10 Mbps (10 MHz) 11.90 Mbps Pass
7 > 15 Mbps (15 MHz)
8 Jitter (Uplink and Downlink) < 50 ms 5.21 ms Pass

Note: all above values are measured on mobility or stationary on each PCI
*Depends on single user scenario and Transmission Capacity
3.2.6 Mobility
No Name Ref PAC Result Status Remark
Handover Success Rate Intra-
1 > 98% 100% Pass 98.5%
Frequency
Handover Success Rate Inter- Applicable if L900/L2300 are
2 > 98% N/A N/A
Frequency deployed
Handover Success Rate Inter-
3 > 95% 100% Pass 98.5%
RAT (PSHO, not RwR)
3.2.7 Functional
No Name Method PAC Result Status
One UE in excellent, one UE in medium, and one
Downlink QoS UE in bad positions, all with same priority. One
1 Cluster Pass
Test additional UE with higher priority is inserted,
under different conditions

Waqas/ Kiki Candra
3.2.7.1 Downlink QoS Test
Figure 14: Downlink QoS Test

PAC
Target
Status
HotRod Priority speed (higher QoS) is higher than Super Hotrod (lower QoS) Pass
3.2.8 PCI Plot
Figure 15: PCI Plot


Waqas/ Kiki Candra
No partial / full cross feeder is detected Information only Pass
3.2.9 RSRQ
RSRQ is provided for information only.
Figure 16: RSRQ Drive Test Result
Min Value (dB) RSRQ Criteria (dB) Max Value (dB) Percentage (%) Legend
-6 RSRQ (dB)>=-6 Infinity 10.64%
-9 -9<=RSRQ (dB)<-6 -6 64.91%
-11 -11<=RSRQ (dB)<-9 -9 18.76%
-14 -14<=RSRQ (dB)<-11 -11 4.90%
-Infinity RSRQ (dB)<-14 -14 0.78%

Waqas/ Kiki Candra
3.2.10 CQI
Figure 17: CQI Distribution Result

Min Value CQI Max Value Percentage (%)
10 10 <= CQI Value < 15 15 53.29%
5 5<= CQI Value < 10 10 46.01%
3 3 <= CQI Value < 5 5 0.70%
0 0 <= CQI Value < 3 3 0.00 %
Item Status
CQI Distribution* Info Only

Waqas/ Kiki Candra
3.2.11 PS DL Throughput
Figure 18: PS DL Throughput Drive Test Result

Min Value (Mbps) DL Throughput (Mbps) Max Value (Mbps) Percentage (%) Legend
30 DL Throughput (Mbps)>=30 Infinity 18.22%
10 10<=DL Throughput (Mbps)<30 30 61.63%
0 0<DL Throughput (Mbps)<3 3 5.47%
PS DL Drive Test Target PAC Result Status
No low DL throughput ( < 3 Mbps) near site ( 300m) Yes Pass
*PS DL Throughput test do in normal mode without cell bar.


Waqas/ Kiki Candra
3.2.12 PS UL Throughput
Figure 19: PS UL Throughput Drive Test Result

Min Value (Mbps) UL Throughput (Mbps) Max Value (Mbps) Percentage (%) Legend
15 UL Throughput (Mbps)>=15 Infinity 14.65%
10 10<=UL Throughput (Mbps)<15 15 38.33%
0 0<UL Throughput (Mbps)<3 3 14.18%
PS UL Drive Test Target PAC Result Status
No low DL throughput ( < 3 Mbps) near site ( 300m) Yes Pass
*PS UL Throughput test do in normal mode without cell bar.


Waqas/ Kiki Candra
3.2.13 Transmission Modes Plot (MIMO)
Note: provided for information only
Figure 20: Transmission Mode Plot
MIMO Check Result

eNB ID eNB Name Cell ID
Design Implementation
275110 4274666E_LTE_INDRALAYA 4 MIMO MIMO
275137 427D681E_LTE_PASARINDRALAYA 4 MIMO MIMO

Waqas/ Kiki Candra
3.2.14 Channel Bandwidth Plot
Note: provided for information only
Figure 21: Channel Bandwidth Plot
3.2.15 Event Failed
Item Target Test Result Status
Found event failed report No event failed is detected Not Found Pass
Event_FTP.csv
3.2.16 Sleeping Cell Identification

No sleeping cell is found Not found Pass
NMS

Waqas/ Kiki Candra
3.2.17 External Interference Identification
No external interference is found Not found Information only
External_Interference
3.2.18 Cell Overshooting

Not found site overshooting
Inter Site Distance Overshooting

Site name Cell name Target Remark
(KM) Factor
LTE_INDRALAYA PG4G18_4274666E_4 N/A >=80% N/A Open Area
LTE_PASARINDRALAYA PG4G18_427D681E_4 N/A >=80% N/A Open Area
CELL
OVERSHOOTING JPS_SS_4G_B_019.xlsx
3.2.19 Bad Spot analysis and Improvement

All bad spots are improved No more bad spot is detected Pass

Waqas/ Kiki Candra
3.2.19.1 Bad spot on RSRP/ SINR
- RSRP
Before After
Spot Spot Type Bad Spot Description Action Taken
1 Bad Coverage Bad spot due to weak coverage from site Adjust MT from 2 to 5
LTE_INDRALAYA Sec 3. Distance around 1.58
Km and located on cell edge Adjust ET from 4 to 0
LTE_INDRALAYA Sec 2. Distance around 1.2
Adjust ET from 4 to 0
Km and located on cell edge
3 Bad Coverage Bad spot due to weak coverage from site Adjust MT from -2 to 2
LTE_PASARINDRALAYA Sec 3. Distance
around 1.8 Km and located on cell edge
LTE_INDRALAYA Sec 1. Distance around 2 Km
and located on cell edge

Waqas/ Kiki Candra
3.2.20 Physical Tuning Summary
Before After
Site Name CellID Height Ant Type RET
Dir Mech Elec Dir Mech Elec
LTE_INDRALAYA 4 55 40 2 4 40 5 0 AAU -
LTE_PASARINDRALAYA 4 38 60 0 2 60 2 3 AAU -
LTE_PASARINDRALAYA 5 38 120 2 2 120 2 3 AAU -
LTE_PASARINDRALAYA 6 38 330 -2 2 330 2 3 AAU -
3.2.21 Parameter Tuning Summary
- No Parameter tuning or optimization done since the coverage already follow RF design &
parameter standard (CDD) already implemented successfully.

Waqas/ Kiki Candra
4. NMS KPI RAN LTE TREND

Availability Session Setup Success Rate
Cell Availability (%) Session Setup Success Rate (%)
100 100
99 99.5
98 99
97 98.5
96 98
95 97.5
94 97
93 96.5
92 96
91 95.5
90 95
8-Jun-17 9-Jun-17 10-Jun-17 11-Jun-17 12-Jun-17 13-Jun-17 14-Jun-17 8-Jun-17 9-Jun-17 10-Jun-17 11-Jun-17 12-Jun-17 13-Jun-17 14-Jun-17
Average of Cell Availability Average of Target Average of Session Setup Success Rate Average of Target Session Setup Sucess Rate
Session Setup Success Rate is maintained above

Availability is maintained above reference value 99%
reference value 99%
RRC Setup Success Rate Session Abnormal Release Rate
RRC Setup Success Rate (%) Session Abnormal Release Rate (%)
100 1.6
99 1.4
98
1.2
97
96 1
95 0.8
94 0.6
93
0.4
92
91 0.2
90 0
Average of RRC Setup Success Rate Average of RRC Target Average of Session Abnormal Release Rate Average of Target Session Abnormal Release Rate
RRC Setup Success Rate is maintained above reference Session Abnormal Release Rate is maintained below
value 98 % reference value 1.4 %
UL/DL PDCP Packet Loss Downlink Vs Uplink Average Cell Throughput
UL vs DL Packet Loss PDCP (%) Downlink vs Uplink Cell Throughput (Average) (Mbps)
25
0.001401
0.001201 20
0.001001 15
0.000801
10
0.000601
0.000401 5
0.000201 0
0.000001 8-Jun-17 9-Jun-17 10-Jun-17 11-Jun-17 12-Jun-17 13-Jun-17 14-Jun-17
8-Jun-17 9-Jun-17 10-Jun-17 11-Jun-17 12-Jun-17 13-Jun-17 14-Jun-17
Average of Downlink Cell Throughput (Mbps)
UL Packet Loss_PDCP DL Packet Loss_PDCP Average of Target UL & DL Packet Loss PDCP Average of Uplink Cell Throughput (Mbps)
PDPCP UL/DL Packet Loss performance is below Cell DL Throughput Average is 16.55 Mbps, Cell UL
reference value 1e-3. Throughput Average is 2.12Mbps.(Only for Information)

Waqas/ Kiki Candra
IRAT-HO SR HOSR Intra-frequency

Handover Success Rate Inter-RAT IRAT-HO not RwR (%) HO Intra Success Rate (%)
100 100
99
98 98
97
96
96
95 94
94
93 92
92
91 90
90
8-Jun-17 9-Jun-17 10-Jun-17 11-Jun-17 12-Jun-17 13-Jun-17 14-Jun-17 HO Success Rate Intra-Frequency
Average of Handover Success Rate Inter-RAT IRAT-HO not RwR HO Success Rate Inter-Frequency
Average of Target Handover Success Rate Inter-RAT IRAT-HO not RwR Average of Target Handover Success Rate Inter-Frequency
Handover Success Rate Inter RAT Frequency is Handover Success Rate Intra Frequency is maintained
maintained above reference value 95.00% above reference value 98.00%
Processor Load 3G vs LTE User Number
Maximum eNodeB CPU Utilization (%) LTE RRC User VS 3G HSDPA User
80 1400
70
1200
60
1000
50
40 800
30 600
20
400
10
200
0
8-Jun-17 9-Jun-17 10-Jun-17 11-Jun-17 12-Jun-17 13-Jun-17 14-Jun-17 0
Average of Maximum eNodeB CPU Utilization
Average of Target Maximum eNodeB CPU Utilization Average of HSDPA UE Mean Cell Average of LTrafficUserAvg
eNodeB processor load maximum is lower below 3G and LTE User Number actually no issue. (Only for
reference value 70.00 %. Information)
3G vs LTE Payload Trend (Daily sum in GB) 3G User throughput vs 4G User throughput
(busy hour cluster level)

DL and UL Volume (GB) Throughput 3G vs 4G (Mbps)
900 0.7 14
800
0.6 12
700
0.5 10
600
500 0.4 8
400 0.3 6
300 0.2 4
200
0.1 2
100
0 0 0
Average of 4G Payload Average of 3G Payload Average of Downlink User Throughput 3G (Mbps) Average of Downlink User Throughput 4G (Mbps)
Payload actually no issue, (Only for Information) Throughput actually no issue, (Only for Information)
Figure 22 : NMS KPI Trend


Waqas/ Kiki Candra
5. KPI 2G & 3G
Drive Test is out of LTE vendor scope of work, hence the 2G & 3G DT KPI would be reviewed
during quarterly Drive Test with PTHS. Therefore, the 2G & 3G aspect only review the NMS
KPI, plus MRR data of 3G in SSO report.
The target for NMS KPI is maintained of improved, comparing the best week (within 3 weeks)
after Frequency Carving/TRX Shutdown versus the week when SSO is collected.
2G & 3G nodes involved are applicable for nodes which are inside LTE polygon, regardless
they have collocated LTE installed or not. All KPI, except availability are calculated during busy
hour-payload UL+DL daily, averaged within a week. Availability is monitored 24 hr daily.
5.1 List of 2G, 3G & LTE sites inside LTE Polygon

Item Target PAC Result Status
Site List 2G & 3G inside the polygon is Must be matched with

Match Pass
matched with actual actual
Adjacent and collo neighbor cell list in excel file attached
SITELIST
5.2 NMS 2G
KPI Baseline Week16 PAC Week20 Comments*

Assignment Success Rate 99.23% 99.84% Improved
Perceive Drop Rate 1.19% 1.51% Maintained
Perceive Congestion Rate 0.03% 0.11% Maintained
SDCCH Drop Rate 0.01% 0.00% Maintained
SDCCH Congestion Rate 0.00% 0.01% Maintained
SDCCH Success Rate 100.00% 100.00% Maintained
TBF Failure Rate 0.93% 0.41% Improved
Cell Availability 99.33% 98.91% Maintained
HO Success Rate 98.17% 99.29% Improved
* Fill comments with: Degraded or Maintained or Improved according to current week compared with baseline

Waqas/ Kiki Candra
5.3 NMS 3G
KPI Baseline Week 16 PAC Week 20 Comments*

RRC Success Rate 99.16% 99.02% Maintained
Speech Access Rate 98.50% 98.59% Maintained
PS Access Rate 98.77% 98.00% Maintained
Speech Drop Rate 1.01% 0.57% Improved

PS Drop Rate 0.35% 0.35% Maintained
RAB Congestion 0.00% 0.01% Maintained
Cell Availability 99.85% 99.82% Maintained
CS IRAT-HO SR 97.11% 95.00% Degraded
* Fill comments with: Degraded or Maintained or Improved according to current week compared with baseline
5.4 MRR 3G
During LTE Optimization process, some physical tuning might be executed to enhance LTE quality. While
in some sites, the antenna is shared between 3G and LTE. Therefore, LTE vendor must provide the MRR
before and after physical tuning is executed. The CPICH RSCP must be maintained, or if due to less
sample, the deviation of 2% is accepted.
* Fill comments with: Degrade or maintain or improve according to current week compared with baseline (a week
before tuning is executed)
Before After

Waqas/ Kiki Candra
6. FEATURE
PAC acceptance validates the feature state on each RAN LTE nodes. The validation refers to Bill of Quantity stated
in Purchased Order with the actual feature status on the node. The feature may be applicable on the cell level,
site level (eNB) or RRC Connected user level. Each LTE vendor may have their own feature ID.
We define 2 type of feature:
- Basic: standard deliverables on each product package
- Optional: selectable feature chosen by customer.
Below is the detail log file on feature validation:
RECOMME
FEATURE FEATURE BoQ Current
FEATURES FEATURE ID NDED
DOMAIN TYPE Checking Status
BASELINE
CS Fallback to UTRAN LOFD-001033 RF Optional YES ON ON
CS Fallback to GERAN LOFD-001034 RF Optional YES OFF OFF
CS Fallback with LAI to
LOFD-001069 RF Optional YES OFF OFF
GERAN
LoCation Services(LCS) LOFD-001047 Product Optional YES OFF OFF
Support of UE
LOFD-001030 RF Optional YES ON ON
Category2/3/4
Enhanced Scheduling LOFD-001015 RF Optional YES ON ON
Active Queue
LOFD-001027 RF Optional YES Trial Trial
Management(AQM)
Enhanced Admission
Control
PS Inter-RAT Mobility
between E-UTRAN and LOFD-001020 RF Optional YES OFF OFF
GERAN
Security Mechanism LOFD-001010 Product Optional YES ON ON
Temporary Temporary
Intra-LTE Load Balancing LOFD-001032 RF Optional YES
OFF OFF
Intra-LTE User Number Temporary Temporary
LOFD-070215 RF Optional YES
Load Balancing OFF OFF
PS Inter-RAT Mobility
between E-UTRAN and LOFD-001019 RF Optional YES ON ON
UTRAN
RObust Header Temporary Temporary
Compression (ROHC) OFF OFF
Flash CS Fallback to
UTRAN
Flash CS Fallback to
GERAN
Temporary Temporary
Flexible User Steering LOFD-001054 RF Optional YES
OFF OFF

Waqas/ Kiki Candra
RECOMME
BASELINE
Inter-RAT Load Sharing to
UTRAN
UL Interference Rejection
Combining
Automatic Neighbour
Relation(ANR)
Self-configuration LOFD-002004 Product Optional YES ON ON
PCI Collision Detection &
Self-Optimization
Mobility Robust
Optimization (MRO)
Remote Electrical Tilt
LOFD-001024 Product Optional YES Scene On Scene On
Control
RIM Based LTE Target Temporary Temporary
Cell Selection OFF OFF
DL 2x2 MIMO LOFD-001001 RF Optional YES ON ON
Enhanced Transmission
LOFD-003011 Product Optional YES ON ON
QoS Management
IP Performance Temporary Temporary
LOFD-003012 Product Optional YES
Monitoring OFF OFF
S1 and X2 over IPv6 LOFD-003017 Product Optional YES OFF OFF
IPsec LOFD-003009 Product Optional YES OFF OFF
Public Key
LOFD-003010 Product Optional YES OFF OFF
Infrastructure(PKI)
Integrated Firewall LOFD-003014 Product Optional YES OFF OFF
S1-flex LOFD-001018 Product Optional YES ON ON
2G/3G and LTE Co-
transmission
UL 64QAM LOFD-001006 RF Optional YES ON ON
Inter-RAT ANR LOFD-002002 RF Optional YES Trial Trial
RACH Optimization LOFD-002015 RF Optional YES Scene On Scene On
RF Channel Intelligent
Shutdown
PSU Intelligent Sleep
Mode
Temporary Temporary
UL 2x2 MU-MIMO LOFD-001002 RF Optional YES
OFF OFF
Intra-eNodeB UL CoMP LOFD-001066 RF Optional YES ON ON
LOFD-
CQI Adjustment RF Optional YES ON ON
00101501
LOFD-
Dynamic Scheduling RF Optional YES ON ON
00101502
Control Channel IRC LOFD-001094 RF Optional YES Trial Trial
CS Fallback with LAI to
UTRAN

Waqas/ Kiki Candra
RECOMME
BASELINE
Temporary Temporary
SRVCC to UTRAN LOFD-001022 RF Optional YES
OFF OFF
Intelligent Access Class
LOFD-070207 RF Optional YES Scene On Scene On
Control
IP Active Performance
Measurement
Dynamic Inter-Cell
Interference LOFD-001014 RF Optional YES OFF OFF
Coordination
Static TDM eICIC LAOFD-002001 RF Optional YES OFF OFF
Temporary Temporary
TTI Bundling LOFD-001048 RF Optional YES
OFF OFF
FeICIC LAOFD-081234 RF Optional YES OFF OFF
SFN LOFD-003029 RF Optional YES Scene On Scene On
CPRI Compression LOFD-001076 Product Optional YES OFF OFF
Cell Outage Detection
LOFD-002012 Product Optional YES ON ON
and Compensation
Enhanced
Synchronization
IPsec for IPv6 LOFD-003024 Product Optional YES OFF OFF
Ethernet OAM LOFD-003004 Product Optional YES OFF OFF
Antenna Fault Detection LOFD-002011 Product Optional YES OFF OFF
Multi-mode BS Common
MRFD-231601 Product Optional YES OFF OFF
Reference Clock
Criteria Result Remark
Feature status matched with BoQ Match Pass
7. Issues, Recommendation and Exclusion:
7.1 KPI RAN LTE

Worse cell availability issue on sector 3 due to hardware issue and already escalate project team to trouble shoot.

Waqas/ Kiki Candra
7.2 DT KPI LTE
Justification for KPI DT LTE which not achieved the target
Spot No Spot Type Badspot Description Action

Bad Bad spot due to weak coverage from site LTE_INDRALAYA
1 N/A
coverage Sec 2. Distance around 2.83 Km and and located on cell edge

Waqas/ Kiki Candra

Bad spot due to weak coverage from site
Bad
2 LTE_PASARINDRALAYA Sec 3. Distance around 1.65 Km and N/A
coverage
and located on cell edge

Waqas/ Kiki Candra

Bad spot due to weak coverage from site
Bad
3 LTE_PASARINDRALAYA Sec 2. Distance around 1.7 Km and N/A
coverage
located on cell edge
Justification No Access Route Sector 3 LTE_PASARINDRALAYA


Waqas/ Kiki Candra
7.3 KPI 2G & 3G
KPI RAN LTE already meet the target
8. Conclusion
We conclude that SSO of Cluster JPS_SS_4G_B_019 is:
Pass, without note

Pass, with note
Not pass
*Tick one appropriate result

Pac JPS SS 4G B 019

Transféré par

Informations du document

Titre original

Copyright

Formats disponibles

Partager ce document

Partager ou intégrer le document

Options de partage

Avez-vous trouvé ce document utile ?

Ce contenu est-il inapproprié ?

Droits d'auteur :

Formats disponibles

Pac JPS SS 4G B 019

Transféré par

Droits d'auteur :

Formats disponibles

LTE NEW SITE PAC DOCUMENT 1 (43)

Prepared No. Program Cluster Name

PROVISIONAL ACCEPTANCE CERTIFICATE

Area South Sumatera

City Kayu Agung

Cluster Name JPS_SS_4G_B_019

RND SOM PMO

Name : Name : Name : Name : Name :

Prepared No. Program Cluster Name

Prepared No. Program Cluster Name

3.2.14 Channel Bandwidth Plot 29

Prepared No. Program Cluster Name

Figure 2: Drive Test Route at Google Earth ............................................................................................................... 8

Figure 3: Coverage Prediction using Planning Tools & DT Route ............................................................................... 8

Figure 4: RSRP Coverage Prediction overlaid by Drive Test ..................................................................................... 13

Figure 5: RSRP Coverage MR Data ........................................................................................................................... 15

Figure 6: RSRP IDLE Drive Test Result ...................................................................................................................... 16

Figure 7: RSRP CDF Distribution ............................................................................................................................... 17

Figure 8: SINR-DL Dedicated Drive Test Result ........................................................................................................ 17

Figure 9: CDF Plot on SINR-DL Drive Test ................................................................................................................. 18

Figure 10: Cell Edge Location ................................................................................................................................... 19

Figure 14: Downlink QoS Test .................................................................................................................................. 23

Figure 15: PCI Plot .................................................................................................................................................... 23

Figure 16: RSRQ Drive Test Result ............................................................................................................................ 24

Figure 17: CQI Distribution Result ............................................................................................................................ 25

Figure 18: PS DL Throughput Drive Test Result ........................................................................................................ 26

Figure 19: PS UL Throughput Drive Test Result ........................................................................................................ 27

Figure 20: Transmission Mode Plot ......................................................................................................................... 28

Figure 21: Channel Bandwidth Plot ......................................................................................................................... 29

Figure 22 : NMS KPI Trend ....................................................................................................................................... 34

Prepared No. Program Cluster Name

1.2 General Site Information

1.2.1 New Site

Prepared No. Program Cluster Name

1.2.2 Drive Test Methodology Mobility Assessment

RSRP, RSRQ, PCI

1.3 Drive Test Methodology Stationary Assessment

1.4 FTP Server Information

Prepared No. Program Cluster Name

1.5 Drive Test tool and Detail

Figure 1: Cluster Map Information at Google Earth

1st tier neighbor of surrounding site distance 10 km away.

Prepared No. Program Cluster Name

2.2 Drive test route, cluster border and coverage prediction

Figure 2: Drive Test Route at Google Earth

Figure 3: Coverage Prediction using Planning Tools & DT Route

Item Result Target PAC Ref

Prepared No. Program Cluster Name

3.1 NMS KPI LTE

Date (Start - End) 8 June 2017 to 14 June 2017

No Name Target PAC Result Status

No Name Target PAC Result Status

No Name Target PAC Result Status

1 Session Abnormal Release Rate < 1.4% 0.15% Pass

Prepared No. Program Cluster Name

No Name Target PAC Result Status

No Name Target PAC Result Status

No Name Target PAC Result Status

No Name Target PAC Result Status

Prepared No. Program Cluster Name

3.1.8 Traffic and Capacity

3.1.8.2 PRB Utilization

Prepared No. Program Cluster Name