(Huawei) (CPS) (TSEL MFS Cancel IMT Pending TRX 003)

TSEL SPECIFIC MOP
(Huawei)_(CPS)_(TSEL_MFS_Cancel_IMT_Peding_Part3)
Prepared by: YUDI ARIYANTO Date: 20181127
00431713
Reviewed by: LIZHIJIE Date: 20181127
L00208584
Approved by: ZHENGYINGXU Date: 20181127
00333418
Implementation Solution for Change
Contents
1 Description of Change........................................................................................... 3
1.1 Description of Site ...................................................................................... 3
1.2 Purpose ...................................................................................................... 3
1.3 Description of Change and Change Influence ........................................... 4
2 Preparations for Change ....................................................................................... 4
2.1 Change Period .......................................... Error! Bookmark not defined.
2.2 Composition of Change Team and Responsibility of Team Members ...... 4
2.2.1 Change Team of XX Company ................................................................... 5
2.2.2 Huawei On-site Change Team .................................................................... 5
2.2.3 Huawei Support & Guarantee Team ........... Error! Bookmark not defined.
2.3 Check of Equipment Running .................................................................... 6
2.4 Change Risks and Countermeasures ........................................................ 7
2.5 Check Before Change ................................................................................ 8
3 Operation Steps for Change ................................................................................. 8
3.1 Change Steps............................................................................................. 8
3.1.1 Overall Description ...................................................................................... 8
3.1.2 Operation Steps for Change ....................................................................... 9
3.2 Test and Verification ................................................................................ 13
3.3 Solution for Changeback In the Case of Failure ...................................... 14
3.3.1 Definition of Change Failure...................................................................... 14
3.3.2 Overall Description of Changeback .......................................................... 15
3.3.3 Information Collection Before Changeback .............................................. 15
3.3.4 Changeback Steps .................................................................................... 15
3.3.5 Equipment Status Check ........................................................................... 16
3.3.6 Tests After Changeback ............................................................................ 17
3.3.7 Changeback Risk Analysis ........................................................................ 17
3.4 Change of Spare Parts and Emergency Workstation .............................. 18
4 Work After Change .............................................................................................. 18
4.1 Observation .............................................................................................. 18
4.2 Provision of Materials ............................................................................... 19
4.3 Provision of Software ............................................................................... 20
4.4 Training..................................................................................................... 20
4.5 Matters Needing Attention........................................................................ 20
Technical support website: Technical support hotline: Page 2 of 20

http://support.huawei.com Fax:
1 Description of Change
1.1 Description of Site
NE Name Version Number Remark

TXNDB Oracle 11.2.4.0 2
MGTDB Oracle 11.2.4.0 2
Network topology:
Single Mode A/S Mode A/A Mode
Service Network
Network Edge OWA OWA
AG AG
SMSC
MFS DB MFS DBCPS DB
SWA SWA
(TXN&MGT) (TXN&MGT)
Cluster Cluster DB srv A/S
A/S DB Group A/S DB Group

MQ MQ1 MQ MQ1
Bank etc MFS DB Ser1 MFS DB Ser2
HA Active-GRP1 HA Standby-GRP1
F5
RCS RCS
F5 GRP Short term Short term
Internal 3rd HA Active-GRP2 HA Standby-GRP2 DB DB
Parties DMZ Ser1 Short DB srv A/S
FS SR FS SR
A/S DB Group A/S DB Group
External 3rd SSO BTS SSO BTS Shorterm-DB Ser1 Shorterm-DB Ser2
Virtual Firewall
Parties
Virtual Firewall
Virtual Firewall
RCS AAS RCS AAS
HA Active-GRP3 HA Standby-GRP3 RPT DB RPT DB
F5 APP Ser1 APP Ser2 A/S DB GRP A/S DB GRP

Telkomsel F5 GRP Report DB Ser1 Report DB Ser2
CoreNet
DMZ Ser1
AMLDB AMLDB
BCS BCS
Cluster Cluster A/S DB GRP A/S DB GRP

Virtual Firewall BCS Ser1 BCS
BCS Ser2
Ser2 AMLDB Ser1 AML DB Ser2
DIP RA DIP RA
BCM&DB BCM&DB
HA Active HA Sta ndby
HA Active-GRP1 HA Active-GRP2
I200 0 Ser1 I200 0 Ser2
Report Ser1 Report Ser2 Long Long Long
Term DB Term DB Term DB
AML AML
HA Active HA Sta ndby HSM HSM
Longterm DB
AML Ser1 AML Ser2 Cluster1 Cluster2
Operation Zone DMZ Zone Apps Zone Data Zone
Remote access information:
We use VPN for access remote.
1.2 Purpose
This is to cancel IMT Pending transaction as bugs from R5 Patch.
This time is to cancel and complete all TRX ID based on request from Customer
RE Cancel trx
Remittance - 5F99JIIF5J.msg

Change scenario: Data configuration
Change solution category: Data configuration
Change scope: scope for below

Hostname Version
TXNDB Oracle 11.2.4.0
MGTDB Oracle 11.2.4.0
Change time:
22:00, 11 27, 2018 to 03:00 11 28, 2018
1.3 Description of Change and Change Influence
MFS TSEL Indonesia
Product Type Current Version Target Version
TXNDB Normal Oracle 11.2.4.0 Oracle 11.2.4.0
MGTDB Normal Oracle 11.2.4.0 Oracle 11.2.4.0
Node IP
TXNDB 10.49.43.154
MGTDB 10.49.43.130
Relative NE Relative Impact

I2000 No Impact
2 Preparations for Change
2.1 Change period
This activity will be implemented at

22:00, 11 27, 2018 to 03:00 11 28, 2018
Operational Window (27-28 Sept 2018 10pm – 03am) JKT Time

Task Start time End time Date
Prepare PIC 19:00 20:00 25 Sept
Take backup 22:00 22:30 25 Sept
Execution 22:30 01:00 25 Sept
Post testing 01:00 01:30 26 Sept
Monitoring 01:30 02:00 26 Sept
2.2 Composition of Change Team and Responsibility of Team

Members
2.2.1 Change Team of Huawei Company（Customer）
Name Responsibility Telephone No.
Yudi – 081291013475
Yudi Ariyanto Chief commander
Owner for MFS product Yudi – 081291013475

Yudi Ariyanto
change
Endhy Bonus PT Telkomsel +62 811-1701-861
2.2.2 Huawei On-site Change Team
Yudi Ariyanto Engineer 081291013475

2.2.3 Huawei Support & Guarantee Team
Lizhijie RND 075513510127247
2.3 Check of Equipment Running
No. Check Items Description Result/status
1 KPI Inbound The success rate is not decreased than several hours before implementation
Transaction
2 Alarm Alarm MFS There is no critical

Below is some alert but no service impact and related with I200 0 monitoring servers

3 Equipment CPU & CPU <=90%

running status Memory Memory <= 80%
Live DB
PIC check of equipment is Yudi Ariyanto - 081291013475
2.4 Change Risks and Countermeasures
No Impact with MFS services
N Risk Description Possibility Impact Countermeasure
o. (High/Mid (High/Mi
dle/Low) ddle/Lo
w)
OGG may be have Medium Medium Check log and share to RnD
1
problem
Script to update TXN and Low Low Check log and share to RnD
2 MGT is error due to some
reason

2.5 Check before Change
No. Preparations Before Change Owner Completion Date
1 Check backup original Order ID from Yudi ARiyanto –

27 Nov 2018
backup table 081291013475
2 Check Script before execution Yudi ARiyanto –

27 Nov 2018
081291013475
3 Readiness of support & guarantee team Yudi ARiyanto –

27 Nov 2018
(RND and GTAC) 081291013475
3 Operation Steps for Change
3.1 Change Steps
 Backup
 Execution
 Service testing
3.1.1 Overall Description
I. Backup
II. Execution
III. Service Testing
Task Sub-task Recommended Start Duration Owner

Time
Backing Up Backing Up Backup 10:00 PM-11:00 PM Yudi Ariyanto – BO MFS

081291013475
Zhengyingxu -
006281280442506

Task Sub-task Recommended Start Duration Owner

Time
Performing Change Execute The new change when 11PM-02:00AM Yudi Ariyanto – BO MFS
the new config is 081291013475
installed
Zhengyingxu -
006281280442506
Verification after The day when the new 02:00 AM – 03:00 AM Yudi Ariyanto – BO MFS
execution Verifying config is installed 081291013475
Zhengyingxu -
test 006281280442506
3.1.2 Operation Steps for Change
No. Change Step Operation Implementati Time
on Person
1. Yudi Ariyanto (11.27)
0812910134 22:00 – 22:30
75
Backup data Backup Zhengyingxu
0062812804
42506

2 Yudi (11.27) –(11.28)
ARiyanto -
0812910134 22:30 – 00:30
75
Execution Execution
Zhengyingxu
0062812804
42506
3 Yudi (11.28)
ARiyanto - 00:30 – 02:00
0812910134
75
Data check Testing
Zhengyingxu
0062812804
42506
The following is the changes that will be executed
Below point 1 – 3 has been done from previous activity. So no need to execute again.
1. Copy and extract Pending_TXN_Patch folder to server
2. Modify the user_define.inc
define cpsmgt_user_name to cpsmgt
define cpstxn_user_name to cpstxn
define cutover_time=20180807 00:00:00
3. Backup table
Execute from TXNDB
sql_executor/execute_sql_files_parallel.sh cpstxn/**** txndb/backup.sql
sql_executor/check_sql_files_execute_result.sh txndb/backup.sql
Execute from MGTDB

sql_executor/execute_sql_files_parallel.sh cpsmgt/***** mgtdb/createTable.sql

sql_executor/check_sql_files_execute_result.sh mgtdb/createTable.sql
export data B$txn_cps_ordertodo4pend from txndb and put as sql file
Insert the data to the B$txn_cps_ordertodo4pend table in the mgt database.
sql_executor/execute_sql_files_parallel.sh cpsmgt/****** mgtdb/backup.sql

sql_executor/check_sql_files_execute_result.sh mgtdb/backup.sql
4. Upgrade or add procedure

Execute TXNDB
sql_executor/execute_sql_files_parallel.sh cpstxn/****** txndb/upgrade.sql
sql_executor/check_sql_files_execute_result.sh txndb/upgrade.sql
Execute MGTDB
sql_executor/execute_sql_files_parallel.sh cpsmgt/****** mgtdb/upgrade.sql
sql_executor/check_sql_files_execute_result.sh mgtdb/upgrade.sql
sql_executor/execute_sql_files_parallel.sh cpsmgt/****** mgtdb/rollback.sql

sql_executor/check_sql_files_execute_result.sh mgtdb/rollback.sql
Execute TXNDB
sql_executor/execute_sql_files_parallel.sh cpstxn/****** txndb/rollback.sql
sql_executor/check_sql_files_execute_result.sh txndb/rollback.sql
1. Check ordered whether on backup table
select * from cpstxn.B$txn_cps_ordertodo4pend t where

t.reason_type='10002382' and t.orderid in (‘5F99JIIF5J’)
cancel 1 IMT.csv
2. Do Adjustment by Finance Team

Singtel must deduct from Reserve balance
Singtel must added from available balance
Post Pos deduct from unclear balance
3. Execute

Login to oracle , cpstxn
sqlplus cpstxn/******
Below is original data from
EXEC_prc_clean_pending_txn(‘5F99JIIF5J’,'20180610 03:48:50','Cancelled');
Login to oracle , cpsmgt
sqlplus cpsmgt/******
EXEC_prc_clean_pending_mgt(‘5F99JIIF5J’,'20180610 03:48:50','Cancelled');
3.2 Test and Verification
No. Operation Operation Method Owner Time

Item
1 Check Check transaction from CPS , the Yudi 00:30 – 01:00
status of ordered must cancelled ARiyanto -
0812910134
75

2 Monitoring Monitoring service by I2K for alarm Yudi 01:00 – 01:15
ARiyanto -
0812910134
75
Detail test verification and monitoring

No. Operation Item Operation Method Owner Time
1 MFS service test Test OGG Yudi 01:15 – 01:30
Oracle> g ARiyanto -
Oracle> info all 08129101347
5
Zhengyingxu -
006281280442
506
3.3 Solution for Chargeback In the Case of Failure
3.3.1 Definition of Change Failure
 Change failure will be happened if there is increasing failure and there is

complaint from customer post implementation
- PIC who determine rollback

o Panhui – 6285213656877 – Huawei
o Annisa – 62811939968 -- Telkomsel
- Deadline for this rollback is at 02:00
- Change back time : 01:30am – 02am

3.3.2 Overall Description of Chargeback
 Restore backup
 Testing
3.3.3 Information Collection before Chargeback
Collect application logs
3.3.4 Chargeback Steps
The standard operation will be take will be like below

No. Change Step Operation Implementat Time
ion Person
1 Yudi (11.28)
ARiyanto – 01:30 – 02:00
081291013
475
Restore backup Rollback Zhengyingxu
0062812804
42506

2 Yudi (11.28)
ARiyanto – 02:00 – 02:30
081291013
475
Testing Verification Zhengyingxu
0062812804
42506
Below are commands that will be executed for rollback:
 TXNDB
sqlplus cpstxn/******
EXEC prc_rollback_pending_txn all ordered complete
EXEC prc_rollback_pending_txn all ordered cancelled
 MGTDB
 sqlplus cpsmgt/******
 EXEC prc_rollback_pending_mgt all ordered complete
 EXEC prc_rollback_pending_mgt all ordered cancelled
3.3.5 Equipment Status Check
We need to check below status
1 KPI MFS Transaction can work Result is working properly

properly after change

2 Alarm Alarm MFS There is no critical alarm

in MFS
3 Equipment CPU & Memory CPU <=90%
running status Memory <= 80%
PIC is Yudi Ariyanto - 081291013475
3.3.6 Tests After Chargeback
No. Operation Item Operation Method Owner Time

1 Check MFS Check transaction by BICP Yudi ARiyanto – 02:00
service report tool 081291013475 –
Zhengyingxu - 02:15
00628128044250
2 MFS Check DB status by Yudi ARiyanto – 02:15
Performance console 081291013475 –
checking Oracle > g Zhengyingxu - 02:30
Oracle> info all 00628128044250
3.3.7 Chargeback Risk Analysis
No. Risk Description Possibility Impact Countermeasure
(High/Midd (High/Mid
le/Low) dle/Low)
Order iD status in CPS is Low Low Take Tracelog and share to RnD
1
not change after rollback

OGG is not sync to Low Low Check OGG Log and share to RnD
2 ShortermDB after
rollback
3.4 Change of Spare Parts and Emergency Workstation

No need as this is software update
4 Work after Change
4.1 Observation
No. Operation Items: Expected Result Operation method Owner Time Telp
1 Keep monitoring with Alarm, Expected : there is Through U2000 Guntur 02:30 – 0062812
and running status check should be no critical about alarm 02:45 4888278
and major alarm
2 Check MFS Transaction from Expected:No No increasing Guntur 02:45 – 0062812

SQL query Issue with transaction, Error on MFS 03:00 4888278
still updated and error Transaction by SQL
total is normal
query
select
to_char(endtime,'yy
yymmdd'),
t.errorcode,
count(*)
total_number,
substr(t.errormessa
ge,1,10)
from
cpstxn.cps_orderhis
t

where
t.endtime >=to_date
('2018-11-27
22:00:00','yyyy-MM-
dd HH24:mi:ss')
and t.endtime <=
to_date('2018-11-
28 03:59:59','yyyy-
MM-dd
HH24:mi:ss')
and t.orderstate not
in ('Completed',
'Expired')
group by
to_char(endtime,'yy
yymmdd'),
t.errorcode,
substr(t.
errormessage,
1,10)
order by
to_char(endtime,'yy
yymmdd')
asc,total_number
desc;
4.2 Provision of Materials

Not required

4.3 Provision of Software

Not required
4.4 Training
Not required
4.5 Matters Needing Attention

Not required


(Huawei) (CPS) (TSEL MFS Cancel IMT Pending TRX 003)

Transféré par

Informations du document

Description originale:

Titre original

Copyright

Formats disponibles

Partager ce document

Partager ou intégrer le document

Options de partage

Avez-vous trouvé ce document utile ?

Ce contenu est-il inapproprié ?

Droits d'auteur :

Formats disponibles

(Huawei) (CPS) (TSEL MFS Cancel IMT Pending TRX 003)

Transféré par

Droits d'auteur :

Formats disponibles

TSEL SPECIFIC MOP

Prepared by: YUDI ARIYANTO Date: 20181127

Reviewed by: LIZHIJIE Date: 20181127

Approved by: ZHENGYINGXU Date: 20181127

Technical support website: Technical support hotline: Page 2 of 20

1.1 Description of Site

NE Name Version Number Remark

A/S DB Group A/S DB Group

RCS AAS RCS AAS

HA Active-GRP3 HA Standby-GRP3 RPT DB RPT DB

F5 APP Ser1 APP Ser2 A/S DB GRP A/S DB GRP

Cluster Cluster A/S DB GRP A/S DB GRP

Operation Zone DMZ Zone Apps Zone Data Zone

Remote access information:

We use VPN for access remote.

This is to cancel IMT Pending transaction as bugs from R5 Patch.

Technical support website: Technical support hotline: Page 3 of 20

Change scenario: Data configuration

Change solution category: Data configuration

Change scope: scope for below

MGTDB Oracle 11.2.4.0

22:00, 11 27, 2018 to 03:00 11 28, 2018

1.3 Description of Change and Change Influence

MFS TSEL Indonesia

Product Type Current Version Target Version

TXNDB Normal Oracle 11.2.4.0 Oracle 11.2.4.0

MGTDB Normal Oracle 11.2.4.0 Oracle 11.2.4.0

Relative NE Relative Impact

2 Preparations for Change

2.1 Change period

This activity will be implemented at

22:00, 11 27, 2018 to 03:00 11 28, 2018

Operational Window (27-28 Sept 2018 10pm – 03am) JKT Time

2.2 Composition of Change Team and Responsibility of Team

2.2.1 Change Team of Huawei Company（Customer）

Name Responsibility Telephone No.

Owner for MFS product Yudi – 081291013475

Endhy Bonus PT Telkomsel +62 811-1701-861

2.2.2 Huawei On-site Change Team

Name Responsibility Telephone No.

Yudi Ariyanto Engineer 081291013475

Technical support website: Technical support hotline: Page 5 of 20

2.2.3 Huawei Support & Guarantee Team

Name Responsibility Telephone No.

Lizhijie RND 075513510127247

2.3 Check of Equipment Running

No. Check Items Description Result/status

2 Alarm Alarm MFS There is no critical

Technical support website: Technical support hotline: Page 6 of 20

No. Check Items Description Result/status

3 Equipment CPU & CPU <=90%

PIC check of equipment is Yudi Ariyanto - 081291013475

2.4 Change Risks and Countermeasures

No Impact with MFS services

N Risk Description Possibility Impact Countermeasure

2 MGT is error due to some

Technical support website: Technical support hotline: Page 7 of 20

2.5 Check before Change

No. Preparations Before Change Owner Completion Date

1 Check backup original Order ID from Yudi ARiyanto –

2 Check Script before execution Yudi ARiyanto –

3 Readiness of support & guarantee team Yudi ARiyanto –