Diversity of SITE

New Perspectives for Customer Experience Testing

Keynote SIGOS GmbH Klingenhofstrasse 50d 90411 Nuremberg Germany www.keynote-sigos.com Date: 30th October 2008

Selected SITE Functionality

SITE Recorder GIS Interface

Iu-PS

Iu-CS

WLU

Core Network Testing in GSM & UMTS Wireless Service Quality Monitoring Drive Service Testing MLU
2008 Keynote SIGOS

Handset Simulation
2

Testing is our Competence

Core Network Testing in GSM & UMTS

Iu-PS

Iu-CS

Core Network Testing in GSM & UMTS Wireless Service Quality Monitoring Drive Service Testing Handset Simulation
2008 Keynote SIGOS 3

Testing is our Competence

Core Network Testing in GSM & UMTS

Functionality Emulation of entire radio access networks plus mobile terminals Active simulation of up to 30 subscribers / LU Support of all relevant SITE Test Applications Benefits Significantly increased test performance compared to mobile probes
e.g. testing time f. attach/detach decreases from appr. 1 min to 3 secs

NEW

Air interface problems do not affect testing results KPIs as well as faults can be isolated to pure core network Perfectly geared for testing services with crucial network components in core network

2008 Keynote SIGOS

Testing is our Competence

Core Network Testing in UMTS

Functionality State-of-the-art technology: IP Support of packet and circuit switched services Protocol conformance checks Enhanced Protocol decoding capabilities New Hardware: 4-port Iu board for both ps & cs

Benefits Early Availability of Iups & Iucs over IP testing solution Erroneous messages from the core network can be detected Entire protocol stack can be traced

2008 Keynote SIGOS

Testing is our Competence

Wireless Service Quality Monitoring

WLU Core Network Testing in GSM & UMTS Wireless Service Quality Monitoring Drive Service Testing Handset Simulation
2008 Keynote SIGOS 6

Testing is our Competence

Wireless Service Quality Monitoring

WLU

Functionality Permanent IP connection established via GPRS/EDGE/HSPA modem New LU: Wireless Local Unit (WLU) WLU upholds GPRS connection with IPSec tunnel Router gets private IP address and represents WLU Up to 3 probes for concurrent tests
IPsec GPRS/HSPA
Mobile Network

x
No IP connection WAN

Benefits Fast installation of test probes for fault isolation No Dependency on wired IP connections No fixed IP address required Same look n feel for LU, CLU and WLU

Router

Virtual SIM card transfer

IP connection

Synchronized tests between WLUs and LUs possible

CU/SIMMUX
2008 Keynote SIGOS 7

Testing is our Competence

Wireless Service Quality Monitoring

Prerequisites General availability of mobile packet network (GPRS/EDGE/UMTS/HSPA) -> Ideally UMTS/HSPA One probe (MC8775) solely installed for communication -> Not available for SITE test cases Number of parallel tests determined by actual bandwidth: -> 20 kbit/sec uplink per interface required -> Main bandwidth consumers are traces and result files Round trip delay of less than 1,5 seconds Firewall settings for WLU recommended for security reasons One SIM / interface to maintain permanent wireless IP connection Geared for wireless deployment; not suitable for moving subscribers WLU = Portable local unit for flexible deployment in the field

2008 Keynote SIGOS

Testing is our Competence

Drive Service Testing

GIS Interface

Core Network Testing in GSM & UMTS Wireless Service Quality Monitoring Drive Service Testing MLU
2008 Keynote SIGOS

Handset Simulation
9

Testing is our Competence

Drive Service Testing Concept

TestCases / KPIs for moving subscribers performing end to end services in addition to static subscriber probes Introduction of moving subscriber probes: Mobile Local Units (MLU) Information displayed on a brightly coloured geographic map (GIS) Geared for vehicles like taxis, trucks or trains
Geographic Information System (GIS)
GPS Position

Customers Map Server

Clients

Mobile LU in car

LAN/WAN
Central Unit

SIM Multiplexer Static LU

Mobile LU in train

Permanent IP Connection Non-Permanent IP Connection

2008 Keynote SIGOS 10

Testing is our Competence

Drive Service Testing

Functionality MLU connected to wiring system of moving vehicle MLU automatically started with vehicle engine ignition After shut down of car engine MLU keeps running for 15 minutes to avoid too frequent booting Fully automated test cases, even beyond the automation grade of previous SITE System Every test case initiates powering up and booting of relevant wireless probes Up to four probes can perform test cases simultaneously (3 recommended) During entire test drive test case keeps running in cyclical mode Test case setup done via common SITE test case editor Non-permanent IP connection between MLU and Central Unit (via e-mail server) Retrieval and sending of e-mails performed every 15 minutes (Proposed value)

2008 Keynote SIGOS

11

Testing is our Competence

Drive Service Testing GIS Interface

Functionality Graphical presentation on your network quality performed by SITE Geographic Information System (GIS) Rich set of KPIs diplayed on geographic map according to GPS data recorded for each Drive Service Test Case WMS maps, e.g. operators own coverage map, display KPIs customizable by operator MapInfo, serves as the GIS engine for SITE Drive Service Tests Support of maps according to Web Map Service (WMS) Display of the KPIs can be customized by operator Periodicity of map refresh configurable Graphic views export in JPEG format
2008 Keynote SIGOS 12

Testing is our Competence

Drive Service Testing Mobile Local Unit

Functionality MLU based upon CLU Non-permanent IP connection Communication between SITE Central Unit & MLU performed by transferring data via the email server E-mail server sends e-mail responses (result data, status messages) and receives test jobs One probe used for UMTS/GPRS communication with the SITE Central Unit Same air interfaces supported as for CLU Duplication of some central software functions:
Scheduler, Resource Manager and Test Execution Manager also implemented in MLU
non-permanent IP connection via e-mail

Central Unit

E-Mail Server

permanent IP connection

Fixed SIM in MLU Tested for off-road usage

2008 Keynote SIGOS

MLU
13

Testing is our Competence

MLU Random Vibration Test

2 hours of vibrations in X-axis 2 hours of vibrations in Y-axis 2 hours of vibrations in Z-axis

Same standard random vibration test as performed for electrical and electromechanical components of MAN vehicle cabs (Random IEC 60068-2-64) 6 hours of random vibration testing in the frequency range between 10 and 2000Hz MLU fully operational during vibrations; all probes equipped with SIM-Card & connected via Ethernet to master system

2008 Keynote SIGOS

14

Testing is our Competence

Drive Service Testing Key Benefits

Autonomous System -> No engineer needs to be present in the vehicle Easy Installation and Removal -> Once MLU connected to wiring
system, no further human interaction required

Enhanced Service Assurance -> Independent view of end-to-end

quality for static & moving customers

Network Optimization -> Troubleshooting & optimization for new

technology networks

Benchmarking -> Comparison with quality of competitors networks Test Cases -> Issues of most customer concern covered Geographic View -> Challenging set of KPIs displayed on map Interfaces -> All CLU SITE interface probes supported Investment Protection -> Extension to existing SITE system securing
current investment into Keynote SIGOS service assurance products

2008 Keynote SIGOS

15

Testing is our Competence

Handset Simulation
SITE Recorder

Core Network Testing in GSM & UMTS Wireless Service Quality Monitoring Drive Service Testing Handset Simulation
2008 Keynote SIGOS 16

Testing is our Competence

Handset Simulation Network / SITE Evolution

Complex Web/WAP transactions Handset specific services Ringtones, Music DL, Games

IP, MMS, WAP Service

Interactive Recorder

Handset Simulation

Service Tests with fixed Handset characteristics

2008 Keynote SIGOS 17

Testing is our Competence

Handset Simulation
Functionality
SITE Testcase Application Server

Test of specific handset characteristics against network services Device specific monitoring of pages with fixed content/ URLs Test cases for WAP and MMS monitoring as well as Web browsing Compliant to ETSI STQMobile

Emulation of UAProfiles Flexible WTP HTTP protocol stack

Request URL Send MMS

Check UAProfiles

Content Validation against Handset capabilities

Response Content Push Content

Content

Handset library contains UAProfiles and capabilities of more than 1000 devices Handset simulation does NOT test real devices or the original handset browser

2008 Keynote SIGOS

18

Testing is our Competence

Handset Simulation Content Validation

Keyword Validation Search for defined words or phrases within the downloaded content Color Support Check if device is capable of displaying colored images Image Size Comparison of all downloaded images with maximum height and width of the device Deck Size Comparison of downloaded size item with deck size of device (WAP1.x) Content Support Check (based on HTTP/WTP accept header) if device can decode downloaded content. Data Format Check if the downloaded content is valid

2008 Keynote SIGOS

19

Testing is our Competence

Handset Simulation SITE Recorder

r wse ser w Bro Bro

with orwithase Edit r tt a -EditoTescc se TC TC- plaeeTes t m lat Te p Tem

e Trac ace Tr
Functionality
2008 Keynote SIGOS

Intuitive creation of browsing test cases New frame test case and Recorder GUI
Testing is our Competence

Handset Simulation SITE Recorder Integration in SITE

SITE Test Editor SITE Recorder

SITE Test Editor SITE Test Editor

SITE Test Case Editor

Save Browsing Session as new test case in TC-Editor

2008 Keynote SIGOS

21

Testing is our Competence

Handset Simulation SITE Recorder

Benefits Intuitive Recording of browsing actions -> No drag n drop Support of HTML forms Easy creation & adaptation of browsing sessions SITE integrated Received page content at a glance KPIs for each browsing action User defined measurements / KPIs can be added with TC-Editor

2008 Keynote SIGOS

22

Testing is our Competence

Conclusion

Mobility
Drive Service Testing

Handset Simulation
Characteristics of mobiles

Portable Units
Wireless Service Quality Monitoring

Core Network
Efficient Short-cut solutions

Intelligent KPI Monitoring

Dashboard & Service Area Monitoring

Revenue Assurance
CDR & billing verification

Diversity of SITE offers new perspectives for Customer Experience Testing

2008 Keynote SIGOS

Testing is our Competence

Thank you
Christian.Pestel@keynote-sigos.com

2008 Keynote SIGOS

24

Testing is our Competence