WHEN QUALITY MATTERS

QualiPoc 10.6 Speech and Video

Test Description April 2011

SwissQual License AG Allmendweg 8 CH-4528 Zuchwil Switzerland t +41 32 686 65 65 f +41 32 686 65 66 e info@swissqual.com www.swissqual.com

Part Number: 16-100-200549-1 Rev 10.6

SwissQual has made every effort to ensure that eventual instructions contained in the document are adequate and free of errors and omissions. SwissQual will, if necessary, explain issues which may not be covered by the documents. SwissQuals liability for any errors in the documents is limited to the correction of errors and the aforementioned advisory services. Copyright 2000 - 2011 SwissQual AG. All rights reserved. No part of this publication may be copied, distributed, transmitted, transcribed, stored in a retrieval system, or translated into any human or computer language without the prior written permission of SwissQual AG. Confidential materials. All information in this document is regarded as commercial valuable, protected and privileged intellectual property, and is provided under the terms of existing Non-Disclosure Agreements or as commercial-in-confidence material. When you refer to a SwissQual technology or product, you must acknowledge the respective text or logo trademark somewhere in your text. SwissQual, Seven.Five, SQuad, QualiPoc, NetQual, VQuad, Diversity as well as the following logos are registered trademarks of SwissQual AG.

Diversity Explorer, Diversity Ranger, Diversity Unattended, NiNA+, NiNA, NQAgent, NQComm, NQDI, NQTM, NQView, NQWeb, QPControl, QPView, QualiPoc Freerider, QualiPoc iQ, QualiPoc Mobile, QualiPoc Static, QualiWatch-M, QualiWatch-S, SystemInspector, TestManager, VMon, VQuad-HD are trademarks of SwissQual AG. SwissQual acknowledges the following trademarks for company names and products: Adobe, Adobe Acrobat, and Adobe Postscript are trademarks of Adobe Systems Incorporated. Apple is a trademark of Apple Computer, Inc. DIMENSION, LATITUDE, and OPTIPLEX are registered trademarks of Dell Inc. ELEKTROBIT is a registered trademark of Elektrobit Group Plc. Google is a registered trademark of Google Inc. Intel, Intel Itanium, Intel Pentium, and Intel Xeon are trademarks or registered trademarks of Intel Corporation. INTERNET EXPLORER, SMARTPHONE, TABLET are registered trademarks of Microsoft Corporation. Java is a U.S. trademark of Sun Microsystems, Inc. Linux is a registered trademark of Linus Torvalds. Microsoft, Microsoft Windows, Microsoft Windows NT, and Windows Vista are either registered trademarks or trademarks of Microsoft Corporation in the United States and/or other countries U.S. NOKIA is a registered trademark of Nokia Corporation. Oracle is a registered US trademark of Oracle Corporation, Redwood City, California. SAMSUNG is a registered trademark of Samsung Corporation. SIERRA WIRELESS is a registered trademark of Sierra Wireless, Inc. TRIMBLE is a registered trademark of Trimble Navigation Limited. U-BLOX is a registered trademark of u-blox Holding AG. UNIX is a registered trademark of The Open Group.

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

Contents
1 Introduction .......................................................................................................................................... 1 Overview of Speech and Video Call Tests ............................................................................................ 1 A-Side and B-Side Tests ....................................................................................................................... 2 Video Call Tests ............................................................................................................................... 2 Call Direction .................................................................................................................................... 3 Sample Direction During a Test ....................................................................................................... 4 Sequence of Call Setup and Playing Samples................................................................................. 4 Call to Any Number Test ....................................................................................................................... 5 Call to Diversity Voice Server Test ........................................................................................................ 5 2 Configuring an A-Side or B-Side Speech or Video Call Test .......................................................... 7 Configuring a Diversity Voice Server as a B-Side Device .............................................................. 11 Starting a Double-Ended Speech or Video Call Test .......................................................................... 12 Monitoring a Speech or Video Call Test .............................................................................................. 12 Log View ......................................................................................................................................... 13 3 Configuring a Speech or Video Call to Any Number Test ............................................................. 15 Starting a Call to Any Number Test ..................................................................................................... 16 Monitoring a Call to Any Number Test................................................................................................. 17 A Abbreviations ..................................................................................................................................... 18

Figures
Figure 1-1 Overview of a speech call test ......................................................................................................... 3 Figure 1-2 Call direction for a 2:1 MOC/MTC ratio ............................................................................................ 4 Figure 1-3 Sample direction during a measurement ......................................................................................... 4 Figure 1-4 Sequence of tones and samples ...................................................................................................... 5 Figure 2-1 Creating a new A-Side or B-Side test .............................................................................................. 7 Figure 2-2 Main Job edit view for an A-Side or B-Side test............................................................................... 7 Figure 2-3 General settings for an A-Side or B-Side test .................................................................................. 8 Figure 2-4 Total test duration for A-Side or B-Side test .................................................................................... 9 Figure 2-5 Reference sample settings ............................................................................................................. 10 Figure 2-6 Timing options for an A-Side or B-Side test ................................................................................... 10 Figure 2-7 Log view for a Speech or Video Call test ....................................................................................... 13 Figure 3-1 Creating a new Call to any number test ......................................................................................... 15 Figure 3-2 Main settings for a Call to any number test .................................................................................... 15 Figure 3-3 General settings for a Call to any number test............................................................................... 16 Figure 3-4 Main settings for Call to any number test ....................................................................................... 16

Tables
Contents | CONFIDENTIAL MATERIALS ii

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

Table 2-1 Description of the settings on the main Job edit view for an A-Side or B-side test ........................... 7 Table 2-2 Description of general settings for an A-Side and B-Side test .......................................................... 8 Table 2-3 Description of the reference sample settings .................................................................................. 10 Table 2-4 Description of the timing options for an A-Side or B-Side test ........................................................ 10 Table 2-5 Description of events in the Log view for a Speech or Video Call test............................................ 13 Table 3-1 Description of the settings in the main Job Edit view for a Call to any number job ....................... 15 Table 3-2 Description of the General settings for a Call to any number test ................................................... 16 Table A-1 Description of abbreviations ............................................................................................................ 18

Contents | CONFIDENTIAL MATERIALS

iii

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

Introduction

The QualiPoc 10.6 Speech and Video Test Description provides an overview of the following types of QualiPoc Speech and Video Call/Streaming tests: Speech: A-Side and B-Side LQ assessment tests Call to any number (access test) Video call test (access test) Video call to any number (access test)

Note: For a description of the abbreviations in this document, see the "Abbreviations" section on page 18. Intrusive, that is, double-ended tests, require a dedicated channel in the test system. The test transmits a predefined reference signal through this channel. The test assesses the quality of the calls by comparing the originating call signal (A-Side) to the received call signal (B-Side). Non-intrusive tests, that is, single-ended tests do not require a dedicated channel in the test system. These tests assess an unknown sample and do not occupy network resources to the same extent that intrusive tests do.

Overview of Speech and Video Call Tests

You can perform the following QualiPoc Speech Call tests to assess the functionality and quality of speech calls on a network. Note: To calculate the MOS speech quality, QualiPoc sends a predefined reference audio sample over the network. Speech Call Test: Assesses the functionality and quality of voice calls on a network. You can start the call on an A-Side or a B-Side device, which can be a mobile phone or a Diversity voice server. You can also use a dedicated service number, that is, IVR, for either side of the test. Call to Diversity Voice Server: Standard speech test where the Voice Call Server is controlled with DTMF tones that are sent to an ISDN or PSTN device that is connected to the server. You need to use this test if your Voice Call Server does not have access to an IP enabled network.

Note: Before the test starts, the A-Side device sets up a full configuration call to select the test on the BSide and to synchronize the measurement windows of both sides. Call to Any Number Test: Simple variant of the standard speech test that sets up a call for a specified amount of time. This test does not assess the speech quality of the call. Video Call Test: Same as the standard speech test except that the call is a video call instead of a voice call. This test cannot record the call. Video Call to Any Number: Same as the Call to any number test except that the call is a video call instead of a voice call.

Chapter 1 | Introduction CONFIDENTIAL MATERIALS

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

A-Side and B-Side Tests

During a double-ended speech or video call test, the following sequence of events occurs: One device initiates a configuration call to the other device Other device sends a synchronization tone to the calling device Calling device synchronizes to the tone and the sample sequence starts on both devices One device starts to play a speech or video sample Other device records the sample

Note: Video call tests cannot record the sample. Recorded sample is compared to a local reference and MOS quality value is calculated. Calling device terminates the call

This sequence repeats for the amount of cycles, that is, window duration that you specify for the test. For more information on test settings, see the "Configuring an A-Side or B-Side Speech or Video Call Test" chapter on page 7. Configuration calls are required for Mobile to Mobile and Mobile to Diversity Voice Server B-Side devices while the following tests do not require a configuration call: Call to any number Call to Answering Station or Service Number (IVR)

Figure 1-1 on page 3 provides an overview of a speech call test. The general flow of a speech call is similar on the A-Side and B-Side devices except for the call and the sample directions. Each test starts with the 1 call setup delay which is followed by a consecutive series of call windows, that is, cycles. These two parameters are the same on both sides of the test. Note: On a trace capable phone, the call starts with trace capability setup which is followed by the actual test phase, that is, 1st call setup delay and the call windows. The behaviour of the test inside the call windows is determined by the job settings that you specify and the st network conditions. For a successful test, the call connects before the 1 call setup delay expires and terminates before the guard time ends. The guard time ensures that the call successfully terminates at the end of the test cycle. If the first call setup fails and the call terminates when the timeout is reached, the test attempts to reconnect after the amount of time that you specify. However, if this attempt exceeds the guard time, the call disconnects.
st

Video Call Tests

The test flow for Video call is exactly the same as for the speech call test. The main difference is that the call is a video call instead of a speech call. A Video Call Test establishes a Video Call and calculates the video quality of the presented video display. This test can only be done on trace-capable phones. To establish a Video Call there must be a 3G Network available. A Video Call Test with video quality evaluation (MOS-Value) must establish the call to a Video Call Server which transmits a predefined video sample to the A-Side. In combination with NQTM such a test can be easily configured and run automatically.

Chapter 1 | Introduction CONFIDENTIAL MATERIALS

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

Trace setup (10sec) , only on TRACE mobiles

1st Call Setup Delay

Window duration

Window duration Call Window

Window duration Call Window

Call Window

Overall Job duration

Call duration

Call Setup

Call Window Call

Guard Time

Start dial

Connect

Max. Call Setup Time Call duration Call Window Call Setup

Call Setup

Pause

Call

Guard Time

Start dial Disconnect because failed

Start dial #2

Connect

Disconnect because Guard Time

Figure 1-1 Overview of a speech call test

Call Direction
The call direction of A-Side and B-Side tests is specified by Mobile Originated Call (MOC) and Mobile Terminated Call (MTC) values respectively.

Parameter
MOC-only MOC/MTC MTC-only

Ratio
MOC/MTC = X:0 MOC/MTC = 1:X MOC/MTC = 0:X

X Value
(X>0) (X>0) (X>0)

For example, if the MOC/MTC ratio is 2:1, the A-Side device initiates the call in the first two call windows while the B-Side device initiates the call in the third call window. Similarly, the B-Side device terminates the call in the first two call windows while the A-Side device terminates the call in the third call window. The test
Chapter 1 | Introduction CONFIDENTIAL MATERIALS 3

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

repeats this call direction sequence for the duration of the measurement.

Trace setup (10sec) , only on TRACE mobiles

1st Call Setup Delay

A-

Call Window

Call Window

Call Window

B-

Call Window

Call Window

Call Window

Figure 1-2 Call direction for a 2:1 MOC/MTC ratio

Sample Direction During a Test

During a double-ended test one side plays a sample and the other side listens for and measures the quality of the sample. The sample direction can either be from A to B, where the A-Side device plays the sample and B-Side device listens for the sample or from B to A, where B plays the sample and A listens for the sample. The test repeats this sample direction for the duration of the measurement. Note: Each test is equal to one speech sample.

A-

Sample Interval

Call Sample Interval

Sample Interval

B-

Sample Interval

Call Sample Interval

Sample Interval

Figure 1-3 Sample direction during a measurement

Sequence of Call Setup and Playing Samples

After a successful call setup, the test plays a defined sequence of sounds on the called side. The A-Side searches for this BD-DTMF sequence, that is, synchronization tone and then starts to record and evaluate the speech samples.

Chapter 1 | Introduction CONFIDENTIAL MATERIALS

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

Connect Start dial Synch Twitcher & Cocodjojo Speech sample Speech sample

Call Setup

Sample

Call Window Call

Sample

Sample Interval Connect to Synch

Sample Interval

Synch to Sample delay

Figure 1-4 Sequence of tones and samples

The called side plays the following sequence of tones and samples: Twitcher and Cocodjojo sample: Serves as line opener for QualiPoc Synchronization sample: Combination of four multi-frequency tones, namely a regular DTMF BTone and D-Tone as well as two higher frequency tones that are outside of the DTMF-frequency range which trigger the recording start on QualiPoc phones. This reference sample is played after the Connect to synch delay that you specify.

Note: For standard answering machines, this delay is 7 seconds. The delay must provide the phone enough time to play the sample and to switch between the phone application and the QPAEngine after the connection is established. WAV reference speech sample: Plays 2.6 seconds after the synchronization sample start. The voice starts on the reference sample after two seconds of silence, so the actual delay is 2.8 seconds for the standard sample. The length of the interval in which the speech sample repeated plays depends on the length of the sample, for example, a 5 second sample corresponds to a 20 second interval and a 6 second sample corresponds to a 25 second interval.

Call to Any Number Test

The Call to Any Number test procedure is the same as the speech tests that are described in the "A-Side and B-Side Tests" section on page 2 except for the following differences: Call duration is limited to 60 seconds if you use Test Manager to configure the test Test has only one pause value, which is also used as the value for the guard time

Note: For the Video Call to Any Number Test, QualiPoc attempts to establish a video call with the receiving end.

Call to Diversity Voice Server Test

The Call to Diversity voice server test procedure is similar to the speech tests that are described in the "ASide and B-Side Tests" section on page 2. The only difference is that the configuration call uses in-band DTMF tones to select the corresponding test and in a second sequence, to synchronize the call windows for the measurement.
Chapter 1 | Introduction CONFIDENTIAL MATERIALS 5

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

Chapter 1 | Introduction CONFIDENTIAL MATERIALS

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

Configuring an A-Side or B-Side Speech or Video Call Test

This chapter describes how to manually configure an A-Side or B-Side speech or video call in the QPAEngine software on your phone. The B-Side device can be a mobile phone, a Diversity Voice Server, or s a specially configured service number, that is, answering station. The configuration of the A-Side and B-Side devices is identical. The only difference is the Job ID that QualiPoc automatically assigns the B-Side test.

To manually create an A-Side or B-Side call test

1. Start QPAEngine on the phone and select Options > Job handling > Speech Call, and then select Call MOS (A-Side) or Call MOS (B-Side). Note: For a video call, select Options > Job handling > Video Call/Streaming.

Figure 2-1 Creating a new A-Side or B-Side test

2. Specify the basic job settings. a Select Options > Create New.

Tip: If the view contains an existing job, you can select the job, select Options > Duplicate, and then select Options > Edit.

Figure 2-2 Main Job edit view for an A-Side or B-Side test Table 2-1 Description of the settings on the main Job edit view for an A-Side or B-side test

Setting
Job Name General settings Tests Timings

Description
Name of the test Specifies the duration, cycle, and general timings for the test. Select an existing test or create a new test Specifies the detailed timings of the tests such as the MOC:MTC ratio or Window duration.
7

Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test CONFIDENTIAL MATERIALS

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

Select Job Name, enter a name for the job, and then select OK.

3. Select Options > General settings, specify the general options for the test, and then select Back.

Figure 2-3 General settings for an A-Side or B-Side test Table 2-2 Description of general settings for an A-Side and B-Side test

Setting
Duration

Description
Enter the maximum measurement time for the test after which the test automatically stops. To disable this feature, enter 0. Enter the maximum number of call windows for the test. To disable this feature, enter 0.

Cycles

Note: If you specify a maximum number of cycles and a maximum duration, the test stops when one of the maximum values is reached. Enter the phone number for the A-Side device. Enter the phone number for the B-Side device. Enter the number of times to repeat the test sequence. Enter the last 8 digits of the International Mobile Equipment Identity of the A-Side mobile phone. To determine the IMEI of a Nokia phone, type *#06#

A number B number Test seq. repetition A-Sides IMEI (last 8 digits) (B-Side test only)

Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test CONFIDENTIAL MATERIALS

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

Setting

Description
Select one of the following B side device types: Answering Station: Select this type if you do not want the B-Side device to generate measurement files QualiPoc Unit: Mobile phone with QPAEngine software When the B-Side test starts, QualiPoc generates a unique job identifier so that NQDI can synchronize the measurement results from both sides. You need to type this identifier on the A-Side phone when the test starts. Diversity Voice Server: B-Side device is a voice server

B side type (A-Side test only)

Note: For information on how to configure the Diversity Voice Server as a B-Side device, see the "Configuring an A-Side or B-Side Speech or Video Call Test" on page 7. Voice Server Job-ID (For Diversity Voice Server B-side type) Record hang over [ms] Enter a unique number to identify the test. This ID is validated when you save the job. For the Qp_Default reference sample, this value must be 14500 ms. For other reference samples, this value must be 18500 ms. Enter the amount of time in seconds for the call setup procedure. QualiPoc uses this value to calculate the remaining time for the tests within a call. This value has a direct impact on the Total Duration of the test.

Average call setup [s]

4. Select Tests, and then select Options > Add > New Test. Note: You cannot specify the Total test duration value. This value is automatically calculated based on the Test seq. repetition, Record hang over, and Average call setup values as well as the reference sample that you choose. You can use this value to help you to determine the call window for the test.

Figure 2-4 Total test duration for A-Side or B-Side test

5. Select Options > Change. 6. Select the test, for example, Test 1:Speech, specify the reference sample settings, select Back, and then select Back.

Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test CONFIDENTIAL MATERIALS

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

Figure 2-5 Reference sample settings Table 2-3 Description of the reference sample settings

Setting
Reference sample Sample Direction Save WAV files LQ <= (LQ Dependent WAV files only)

Description
Select the reference sample in the list that you want to use for the test. This list only shows the samples that are installed on the phone. Select the direction that you want the sample to travel during the call. The receiving side compares the sample with a corresponding copy to assess the speech quality. Select the types of WAV files that you want to save on the phone. Enter the cutoff Listening Quality value for the LQ dependent WAV files that you want to save.

7. Select Timings, specify the timing options for the test, and then select Back.

Figure 2-6 Timing options for an A-Side or B-Side test Table 2-4 Description of the timing options for an A-Side or B-Side test

Setting

Description
Enter the call direction during the test in the form of a ratio. For example, the call direction for a 1:0 ratio, that is, MOC only, is A-Side to B-Side while a 1:1 ratio causes the call direction to reverse in each call window.

MOC:MTC - Ratio

Note: If you specify a MOC only call direction, that is, a 1:0 ratio, the test starts with a configuration call to synchronize the measurement windows on both devices. For a detailed description of this ratio, see the "Call Direction" section on page 3.

Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test CONFIDENTIAL MATERIALS

10

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

Setting

Description
Enter the amount of time in seconds for the call window during which one more call setups can occur. If a call setup fails, the test attempts the setup repeatedly until the window duration expires. QualiPoc automatically terminates a call that exceed the window duration. The call window must be long enough to accommodate the 1st call setup delay, the call duration, the guard time, and an additional three seconds.

Window duration [s]

Use call duration Call duration [s] (Only if Use call duration is set to On) Pause duration [s] 1st call setup delay [s] Guard time [s]

Select On to automatically disconnect the call after the call duration that you specify. Enter the amount of time in seconds between the Dial and Disconnect commands. This amount cannot exceed the Window duration minus the Guard time. Enter the amount of time in seconds to wait between the last call termination and the next Dial command. Enter the amount of time in seconds for the test to wait before the first call setup. If the time expires before the call connects, the test ends. Enter the amount of time in seconds for the buffer time at the end of the call window during which QualiPoc disconnects the call. Enter the amount of time in seconds during which the test does not reattempt a call. This set point in time occurs at the end of each call window. Enter the amount of time in seconds for the test to wait between a failed test and a call reattempt. Specifies the number of consecutive failed calls after which a call reattempt is made. Note: This setting does not apply to dropped calls.

No call setup time [s]

Pause after failed calls [s]

Max failed calls

Pause after max. failed

Enter the amount of time in seconds to wait after the test reaches the Max failed calls limit. Enter the maximum amount of time in seconds for the test to try to establish a call. If the test does not establish a call within this time, the call fails and the test proceeds to the next call. Enter the amount of time in seconds to wait for a call to occur before the test stops.

Max. call setup time [s]

No connection timeout [s]

8. Select Back, and in the save dialog box, select Yes.

Configuring a Diversity Voice Server as a B-Side Device

After you create and save a Call-MOS (A-Side) test that uses a Diversity Voice Server as a B-Side device, you need to copy the configuration file from the phone to the server.

To copy the configuration file to the Diversity Voice Server without a connection
1. Connect your phone to your PC. Connect the data cable to the PC and then connect the other end of the cable to the phone. Enable Bluetooth connectivity on your phone and on your computer.

Note: SwissQual ships most mobile phones with Bluetooth enabled. If you need to enable Bluetooth,
Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test CONFIDENTIAL MATERIALS 11

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

consult the manufacturer manuals for your phone and your computer. 2. Copy the following B-Side device configuration file from your phone to your computer: C:\data\QualiPoc\DataTest\Jobs\VoiceServer\Job_123.ini 3. Copy the Job_123.ini file to the following location on the Diversity Voice Server: C:\Documents and settings\All users\Application data\SwissQual\Diversity\Tasks\ PreDefinedJobs Important: The three digit number in the filename must be unique on the server. This number is transmitted during the configuration call as in-band DTMF tones to identify the job that the Diversity Voice Server has to start.

Starting a Double-Ended Speech or Video Call Test

At the start of a Data Call test, QualiPoc opens a GPRS session through the access point that you configured for QPAEngine on the phone. For information on how to configure an access point, see Manual QualiPoc SW - Active Engine.pdf. QualiPoc uses an adapted version of the Squad LQ algorithm to calculate the MOS of the speech samples that are received. Depending on the processing power of the phone, the algorithm takes 5 to 15 seconds to calculate the MOS. The amount of time between two speech samples is 20 to 30 seconds is determined by the length of the reference sample.

To manually start a double-ended Speech or Video Call test in QPAEngine

1. On the B-Side device, start the B-Side test. a In QPAEngine, select Options > Start a job > Choose from List > Speech Call.

Note: For a video call, select Video Call/Streaming. b c Select Call-MOS (B-Side) and select Start. Take note of the Job ID for the B-Side test in the Status view.

2. On the A-Side device, start the A-Side test. a b c d In QPAEngine, select Options > Start a job > Choose from List > Speech Call. Select Call-MOS (A-Side) and select Start. In the Start Job view, select Yes. In the TID from BSide Job box, enter the Job ID from the Status view of the B-Side test, and then select OK.

Note: NQDI uses this ID to match the measurement files from both sides of the test when you import the files into the NQDI database.

Monitoring a Speech or Video Call Test

This section describes the events that you can monitor during a Speech or Video Call test. The events in Table 2-5 are for A-Side, B-Side, and Call to any number speech and video call tests as well as Diversity Voice Server tests.

Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test CONFIDENTIAL MATERIALS

12

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

Log View

Figure 2-7 Log view for a Speech or Video Call test Table 2-5 Description of events in the Log view for a Speech or Video Call test

Event
ACK! B Side Connected Call terminated Cell_Id: 0x3933 Config Call (x) Connect Failed CONNECT! Create XXMF Tones > Dropped hh:mm:ss Cycle #xx MOC (outgoing) MTC (incoming) Playing DTMF Tones Rec. Complete Rec... Playing SQMF Tones

Description
Indicates correct acknowledge in a config call. Indicates, that the phone was able to establish a call to the B-Side. A call has been locally terminated due to the job parameters. Indicates a change of the serving cell with the new Cell Id in hex format. Indicates a starting config call, as side x The phone was not able to establish a call to the B-Side within the specified time frame. Indicates correct connect information in a config call. Creating a DTMF or SQMF sequence. Call lost due to some local or remote fault. Indicates the beginning of the xx-th call window. Denote the direction of the calls inside this call window. Transmitting a DTMF tone sequence to the Diversity Voice Server to select the BSide test. A complete speech sampled has been recorded and is now ready to be analyzed. Recording of a sample starts. Transmitting a SQMF tone sequence to the Diversity Voice Server to select the BSide test. This tone is required if the voice server did not receive to the DTMF tones as some network operators filter out the DTMF tones in a call. A signal was not found during the recording and MOS analysis failed.

SQuad failed: -20 (A-Side and B-Side speech tests only) SQuad failed: -30 (A-Side and B-Side speech tests only) SQUAD LQ: x.xx (A-Side and B-Side speech tests only)

Signal recording is incomplete so the MOS analysis failed due to lost synchronization. Analysis of the speech sample was successful. The value displayed is the MOS value.

Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test CONFIDENTIAL MATERIALS

13

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

Event
SQUAD (A-Side and B-Side speech tests only) Synch: xxMF-xx; (A-Side and B-Side speech tests only) VMON failed: -20 (Video Call on Nokia N80 only) VMON failed: -30 (Video Call on Nokia N80 only) VMON LQ: x.xx (Video Call on Nokia N80 only) VMON (Video Call on Nokia N80 only)

Description
Analysis of the speech sample has started.

A multi-frequency code that is used for recording synchronization has been detected. Xx indicates the type and digits that were found. A signal was not found during the recording and MOS analysis failed.

Signal recording is incomplete so the MOS analysis failed due to lost synchronization. Analysis of the speech sample was successful. The value displayed is the MOS value. Analysis of the speech sample has started.

Stopping a Call to a Diversity Voice Server without a Connection

If you stop a test on the phone that involves the Diversity Voice Server, QPAEngine plays a "stop" reference sample instead of a speech sample, and then exits the test. Upon receipt of the "stop" sample, the voice server component of the test automatically stops. Important: If QPControl in advanced mode cannot end the current cycle and play the "stop" sample within 50 seconds, QPControl forces a stop. The voice server restarts the task after the test duration expires or when you start a new configuration call. Such a scenario can occur if the samples finish playing and recording before the call duration expires.

Chapter 2 | Configuring an A-Side or B-Side Speech or Video Call Test CONFIDENTIAL MATERIALS

14

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

Configuring a Speech or Video Call to Any Number Test

This section describes how to manually configure a Speech or video Call to Any Number test in the QPAEngine software on your phone. You only need to configure the test on the A-Side device. Although you do not need a dedicated B-Side device, the device that receives the call must be able to answer the call and hold the connection until the ASide phone terminates the call. The Call to Any Number test does not perform a speech quality assessment.

To manually create a Call to Any Number test

1. Start QPAEngine on the phone and select Options > Job handling > Speech Call > Call to any number. Note: For a video call, select Options > Job handling > Video Call/Streaming.

Figure 3-1 Creating a new Call to any number test

2. Specify the basic job settings. a Select Options > Create new.

Tip: If the view contains an existing job, you can select the job, select Options > Duplicate, and then select Options > Edit.

Figure 3-2 Main settings for a Call to any number test Table 3-1 Description of the settings in the main Job Edit view for a Call to any number job

Setting
Job Name General settings Tests b

Description
Name of the test Specifies the duration, cycle, and timings for the test. Select an existing test or create a new test

Select Job Name, enter a name for the job, and then select OK.

Chapter 3 | Configuring a Speech or Video Call to Any Number Test CONFIDENTIAL MATERIALS

15

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

3. Select General settings, specify the timing options for the test, and then select Back.

Figure 3-3 General settings for a Call to any number test Table 3-2 Description of the General settings for a Call to any number test

Setting
Duration Cycles

Description
Enter the maximum measurement time for the test after which the test automatically stops. To disable this feature, enter 0. Enter the maximum number of cycles, that is, call windows, for the test. To disable this feature, enter 0. Note: If you specify a maximum number of cycles and a maximum duration, the test stops when one of the maximum values is reached.

Pause between cycles Max. connect timeout

Enter the amount of time in seconds to wait between test cycles. Enter the amount of time in seconds

4. Select Tests, and then select Options > Add > New Test. 5. Select Options > Change.

Figure 3-4 Main settings for Call to any number test

6. Select Duration, enter the amount of time for the call in seconds, and then select OK. 7. Select Number, enter the phone number to call, and then select OK. 8. Select Back, and in the save dialog box, select Yes.

Starting a Call to Any Number Test

At the start of a Data Call test, QualiPoc opens a GPRS session through the access point that you configured for QPAEngine on the phone. For information on how to configure an access point, see Manual QualiPoc SW - Active Engine.pdf.

Chapter 3 | Configuring a Speech or Video Call to Any Number Test CONFIDENTIAL MATERIALS

16

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

To manually start a Call to any number test in QPAEngine

1. Select Options > Start a job > Choose from List > Speech Call. Note: For a video call, select Video Call/Streaming. 2. Select a test category in the list, for example, Call to any number. 3. Select a test in the list and then select Start.

Monitoring a Call to Any Number Test

For a description of the events that you can monitor during a Call to any number test, see the "Monitoring a Speech or Video Call Test" section on page 12.

Chapter 3 | Configuring a Speech or Video Call to Any Number Test CONFIDENTIAL MATERIALS

17

QualiPoc 10.6 Speech and Video Test Description

2000 - 2011 SwissQual AG

Abbreviations
Description
Dual-tone multi-frequency Global System for Mobile Communications Internet Protocol Integrated Services Digital Network Interactive Voice Response is an interactive technology that allows a computer to detect voice and keypad inputs. Listening Quality on a five-point MOS (Mean Opinion Score) scale. The value 1 refers to bad quality, the value 5 means excellent. By practical reasons, objective measures for LQ are limited at 4.5, which indicate that the signal to be measured is identical to the used reference signal. Mobile-Originated Call (synonym for the calling side), used for the MOC:MTC Ratio in the Intrusive Job timings This is indicated if the MOC:MTC Ratio in the Intrusive Job timings is set to 1:0 Mean Opinion Score, Value of the listening quality Mobile-Terminated Call (synonym for the call terminating side ), used for the MOC:MTC Ratio in the Intrusive Job timings TestManager Public Switched Telephone Network QualiPoc Active Engine Universal Mobile Telephone System Waveform audio format

Table A-1 Description of abbreviations

Abbreviation
DTMF GSM IP ISDN IVR LQ

MOC MOC-only MOS MTC NQTM PSTN QPA UMTS WAV

Appendix A | Abbreviations CONFIDENTIAL MATERIALS

18