Automated Regression Testing

Overview

Produced by Visionfilm (Conta 1

ct: enquiries@visionfilm.com)
These slides demonstrate the approach taken to set up and run a set of data driven
automated test cases into the Olympic Banking System user Mercury Interactive’s
Automation tool “Winrunner”.

The test data is built into an Access database from which various sub-sets can be
extracted into an Excel spreadsheet.

The spreadsheet then feeds a series of Winrunner scripts which enter the required
data into Olympic.

The Winrunner scripts automatically capture screen prints of the data entered as well
as the results of the test. These are presented in a Word document for validation by
the test teams.

This approach allows both test definition and the checking of results to be carried out
off-line.

Produced by Visionfilm (Conta 2

ct: enquiries@visionfilm.com)
The basis of an Automated Test Pack is a database of test cases.

The test cases are -

Defined by the user.

Matched to the test system for the required Clients, Accounts and Products etc.
Entered into the Access Database.

Each test case is marked as to which Branch and Test Case Set it belongs to.

The following slide shows the progress of the test case from the database extraction
into Olympic and the associated output.

Produced by Visionfilm (Conta 3

ct: enquiries@visionfilm.com)
 Automated Data Entry Diagram
Test Cases Test Data Automation Tool Check Output

MS Word
Winrunner/
Quick Test Pro. Screen prints
MS Access Accounting Sets
MS Excel
Reads Excel A/c Balances
Test Cases Extract Log
User Test Cases Automatic and enters
entered into an
Extract of the test data
Access database
subsets of into Olympic. MS Excel
test data Captures
Flag for subset
into Excel screen prints Accounting Set
extraction
of data entered Analysis
and the results

EOD Reports
Olympic
etc.
Extract Log

Optional Manual Entry

Of Data
Report of Test
Cases Extracted

Produced by Visionfilm (Conta 4

ct: enquiries@visionfilm.com)
Sets of test cases are built for each branch of the bank.

Where the same tests are to be performed at all branches they can be easily copied
for each branch. This is especially useful where the same tests are to be run to check
differing tax implications at each branch.

Individual tests can be flagged to be ignored when the underlying functionality is

known
not to be working.

At the extraction stage there are options to include or exclude specific types of data
(e.g. a test may have been designed to run Corporate Actions and Cash but for the
current run only Corporate Actions are required) and to select a particular testing day
where a test is designed to run over a series of days.

Produced by Visionfilm (Conta 5

ct: enquiries@visionfilm.com)
 Test Case Selection Diagram

All Test Cases Database

Singapore Hong Kong

Branch Test Cases

S1 S2 (Local Tax) HK1 HK3=S2

HK2
Test Case Sets All Test Cases Cash Cash Cash
Cash
Excl. Mutual Funds FX Mutual Funds
Corp. Actions
Corp. Actions Fixed Income Loans Fixed Income

Individual Filter Ignore 3 FX

Tests

S2
Select Sub-Set S1 HK1 HK2 HK3=S2
for each Test Cash
Run FX Mutual Funds Loans Corp. Actions Mutual Funds
Fixed Income

OLYMPIC

Produced by Visionfilm (Conta 6

ct: enquiries@visionfilm.com)
To achieve ease of use, and make the Olympic functionality transparent to the user
designing the tests, the process is broken down into a number of discrete stages.

In the following diagram the user only defines the test case “Incoming Cash” (containing
Client Account, Amount, Currency and Agent), and the selection process will determine
how many individual entries will be required by Olympic.

In addition to the required Olympic entries, optional entries may also be automatically
output (e.g. to print an accounting set of the transaction that has been entered and the
balance on the Client’s cash account).

A further process will then determine which user profile is needed for each entry (and
any originating profiles that are needed as part of the on-going data entry) and how the
relevant screen is to be found in Olympic (‘How’ the data is entered, ‘Who’ is to enter it,
and ‘Who’ entered the original data).

Produced by Visionfilm (Conta 7

ct: enquiries@visionfilm.com)
 Olympic Test Data Construction

Test Case Olympic Method Of Entry

Transaction

Incoming Cash
Olympic Navigation (How)

Olympic User (Who)

Cash Entry

Olympic Navigation (How)

Cash Control
Olympic User (Who)

Addition Entry
Olympic Originating User (Who)

Addition Control

Accounting Set
Capture

Balance Enquiry

Produced by Visionfilm (Conta 8

ct: enquiries@visionfilm.com)
The test pack (test data and automation scripts) is designed to be as self sufficient as
possible, incorporating –

• Automatic logging on to Olympic and logging off.

• Navigation throughout the Olympic screens or program calls.
• Additional intermediate tests cases where needed (e.g. for a Corporate Action a
position of the client’s holding will be captured before the test, the relevant stock
will be transferred in, the Corporate Action run, and the new position captured).
• Trapping and responding to warning messages.
• The Controlling of un-controlled data left over from previous tests.
• Automatic extraction of all results to a Word document.

Produced by Visionfilm (Conta 9

ct: enquiries@visionfilm.com)
 Benefits Of Automation

• No risk of incorrectly entered data.

• Reduced testing costs both in terms of timescales and resources.

• No reliance on ‘business expertise’ in order to test changes.

• Input screens and results automatically documented.

• Ability to enter a large volume of tests in a very short time.

• All business processes associated with the input to Olympic are documented as a by-product
of script development.

• All tests held in one location giving better control over the project.

Produced by Visionfilm (Conta 10

ct: enquiries@visionfilm.com)
 Visionfilm
Specialise in

Test Management

And

Fully Automated Testing Solutions

Contact us at - enquiries@visionfilm.com

Produced by Visionfilm (Conta 11

ct: enquiries@visionfilm.com)