A Case Study on QTP for CRM

Xyz Application
 Agenda
 Xyz CRM Architecture
 QTP Framework implementation
 ROI (Return On Investment)
 Architecture of Xyz CRM

The Xyz Architecture consists of

» Xyz web client (Browser)

» Xyz web server extension
» Xyz Gateway server
» Xyz Enterprise server
» Xyz server
» Xyz server components
» Database server
» Xyz file system
 Different Types of Client

– Xyz Web Client

– Xyz Handheld Client
– Xyz Wireless Web Client
– Xyz Mobile Web Client
– Xyz Dedicated Web Client

Web Wireless Web Handheld Mobile Web Dedicated Web

 Client Access Overview

WAP Web Server Xyz Web Client

Server SWSE
Xyz Wireless
Web Client

Xyz Gateway Name

Server
Enterprise

Xyz Server

Server Components
Dedicated Web Client Mobile/Handheld Client
Application Object manager

Application Object Manager Component Parameters Application Object Manager

.CFG .SRF
.CFG
Database .CFG DB Fs
DB
Server Fs
.SRF .SRF
 Test Automation Life Cycle
Requirements
Proof Framework Test Test Execution
Analysis Automation Maintenance
of Design / Automation and
& Preparation
Concept Development Development Reporting
Automation
Planning

• FW Design Document & • Test execution plan • Framework design

• Manual test cases • AUT
Input • Manual Test Cases • Application Requirement
• Manual test cases & Test
• Automation Tool
FW Components • Test Automation document.
Data • Script Template (s) Strategy & Plan • AUT Change request
• Evaluation copy of Specifications (SRS, • Requirements
• S.R.S / Other specs • CandidateTestCases List • Driver Script,Test document(s)
Tools Design Specs etc) Analysis/Test case
• Test Automation Plan • AUT script(s) and Test • Application Requirement
• AUT • Test Automation Strategy prioritize document • Test Automation tool & suite(s) Specifications (SRS,
/ Scope from Customers • Time & Skill set of the
Environment • Test execution Design Specs etc)
• PLC & Dev Roadmap resources • Baseline Manual environment (AUT) • Baseline Manual
Testcases • Test automation testcases
• Test Automation Strategy execution document • Test scripts
& Plan • AUT

• Tool evaluation • Test Automation Strategy • Frame work design

• Automation candidate • DriverScript Development • Test execution • Impact Analysis
Activities • Identify testcases for / Process / Scope • Framework
selection • Test scripts Development planning & execution • Automation Framework
demo script Analysis. development(reusable
• Test Automation Plan • Test suite development • Results analysis and Maintenance
• Generate demo script • Study Manual testing Components, library
revision (integration of test scripts) Reporting • Baseline test automation
for identified work Process / Methodologies. components, directory
• Test Automation tracker • Additional framework • Defect logging & scripts & suites
flow/testcases • System study of AUT. structure, test data)
• POC document document development components development tracking • Automation tracker
• Test Automation Planning • Script Template (s)
• Test Env. Config Plan • Review and Baselining of update
preparation & Estimation Development
• Test Data Preparation all above automation
• POC Demo • Review and Baselining of
Plan artifacts
• all above automation
Test Mgt, Automation tool
artifacts
installation & setup

Actors
• Test automation • Test automation lead • Test automation lead
• Test automation • Test automation • Test automation • Test automation engineer
lead / Engineer • Test Manager • Test Manager
• Test Manager engineer(s) engineer(s) engineer
• Test automation lead • Test automation lead

Deliverables • Automation candidate list • Baselined automation

• Demo Script(s)
• POC Document
• Requirements • Framework Design
• Revised Test Automation • Baseline Driver Script(s) • Test execution results scripts & suites.
Analysis/Test case Document
Plan • Baseline Test scripts and • Test reports • Updated automation
prioritization document. • Framework components
• Test Data Preparation Test suite(s) tracker document
• Test automation Strategy (Libs, other Re-usable
Document
& plan. components etc)
 Overview of a Case Study:: Xyz CRM Application

• Customer Solution (prior to solution)

– No. of test cases – 978
– Hardware resources – 10 work stations
– Software resources – No special software needed
– No. of Test Engineers – 10
– No. of product releases - 2
– Execution cycle time for 1 release – 5 Calendar
days (1 Week)
– Total Cost of Manual Testing is USD 864K
 Automation Process Model for QTP

Parameterization &
Data sheet
creation

Test Scripting using Execute Test Compare results

QTP Scripts with output
with output
Design and Analysis data
data file
file

Create Test sets

according to
scenario/
workflow
orkflow

No
Results
Results are
are
OK?

Yes
Data Driven Testing
Sign off
POC
 Hybrid Framework Implementation – Xyz CRM Application

Test Case Documents for Modules

Repeatable Functionality-1 Repeatable Functionality- 2 Repeatable Functionality- 3 Repeatable Functionality -N

Script
Business Function Utility Function
Library Files Library Files
(*.vbs) QA Server (*.vbs)

User Data Files

(*.xls) (Input & Out File)

Action Sheets
Global Sheet QTP Scripts
(.mts) Shared

Obect Repository

(Xyz Objects)

(.tsr)
Action -1 Action -2 Action- 3 Action - N

Reusable
1 Action
 1

Script -1 Script -2 Script- 3 Script -4 Script -N

Multi Test QTP AUT

Manager Engine

Process

Result Files
 Overview of Case Study:: Xyz CRM Application

• Solution ( Based on test automation using QTP)

– No. of test cases - 978/ No. of test scripts developed –
240 scripts
– Hardware resources (Initial:4 , Execution time: 1)
– Software resources (4 Licenses of QTP with Xyz Add-
in)
– No. of Test Engineers (4 Offshore )
– No. of product releases – 4
Overview of Case Study:: Xyz CRM Application

- Cost of Automation is USD 240K

- Tool cost (4 licenses of QTP with Xyz Addin): USD 180K
- Automation Scripts Development cost: USD 60K
- One Test Engineer on-site and Six Test Engineers off-shore
- Time taken for development of scripts – 90 Calendar days (3
months)
- Maintenance of scripts for 1 release – 7 Calendar days (with 1
Test Engr)
- Data preparation time for 1 release – 15 Calendar days (with 1
Test Engr)
- Execution Cycle time for 1 release – 15 Calendar days (with 1
Test Engr)
- Cost of Execution for 1 release – USD 6K
Total Cost of Testing is USD 290 K
 Value Delivered to Customer
from Solution (ROI)
Time for Execution
Time in Calender Days

100 90 No. Of Resources

No. of Resources
15
Customer
50 10 10 10 10
IBM India 10
Customer
0 5 2 5 2 5 2 5 2
4 IBM India
0 5
Script Release Release Release Release 1 1 1 1
0
0
Customer 0 5 5 5 5 Script Release1 Release2 Release3 Release4

IBM India 90 2 2 2 2 Customer 0 10 10 10 10

Release IBM India 4 1 1 1 1

Release

Cost Of Testing

TOTAL SAVINGS
400 300
Cost in K US $

300 230
160 Customer
200
100
72 72 72 7290 72
20
72
IBM India Total Cost Saved: USD 840K (71%)
0
-100 -50
Execution time saved:96%-1 release
Month Month Month Month Month Month
Customer 72 72 72 72 72 72
Automation cost : USD 290K
IBM India 300 230 160 90 20 -50 Total effort saved: 2300 man days
Month