For more QTP Realtime Sripts, visit

www.ramupalanki.com

COMPARE

HP QTP TO SELENIUM/TESTMAKER

Web Record/Playback for Functional Tests and Load and

Performance Tests December 2009

Web Testing
Detailed Comparison

BENEFIT COMPARISON HP QTP 10 TESTMAKER

5.4/SELENIUM 1.0
Improve collaboration between
workgroups Sharing enabled with Quality Sharing enabled w ith svn and

Center (QC.) other repository integration.

with shared function libraries, object

man-
For more QTP Realtime Sripts, visit
www.ramupalanki.com
agement and flexible asset storage

Helps implement Agile methodology. Built around Waterfall SDLC Built for Agile SDLC, including

where QA testers test after soft- Test First m ethodology, Con-

ware is com pleted. tinuous Integration, and Unit

Testing. Popular with Developers

and Testers.

Collapse test documentation and

creation Record/playback with Web object Record/playback to build use

recognition. QTP not an

is agile case s, test su ite s, te st c as es .

to a single step for agile testing

tool. Good for Agile Test-First meth-

o d o lo g y .

Fix defects faster by fully documenting

and QTP o ers native Quality CenterSelenium and TestM aker provide

(QC) integration. QC o ers good common framework for QA

replicated defects for developers

Test M anagem ent capabilities.Testers, Developers, and IT Op-

erations to work together.

Set a test development process and propa-QTP with Quality Center (QC) Selenium and TestM aker o er

test process support for

o ers Test M anagement for test your

gate it throughout the organization

process propagation in your or- organization.

ganization.

Make test modifications “on the fly” during

test execution

TECHNICAL DETAILS HP QTP SELENIUM & TESTMAKER

 Skill Level R

Record and

Event or Tim
on

Recording a
Playback

Comparing HP QTP to Selenium/TestMaker

2
For more QTP Realtime Sripts, visit
www.ramupalanki.com

TECHNICAL DETAILS HP QTP SELENIUM & TESTMAKER

Rich Internet
Application Poor Good
(RIA) support for Ajax

Supported Languages VBScript Selenese, Java, Ruby, Perl, PHP, Python,

C#, Groovy

Large group of value added Large open source community of

Extensible extension com-

packages for QTP. mitters and participants.

Checkpoints synchronize test to Assertion and verification commands

Verification ap- to

plication under test, and validate test and validate the application
ap- under

plication values and state. test.

Drill down to root No point-and-click, easy viewing of

cause Point and click to drill down to logs

application-level error for exception reports and stack

of functional issues/ messages. traces.

crashes

Verification of Ajax Poor. Architecture not designed Good. Architecture readily supports
appli- for Ajax

Ajax data models, event models, data models, event models, and
cations and proto-

protocols. cols.

Known as “Recovery” in QTP. Simple request/response and error

Exception handling Han- log-

dles application crash and

message ging.

dialog recording.

QTP hooks into memory space

Test tool integration of n/a

(hooks) into applications under test. Some

application appli-

cation crashes take QTP down

under test. too.

QTP hooks into memory space Selenium playback requires browser-

Test tool integration of bot

Web browser. Requires QTP running in supports Web browser.

(hooks) with Web com- Sup-
For more QTP Realtime Sripts, visit
www.ramupalanki.com
patibility with Web browser.
browser. Works ports MS IE 5, 6, 7, 8, Firefox 2, 3, Opera,

best in MS IE. No support for

Fire- Safari, Chrome

fox 3, Opera, Safari, Chrome.

QTP features help users created

Data-driven testing Mi- TestMaker provides operational test data

crosoft Excel workbook that can to Selenium test script from CSV,
be Rela-

accessed from within QTP test tional Databases, and data

con- generating

text. objects.

Automating custom Customized user interface

and objects Exported Selenium tests have full use of

and other complex objects may object technology in Java, Ruby,

complex UI objects not and

other script languages, including

be recognized properly by QTP. loops,

com plex data structures, conditional

exe-

cution and branches.

Comparing HP QTP to Selenium/TestMaker

3
 TECHNICAL DETAILS HP QTP SELENIUM & TESTMAKER
Reusable Test Compo- QTP Virtual Object concept Supports combining recorded tests
For more QTP Realtime Sripts, visit
www.ramupalanki.com
enables into

users to add some degree of larger test use cases and test suites,
nents support in-

for UI and complex objects. Not

al- cluding data and session sharing betw een

ways possible, depends on

applica- tests.

tion construction.

Add-ins for third-party and

Add-in Extensibility custom No extensibility Add-On system

controls built in Web, .NET, Java,

and Delphi.

Results QTP generates result file for test TestMaker generates results files for test

cases at the end of a test. Results use case, test case, test suite,
file transac-

is in XML tree format. Shows

Pass, tions. Results files in XML format.

Show s Pass, Fail counts, error

Fail counts, error messages, and m essages,

sometimes supporting information

to and command step execution times.

determine underlying failure.

Users

frequently need to re-execute

test

cases to observe the failure.

Yes with PushToTest TestMaker QC

Quality Center (QC) Yes, natively In-

Integration tegration option.

Records tests of Web and Repurposes tests created by

Multiple Language and Desktop Selenium,

soapUI, Mozmill, Windmill, and

Tool Support Applications several

other test tools.

Support of Agile Poor because of QTP’s focus on Strong from Selenium support of
Software re- build-
Development Life cording tests over constructing ing reusable test cases, and
Cycles reus- TestMaker’s

(SDLC) able test units. component methodology.

Little thought given to TestMaker and Selenium designed

Support of Agile Tech- continuous to

integration and iterative test

niques devel- build reusable test com ponents that plug-

opment. into continuous integration environ-

ments for iterative test

development.

QTP Keyword View is default.

Novice/Expert Modes Useful One mode only.

for beginners, but is most widely

used mode. Displays automation

steps as a descriptive tree of

actions

and functions. Tree contains

column

listing the action or function

name,

parameters, and comments.

Expert

mode displays for editing the

under-

lying VBScript script.

Comparing HP QTP to Selenium/TestMaker

4
For more QTP Realtime Sripts, visit
www.ramupalanki.com

TECHNICAL DETAILS HP QTP SELENIUM & TESTMAKER

QTP uses VBScript. VBScript
Language Support for sup- Exported Selenium tests have full use of

ports classes but not object technology in Java, Ruby,

Objects polymorphism and

and inheritence. VBScript does other script languages, including

not loops,

implement all of Visual Basic for com plex data structures, conditional
Ap- exe-

plications (VBA) classes,

keywords, cution and branches.

features. No support for

integrated

debugger, event handler, and

 forms

editor. HP added a QTP VBScript

debugger, but it disappoints

those

used to debuggers found in

IDEs.

Operating QTP requires Windows ActiveX MS IE 5, 6, 7, 8, Firefox 2, 3, Opera,

Environment en- Sa-

Compatibility vironments. fari, Chrome

Supported QTP has optional add-on TestMaker and Selenium have

environments modules standard

(at additional cost) for: Web, support for Web, RIA, .NET, Java,
Java, Ruby,

.Net, WPF, SAP, Oracle, Siebel, Groovy, Perl, PHP, Python,

Peo- Flex/Flash/

pleSoft, Delphi, Power Builder, AMF, SOAP, REST, Ajax (GWT, YUI,

Stingray, Terminal Emulator,

Flex JQuery, Appcelerator)

HP Professional Services, Google search on “Selenium

Support Availability Mercury TestMaker”

User Guides, some third party results in 33,800 references.

sup- Estimated

port. However, we often find

com- 250,000 TestMaker users.

ments like this about QTP, “I

couldn’t find any “real-world”

reviews

and my guess is that you may be

hav-

ing the same problem.”

For more QTP Realtime Sripts, visit
www.ramupalanki.com

Comparing HP QTP to Selenium/TestMaker

5
Screen Shots

Selenium 1.0 and TestMaker 5.4

For more QTP
Realtime
Sripts, visit
www.ramupal
anki.com
Comparing HP QTP to
Selenium/TestMaker

6
For more QTP Realtime Sripts, visit
www.ramupalanki.com
HP Quick Test Professional (QTP) 10
Prepared by Frank Cohen ( fcohen@pushtotest.com), PushToTest,

December 5, 2009 QTP requirements stated at http://tinyurl.com/nndjpv

QTP pricing stated at http://tinyurl.com/yamr54t

In addition to this comparison check http://www.qtp10.com/2009/08/qtp-vs-selenium.html

Quick Test Professional and QTP are trademarks of the Hewlett Packard Company.
For more QTP Realtime Sripts, visit
www.ramupalanki.com
PushToTest and TestMaker are trademarks of the PushToTest Company.

Comparing HP QTP to Selenium/TestMaker