AgileTestingProcessExample

BUGTRACKINGPROCESS
Theprocessvariesdependingonwhereabugisfoundinthedevelopmentcycle. Generally,bugswillbetrackedandfixedusingtheAPMtoolastheprimarypointofreference.Thisallows allmembersoftheteamtotrackallworkinasinglespot.Butthereareexceptions,asoutlinedbelow.

DURINGANITERATION
Bugsidentifiedwithinaniterationforwhichthestoryisbeingdevelopedaretrackedontheprojectwall usingthefollowingprocess: 1.Testernotesbugonstickienoteandattachesittothestorycard 2.Testerplacesabugstickeronthestorycard 3.TestermovescardbacktoInDevelopmentandnotifiesresponsibledeveloper 4.DeveloperfixesbugandresubmitsittoReadyforTestontheprojectwall

AFTERANITERATION
BugsidentifiedafteraniterationwhereastorywasconsideredDonemustbeplacedonnewstoriesand prioritizedalongwithotherdevelopmentworkbytheProductOwnerteam. 1.TestercreatesadefectstorycardintheAPMtoolandnotifiestheProductOwnerrepresentative aboutthedefectcard. 2.Productownerrepresentativethen: 1.Schedulesthedefectforresolution 2.Defersthedefectforalaterrelease

ININTEGRATIONTEST,SYSTEMTESTANDUAT
ForbugsfoundduringregressiontestinginSystemTestandUAT,defectsmustbeenteredintoQuality Centerforthesupportofqualitymetrics,departmentalobjectivesandtofacilitatedefectresolutionand qualitytransparencywithdependentteams. 1.TestermustenterdefectintoQualityCenter 2.TestercreatesadefectStoryCardintheAPMtoolandnotifiestheProductOwnerrepresentative aboutthedefectCard.

3.ProductownerRepresentativeThen 1.Schedulesthedefectforresolution 2.Defersthedefectforalaterrelease 4.TesterupdatesstatusinQualityCenterbasedondecisionoftheProductOwnerRepresentative

DEFINITIONOFTERMS
UNITTESTTestscreatedbydeveloperstestingsmallunitsofcode.Thesearegenerallyrunduringthe ContinuousIntegrationprocess.Wewilltrackcodecoverageandoverallnumberoftestsascorequality metricsforthedevelopmentteam.ThesetestswillbedevelopedusingjUnitandstandardextensions. Unittestsdonotrequiretheapplicationbedeployedtorun INTEGRATIONTESTIntegrationteststesttheapplicationsfunctionalityfromfronttobackandrequire thattheapplicationbedeployedinWebspheretorun.Thesetestsvalidatethefunctionalityforeachstory andwilleventuallyprovideautomatedregressiontests.Thesetestsaregenerallycreatedbyboththe testersanddevelopmentgroup.Severaltoolswillbeusedforseveraltypesofintegrationtesting including;Fitnesse,Selenium,jUnitandQuickTestPro. SYSTEMTESTSystemtestsareteststhatarewritteninQuickTestProandrunagainsttheapplication intheSystemTestenvironment.Seleniumtestsmayberuninthesystemtestenvironmenttovalidate CrossBrowserCompatibilities. ITERATIONPERFORMANCETESTAsmallsetofintegrationtestswritteninjUnitwillbe instrumentedtovalidateLoadandPerformancecriteriawithintheContinuousIntegrationserver.These arenotasubstituteforoverallL&Pbutallowtheteamtotrackperformancenumbersearlyinthe developmentcycle. PERFORMANCETESTFormalLoadandperformancetestingrunpriortoarelease.Thesetestsarerun asthecurrentL&Pprocessdoes. ITERATIONUATTESTManualacceptancetestsrunbytheProductOwnerteamattheendofeach iteration. UATTESTTraditionalUATtestruneachrelease.Thesearemanualtestsandrepresenttheregression testforallfunctionalitytouchedbythesystem.

TESTINGTOOLS
InformationonFitnesseandSeleniumisavailableinthetoolprofiledocuments QUICKTESTPROUsedforregressiontestofallfunctionalityintheSTenvironment. SELENIUMTheteamwillbeutilizingseleniumtotestcrossbrowserfunctionalityforeachofthe supportedbrowsers.SeleniumsupportsmanystandardbrowserswhileQTPonlysupportsIE.

FITNESSEFitnessewillbeutilizedasatestingplatformforvalidatingtheWebServiceinterfacesthat wewillbeinteractingwith. JUNITStandardunittestingframeworkforJavawithextensionsfortestingJ2EEApplications.

TESTINGENVIRONMENTS
BUILDENVIRONMENTHudsonbuildenvironmentthatrunsallunitandjUnitintegrationtests.Builds checkevery5minutestoseeifnewcodehasbeencheckedin.IfthereisnewcodeHudsonchecksoutall thecodeandbuildstheapplicationandthendeploysittotheDevelopmentIntegrationserverifallUnit Testspass. *HudsonBuild DEVELOPMENTINTEGRATIONThisserverhasthelastgoodbuildoftheapplication.This environmentisavailablefordeveloperstorunbasictestsagainst.Theremaybetwoinstancesofthis environmentasneeded. *Devl2DeveloperSandbox ITERATIONTESTHudsonmaybeusedtodeploythelatestgoodbuildtotheIterationTest environment.Thisenvironmentwillbeusedforvalidationoffunctionalitywithintheiterationand demoingtheapplicationattheendoftheiteration.Theremaybetwoinstancesofthisenvironmentas needed. *Devl3IterationTesting FullintegrationandpreproductiontestingFromtheAgiledevandtestenvironments,codewillbe promotedintotheSHAREDIT,ST,UAT/PTenvironments.Thetoolstypicallyusedinthoseenvironments forqualitymanagementwillbeappliedtothecodefromtheAgileteamsjustasitisforeverythingelse. ThisincludestheuseofQualityCenter.Asmentionedearlier,inadditiontousingQualityCenterinthe Sharedenvironments,theteamwillalsousetheAPMtooltoprioritizeitsdefects.

TOOLENVIRONMENTMATRIX jUnit Selenium Fitnesse QuickTest Pro

Build x x

Integration x x

IterationTest x x X X

SystemTest x X

UAT X X