The Dirty Little Secret of DevOps

That's Holding You Back...

 What's the hold up?
Gitlab’s 2018 Global Developer Survey found that testing is the single biggest cause of
delay in the software development process.

Industry-wide, developers have been slow to adopt automated testing. This is not
ideal for organizations looking to automate testing in a DevOps environment.

1
Where do you encounter delays in develoment?
60

50 52%

47%
40
% OF RESPONDENTS

30
31% 30%
27%
25%
20
20%

10

0
Testing Planning Deploying to Code Reviews Code Monitoring Test Data
Production Development Management
2
According the 2018 World Quality Report, test data automation is one
of the top emerging trends. Yet, the reality is that less than 16 percent
of test activities are being performed with automated technologies.
The benefits of automation
are real and significant. From Real Benefits of Test Automation 2

lowering costs, to improving

velocity and coverage while
eliminating risk, automating
testing is a no-brainer.
• Better Detection of Defects
• Better Reuse of Test Cases
• Reduction of Test Cycle Time

So why aren’t organizations • Reduction of Test Costs

jumping on the automation • Better Test Coverage
train?
• Better Control and Transparency of
Test Activities

3
 It’s not easy
Getting automation right in your test environment is harder than it appears

When it comes to test 2

automation, most teams have What Are Your Common Test Automation Challenges?
great intentions -- until they
realize how challenging it is to
implement.
The idea of getting developers 52%
to accept new automated tools 47% 46%
and technology, incorporating 42% 41%
% of respondents

new processes, or hiring new 40%

expert team members scares
off many organizations.
At the same time, the drive
to deliver innovative digital
engagement solutions is
pushing teams to shorten
development cycles. And
with little room for bad user 5%
experiences, the only option is
NOT ENOUGH DON'T HAVE THE DON'T HAVE THE NO MOBILE DON'T HAVE IN- DON'T HAVE THE WE DON'T DO
to test earlier in the dev cycle. TIME TO TEST RIGHT TESTING RIGHT TOOLS TO TESTING EXPERTS HOUSE TESTING DEVICES READILY MOBILE TESTING
PROCESS/METHOD TEST ENVIRONMENT AVAILABLE
As dev teams look to accelerate
development velocity, test
automation is the only way to
ensure quality output at speed.

4
It's all in your mind, kinda
As much as we don’t Biggest Organizational Challenges Developers Face When
like to admit it, many
developers don’t see Adopting New Practices or Tools? 1
testing as part of their 70
job. As a result, they
can resist adopting new 60
tools and processes. 58%
Barriers such as 50
organizational culture 50%
% RESPONDENTS

and training also make 40

it tougher to institute
36%
change. 30

To fully rollout 27% 26%

20
automated testing 21%
and not delay a critical
10
component of the
software development
0
lifecycle (SDLC), dev Replacing Ingrained Resistance to Change Cross-team Inadequate Lack of Leadership Risk-averse Culture
teams must change the Practices Communication Workforce Training Support
way they think.

5
Getting in the right headspace
Every company wants to realize full test
automation in the SDLC. To get there, teams
have to rethink how they work.
First, Dev and QA have to work together. The
skills required for test automation reside in
both teams and neither can get there on their
own.
Next, you have to change how you think
about testing. Test code is code. So treat it
like code. Design it. Test it. Version it. And
Maintain it.
Finally, to ensure that testing and
development are done together, build it into
your sprints. Lengthen the sprint to include
testing or reduce the amount of development
per sprint. Either way, bake testing right in.

6
Doing automation right
Once your dev team is ready to go all-in, it’s
important to implement automation correctly for
it to work efficiently and properly. Here is a 4 phase
plan teams should follow when implementing a new
automated testing suite:
1. Prepare existing infrastructure to ensure that all
parts of the testing stack are integrated with
the rest of the development plan.
2. Prove that the automation is impactful by
first automating a small number of tests
(i.e. 5-20 scripts) on a daily, or at the very
least weekly, basis.
3. Scale your automation by applying it to a
larger set of scripts to highlight its fast feedback
and large data set capabilities.
4. Maintain this same scalability across the SDLC.
Keep in mind that project plans should take
testing into account and be fully integrated with
automated testing code and timelines.

7
Foundation is Critical
Your test environment is the cornerstone of your test automation
implementation, so getting it right is critical.

With challenges ranging from coverage, to access and maintenance,

a third
party test
environment,
such as
Perfecto’s
Continuous
Quality Lab,
gives you
the reliable,
cloud-based
platform
you need
to ensure
success.
Visual Analytic Test Results with Digitalzoom
8
 About Perfecto
Perfecto is the leader in cloud-based continuous testing and monitoring for today’s dynamic DevOps environments.
Our Continuous Quality Lab enables DevOps teams to accelerate development, achieve continuous testing and monitoring,
and drive fast feedback through actionable analytics for web, mobile, and IoT apps.

More than 3,000 customers rely on our cloud-based Continuous Quality Lab as their digital app test environment and for
authoring test automation executed on real browsers, smartphones, and devices under real end-user conditions.

For more information about Perfecto, visit perfecto.io, join our community, or follow us on Twitter at @PerfectoMobile.

1. https://about.gitlab.com/developer-survey/2018/
2. https://www.sogeti.com/globalassets/global/downloads/testing/wqr-2017-2018/wqr_2017_v9_secure.pdf