Académique Documents
Professionnel Documents
Culture Documents
Key Takeaways
forrester.com
Table Of Contents
Recommendations
What It Means
2016 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law.
Citations@forrester.com or +1 866-367-7378
FIGURE 1 CX Pros Need Descriptive, Perception, And Outcome Metrics In Their CX Measurement Framework
Helps to:
Examples
Likelihood to recommend
Likelihood to purchase
Churn rates
Actual purchases made
Policy renewals
Contextualize and
operationalize perceptions
2016 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law.
Citations@forrester.com or +1 866-367-7378
during onboarding, so PFG designed a responsive enrollment process for use on a smartphone.
The firm now prioritizes measuring this digital experience and finds that the first-year contribution
rate is 30% higher than that for other enrollment methods.
Map journeys and add potential metrics and data sources. For each key digital experience,
CX pros should schedule meetings with stakeholders across the organization who own the
corresponding digital CX measurement metrics or tools. This could include teams in charge of
eCommerce, marketing, customer service, technology management, web analytics, or research.7
Together with these stakeholders, CX pros should review available data and define a set of
potential metrics and the tools that they need to collect them along each journey (see Figure 2).8
For example, Lloyds Banking Group worked with internal stakeholders to map the payment journey
and overlay data from disparate sources including conversion and tagging data, complaint data,
and voice analytics.
Define triggers that prompt further investigation. CX pros must define triggers where poor
performance compared with historical data or other journeys, touchpoints, or steps in the
journey prompts further investigation. They can base these trigger metrics on survey feedback,
behavioral analytics data, metrics from other channels, or performance data (see Figure 3). To
avoid panicking at slight movements in trigger metrics, CX pros should refine thresholds so that
they represent what falls outside of natural fluctuation in the data. Clicktale recommends focusing
on changes of more than two or three times the standard deviation. For survey feedback, try a
pragmatic approach: Instead of monitoring average survey scores, look for spikes in low scores.
2016 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law.
Citations@forrester.com or +1 866-367-7378
FIGURE 2 Use Journey Maps To Identify Metrics And Data Sources To Measure Digital CX
2016 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law.
Citations@forrester.com or +1 866-367-7378
FIGURE 3 Examples Of How Companies Define Triggers That Flag Pain Points For Further Investigation
Type of trigger
Examples
Customer feedback
Behavioral data
Lloyds Banking Group uses Webtrends web analytics data to identify where
users abandon service journeys (e.g., transfers, deposits, account balance
checks). They measure how many customers start the journey, how many finish it,
and where the major drop-off points are.
Motorcycle Superstore works with IBM Tealeaf to identify where customers are
struggling to complete their mobile purchase. Automatic alerts help identify
struggle events like form fields in the checkout process that users attempt to
fill in repeatedly.
Cross-channel
impact of digital
issues
Expedia uses calls to the call center to pinpoint digital issues, understanding
that the propensity to call is a predictor of an experience thats gone awry.
Performance data
2016 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law.
Citations@forrester.com or +1 866-367-7378
Clicktale and Tealeaf to allow clients to view session replays for customers who gave feedback.9
iPerceptions captures behavioral analytics in its feedback solution to surface issues and prompt
follow-up surveys.
Prioritize which CX pain points to tackle. CX pros must develop a way to triage CX pain points.
The Hartford places digital CX problems into four buckets that it bases on the required effort to fix
them and importance of fixing them to customers. The buckets include website errors and technical
problems that need immediate fixes and quick-hit items like improving descriptions that need nearterm fixes. Others are enhancements that go into a test-and-learn schedule and broader changes to
the digital CX that feed into a redesign process. Similarly, B&Q categorizes issues by four priority levels
that it bases on the number of affected customers, scale of impact, and potential brand impact.10 The
higher the priority, the less time the company gives itself to develop a plan or a final solution. And Life
Fitness uses ForeSees priority matrix to identify focus issues from surveys (see Figure 8).11
Determine the root cause of digital problems. CX pros need to identify root causes of digital
CX pain even if its coming from elsewhere in the ecosystem. For example, B&Q saw a drop-off in
customers who were ordering on its website. The reason for the drop-off became obvious quickly
customers never saw delivery dates. Further investigation into the ecosystem revealed that the root
cause of the missing dates was a process issue that it traced back to a single distribution center.
The fix required a five-month process involving changes ranging from API integrations with couriers
systems to revised shift patterns at the distribution warehouse itself.
Level
Journey
...
Transfer money
Interaction
Call customer
service
Elements
Landing page
BankA.com
Login
Create account
Login page
FAQ page
BankA.com
BankA.com
FAQs
What if I . . . ?
Name:
How can I . . . ?
Password:
Email:
Insight: Perception of
specific components of
a digital interaction and
detailed feedback on
snags that affect that
experience
Source: Unsolicited
opt-in feedback
2016 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law.
Citations@forrester.com or +1 866-367-7378
FIGURE 5 KLM Collects Detailed Opt-In Feedback On Elements Of The Digital Experience With Usabilla
2016 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law.
Citations@forrester.com or +1 866-367-7378
FIGURE 6 CX Pros Must Connect Many Data Sources To Answer Key Questions When Measuring Digital CX
Digital interaction
analytics
Opt-in feedback
I struggled with . . .
Intercept survey
Qualitative research
and testing
Website/mobile app
analytics
Which channels are
customers moving to
after a website visit?
Was abandonment
due to a
technical error?
Why do customers
move out of digital
channels?
Journey analytics
Examples of
=
key questions
2016 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law.
Citations@forrester.com or +1 866-367-7378
FIGURE 6 CX Pros Must Connect Many Data Sources To Answer Key Questions When Measuring Digital CX (Cont.)
Data source
Intercept survey
Sample insights
Perception of CX
Intended outcomes
Structured feedback
Sample vendors
ForeSee
iPerceptions
Opt-in feedback
Perception of CX
Intended outcomes
Feedback about specific problems
OpinionLab
Usabilla
Digital interaction
analytics
Clicktale
IBM Tealeaf
Website/mobile app
analytics
Adobe Analytics
Google Analytics
Localytics
Webtrends
Digital performance
management
Dynatrace
Google Analytics
Journey analytics
Clicktale
IBM Tealeaf
CallMiner
Datalogix
Nice Systems
Verint Systems
Qualitative research
and testing
User Testing
UserZoom
2016 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law.
Citations@forrester.com or +1 866-367-7378
10
Situation
Example
Tools
Adobe Analytics,
Starting with behavioral Belgian telecom company Telenet guides its work by looking at
critical conversion points and then adding a one-question survey Emolytics
data, solicit customer
feedback.
for fast feedback from customers. The tool is implemented
across the 20 most-used web pages on the site. The singlequestion survey yields 15-times more responses than a
previously used, longer survey. All responses can be reviewed to
see what the user interacted with before providing feedback.
Starting with data from
nondigital channels,
dig into behavioral,
feedback, and
performance data.
2016 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law.
Citations@forrester.com or +1 866-367-7378
Webtrends,
LogShark
IBM Tealeaf,
iPerceptions,
UserTesting
11
FIGURE 8 ForeSees Priority Matrix Helps Companies Identify The Most Effectual Digital CX Issues
Source: ForeSee
2016 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law.
Citations@forrester.com or +1 866-367-7378
12
from a reduction in calls, chat sessions, or emails to the contact center. For example, Lloyds
Banking Group has shown that digital improvements for customers making payments will result in
the reduction of 65,000 calls annually.
Employ design methods to improve the digital CX. CX pros should turn to the methods that
drive modern design to make comprehensive changes. These methods include customer-empathybuilding tools like ethnographic research, Leans focus on the minimum viable product to test new
concepts, and Agiles principles of continuous communication and rescoping.13 Principal Financial
improved 401(k) enrollment using an Agile design and development process that it aimed at
giving consumers more confidence in their decisions. Customers now see a red, yellow, or green
retirement readiness number. A slider then allows them to make changes to their retirement
withholdings, updating the readiness number in real time. This led to a 25% increase in changes to
retirement withholdings over the previous year.
Verify that your improvements worked. Pre-change and post-change feedback helps CX pros
understand the effect that changes have on digital experiences.14 When Customer Experience
Index (CX Index) leader QVC shifted from PIN logins to passwords, the firms user experience
team tracked the effectiveness of daily design tweaks by measuring the reduction in complaints.15
CX pros should also add insight from the metrics on which eBusiness leaders focus.16 Agency Viget
worked with the Wildlife Conservation Societys Bronx Zoo to optimize ticket purchase as part of
a site redesign. Before the redesign, users struggled to compare three kinds of tickets. After the
redesign and more than 40 A/B tests, it realized that it shouldnt present the three options side by
side. The redesign led to a 720% increase in revenue per mobile visit, a 141% increase in seasonticket conversions, and 52% more revenue per visit.17
Recommendations
2016 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law.
Citations@forrester.com or +1 866-367-7378
13
2016 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law.
Citations@forrester.com or +1 866-367-7378
14
emotions.23 To make the emotion insights easier to understand and share, both feedback
and analytics vendors will invest in visualizations that show emotions of customers during
interactions. As a result, the use of emotion scores will surge in dashboards.
3. Market confusion will increase as optimization vendors add CX to their pitch. Analytics
vendors and agencies will add customer experience terminology to their acquisition-focused
message. As a result, CX pros will have to wade through vendor presentation after vendor
presentation and endure overuse and misuse of the term customer experience. CX pros
will then take on an important role in helping their organizations decipher which vendors will
only improve conversion numbers and which can provide information to improve customer
experience. Unfortunately, this will cause some stakeholders to write customer experience off
as the latest business fad after they implement measurement technologies that fail to make
meaningful improvements in the business.
Analyst Advisory
2016 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law.
Citations@forrester.com or +1 866-367-7378
15
Supplemental Material
Companies Interviewed For This Report
B&Q
Localytics
Clicktale
MetLife
Emolytics
NCS Technologies
Epsilon
Optimizely
ForeSee
Principal Financial
GoPro
Qualtrics
Huge
QVC
IBM
SandSiv
iPerceptions
Telenet Group
KPMG Nunwood
Usabilla
Life Fitness
Verndale
Wells Fargo
James McCormick
Deanna Laufer
Jennifer Wise
Endnotes
CX and website metrics dont align, but CX pros need both to measure their efforts. See the Brief: How To Combine
Website And Customer Experience Metrics Forrester report.
eBusiness professionals have a transactional mindset 68% of respondents in a recent survey said that they focus
on interaction, transactional, and financial metrics, but only 41% measure customer perceptions. See the Use
Customer-Centric Metrics To Benchmark Your Digital Success Forrester report. Also, see the Brief: How To Combine
Website And Customer Experience Metrics Forrester report.
VoC programs are vital to improving customer experience; they both feed CX measurement and uncover the insights
to deliver better experiences. See the The State Of Voice Of The Customer Programs, 2014: Its Time To Act
Forrester report.
For more information, see the Brief: How To Combine Website And Customer Experience Metrics Forrester report.
2016 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law.
Citations@forrester.com or +1 866-367-7378
16
While a multitude of tools present cross-device targeting and measurement as table stakes and most vendors claim
to be able to bridge the cross-device gap, few can actually do this well. See the Bridging The Cross-Device Chasm
Forrester report.
These moments of truth can be journeys that set the tone for the relationship like an onboarding journey or
drive a lot of revenue like a purchase journey. For more examples of journeys that are moments of truth and how
to identify them, please see the Seven Steps To Successful Customer Experience Measurement Programs Forrester
report and see the How To Get Started With Customer Journey Mapping Forrester report.
Ecosystem maps can help ensure that CX pros identify all involved parties. See the How To Map Your Customer
Experience Ecosystem Forrester report.
Even some well-established CX measurement programs arent able to measure the health of end-to-end experiences
that cross touchpoints as customers pursue a goal. Customer journey maps help companies see those end-toend experiences from the customers perspective. See the How Journey Maps Improve CX Measurement Efforts
Forrester report.
ForeSee also offers an integrated, proprietary session-replay product. iPerceptions also integrates its solution with
behavioral analytics vendors like Clicktale and Tealeaf. And IBM and Clicktale allow users to identify struggle events
(e.g., when customers struggle to accomplish a task like completing a form). They alert CX pros to these struggle
events and help them focus on session replays to watch.
The numbers of customers who are affected and scale of the issue are estimated by using website and behavioral
analytics, and the brand impact is defined as the potential impact of the experience by the level of recommendations
for and positive conversation about the website.
10
ForeSees priority matrix plots CX elements that are based on calculated score and impact. The diameter of the bubble
represents the impact score, and movement shows how the score has changed over a period of time. The bubbles
dont always increase in size and instead increase and decrease over time depending on the impact score.
11
CX professionals must help their colleagues understand how they affect and ultimately own a piece of customer
experience outcomes. That requires CX teams to ensure that all employees are responsible for relevant elements of
the experience. See the Want Great CX? Make Everyone Do Their Part Forrester report.
12
CX professionals want to grow and transform their businesses by fostering empathy for their customers, quickly
adapting to challenges, and creating effective and compelling experiences. See the Design Methods In The Age Of
The Customer Forrester report.
13
Declines in CX and financial metrics are virtually guaranteed after a major website change. Drops happen immediately,
and metrics recover slowly over two to four weeks, with even more recovery happening in five to 16 weeks, depending
on the scope of change, frequency of use, and industry. See the Brief: How To Combine Website And Customer
Experience Metrics Forrester report.
14
QVC is now a top-15 brand in Forresters CX Index. See the The US Customer Experience Index, Q3 2015 Forrester
report.
15
Competing for empowered customers and their shifting digital expectations means that firms must evolve their
online experiences by using customer data to constantly optimize digital interactions. See the Transform Customer
Experience With Continuous Optimization Forrester report.
16
Viget recommends that you start with tests that focus on the conversion point and then work your way back out and
that you avoid being heavy-handed with testing overall. See the Make This Website Redesign Your Last Forrester
report.
17
For more information, see the Transform Customer Experience With Continuous Optimization Forrester report.
18
For more information, see the Transform Customer Experience With Continuous Optimization Forrester report.
19
2016 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law.
Citations@forrester.com or +1 866-367-7378
17
QVC engaged in a five-year effort and put the data infrastructure in place to link users behavior and reviews on its
website and app to call volume and actual purchase behavior. Additionally, QVC monitors journeys like customer
service, linking these to retention. Within hours, the firm can now do sophisticated analysis like page-level reactions to
changes in how the host presents products on TV.
20
Giles Richardson presented at the 2015 Adobe Summit, where he talked about the application, organization, and
management of machine learning, analytics, and test-and-learn approaches within RBS. RBS is one of the retail
banking subsidiaries of The Royal Bank of Scotland Group. See the Transform Customer Experience With Continuous
Optimization Forrester report.
21
The insights services market will radically change the way that companies source data and analytics technologies. See
the Insights Services Disrupt The Data And Analytics Market Forrester report.
22
Source: Todd Hollingshead, U mad bro? Researchers measure emotion with your mouse clicks, BYU News,
December 11, 2015 (https://news.byu.edu/news/u-mad-bro-researchers-measure-emotion-your-mouse-clicks).
23
2016 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law.
Citations@forrester.com or +1 866-367-7378
18
Technology Management
Professionals
CIO
Application Development
& Delivery
Enterprise Architecture
Infrastructure & Operations
Security & Risk
Sourcing & Vendor
Management
Technology Industry
Professionals
Analyst Relations
Client support
For information on hard-copy or electronic reprints, please contact Client Support at
+1 866-367-7378, +1 617-613-5730, or clientsupport@forrester.com. We offer quantity
discounts and special pricing for academic and nonprofit institutions.
Forrester Research (Nasdaq: FORR) is one of the most influential research and advisory firms in the world. We work with
business and technology leaders to develop customer-obsessed strategies that drive growth. Through proprietary
research, data, custom consulting, exclusive executive peer groups, and events, the Forrester experience is about a
singular and powerful purpose: to challenge the thinking of our clients to help them lead change in their organizations.
125804
For more information, visit forrester.com.