Académique Documents
Professionnel Documents
Culture Documents
3rd Edition
By: Amy Schade and Jakob Nielsen
WWW.NNGROUP.COM
Copyright Notice
Please do not post this document to the internet or to publicly
available file-sharing services.
This report required hundreds of hours of planning, recruiting, testing, analyzing,
writing and production. We sell these reports to fund independent, unbiased usability
research; we do not have investors, government funding or research grants that pay
for this work.
We kindly request that you not post this document to the Internet or to publicly
available file-sharing services. Even when people post documents with a private URL
to share only with a few colleagues or clients, search engines often index the copy
anyway. Indexing means that thousands of people will find the secret copy through
searches.
If someone gave you a copy of this report, you can easily remedy the situation by
going to http://www.nngroup.com/reports and paying for a license.
We charge lower fees for our research reports than most other analyst firms do,
because we want usability research to be widely available and used.
Thank you!
INFO@NNGROUP.COM
Copyright Notice
Table of Contents
Executive Summary .......................................................................................6
Usability Metrics Show Nice Improvements .................................................................................... 6
Old Study Findings Stand ............................................................................................................ 7
Latest User Research .................................................................................................................. 7
Supporting Different Types of Shoppers ......................................................................................... 8
Bad Content Kills Sales ............................................................................................................... 8
Loyalty = Business ..................................................................................................................... 9
WWW.NNGROUP.COM
Bargain-Hunting ................................................................................................................... 32
One-Time Shoppers ............................................................................................................... 35
INFO@NNGROUP.COM
Executive Summary
WWW.NNGROUP.COM
Executive Summary
(Yes, this is a summary of the summary. Considering that the full E-Commerce User
Experience report series clocks in at more than 2000 pages with more than 1700
screenshots, the more summaries the merrier :-)
To give away the bottom line, the number of usability guidelines for e-commerce
sites has increased from 207 in the first edition of this report to about 880 in the
current edition. Using this rough metric, we now know 4.2 times as much about ecommerce user experience as we did during the dot-com bubble.
As Jakobs Law of the Internet User Experience states: users spend the majority of their time on
other sites than yours.
INFO@NNGROUP.COM
Executive Summary
WWW.NNGROUP.COM
Other tasks were broader and assessed the degree to which the site could inspire
users who dont have a particular need in mind. For example: You just got a
promotion and a bonus and you want to treat yourself. Buy yourself something.
Spend no more than 200 at Links of London.
We also tested web-wide tasks where we didnt specify what site the user should
use. For example: The light bulb in your desk lamp just burned out. Get a
replacement for it. (With this task, we gave users the burned out bulb.)
Finally, we tested a range of customer service tasks. For example: Can you get a
refund for tickets you buy from cinema.com.hk if there is a typhoon signal?
Known-item purchase
Category research, leading users to identify and buy the best match with
their needs
Bargain-hunting
Browsing for inspiration
Finally, some users are one-time shoppers. They dont know the site, and they dont
intend to return, but they may want to shop there once. (Maybe they received a gift
card, or maybe a relative wished for a gift carried by that site.)
INFO@NNGROUP.COM
Executive Summary
The key downside of e-commerce is that one cannot touch, feel, see, taste, or smell
the offerings. Nor do customers benefit from the essential credibility boost of having
the purchase in hand before paying the price. No tactile experience. Online shopping
is purely an information experience. (Or user experience, as we like to say.) This
again places a huge premium on good content. One many sites fail.
LOYALTY = BUSINESS
One of our study participant said, If I have a good experience with something, Ill
stick with it forever. Not all users are that loyal, but our research does indicate the
tremendous benefits from fostering customer loyalty in e-commerce.
In the web-wide tasks, we didnt specify what site users should visit for their
purchase. No surprise, half of the users went straight to a search engine. But it was
a bit of surprise that the other half of users went directly to some site they already
knew. Bypassing the search engines tollbooth on the information highway is the first
benefit of user loyalty. But the advantages reach much further.
Of users who started by searching the web, only 39% completed their task on the
first site they selected from the SERP (search engine results page). Almost 2/3 of
search users abandoned their first love and proceeded to do business elsewhere. This
outcome demonstrates that SEO and good search engine ranking are necessary but
not sufficient for Internet business success. Its actually more important to satisfy
users once they arrive at your site. Search users exhibit little loyalty to the sites they
happen to click on.
In contrast, those users who bypassed search in order to go directly to a preferred
site overwhelmingly ended up giving their money to that site: 71% did so and only
29% completed their task on another site. (Of course, this is a sufficiently big
amount of lost business to point out that you cant take e-commerce users for
granted, even when theyre loyal to your site.)
The benefits of loyalty might make you push aggressive registration requirements,
but that would be a mistake. You must convert first-time shoppers before they can
become long-time shoppers, and users strongly resent up-front registration. On the
other hand, users frequently complained about the drudgingly large amount of data
entry they were forced to perform to complete their purchase. So by reminding
repeat users of the time savings, you can nudge them to register eventually.
In general, a longer-term perspective on the full sales cycle and total user
experience would benefit sites. A transmedia design strategy should reach beyond
the main website to encompass a mobile site, an email newsletter strategy, and
good customer service (including good confirmation messages). Yes, e-commerce
user experience has come far, but it has even further to go to truly meet customers
needs.
WWW.NNGROUP.COM
RESEARCH STUDIES
The information in these reports is a result of two separate rounds of e-commerce
studies conducted by Nielsen Norman Group as well as a round of design reviews of
a set of e-commerce websites. The studies took place in the United States, United
Kingdom, Denmark and China (Hong Kong), and involved user testing, a diary-based
longitudinal study and an eye tracking component.
The Methodology report in the E-Commerce Report Series includes the full details of
each study, the list of sites tested, and information about participants.
The Wishlists and Gift Certificates, Transactional Email and Confirmation Messages
and Locator Usability reports are based on additional research studies. Each of these
three reports includes its own methodology section.
10
INFO@NNGROUP.COM
Study One
The first research study was conducted by a team of five usability experts. They
conducted usability tests of 20 business-to-consumer e-commerce websites. A total
of 64 people participated: 39 from the United States and 25 from Denmark. Nineteen
of the twenty sites tested were American websites, which were tested by users in
both countries.
Users ranged in age from twenty to sixty. All users had previously shopped online
and most had made purchases; however, we screened out people who had extensive
technical knowledge of the Web.
Usability testing sessions lasted two hours, and users typically tested three of the 20
selected sites in that time. Each site was tested by a minimum of nine users: six
from the U.S. and three from Denmark. Sites were selected in seven different
industries, such as clothing and toys, so that within each industry we had two or
three sites for comparison.
Tasks were modeled on common goals of online shoppers. Most tasks asked users to
find a specific item or were open-ended, allowing freedom to shop according to their
own preferences. In most cases, we stopped users before they entered a credit card
number, so they did not complete the purchase. We also included tasks involving
customer service information.
For each test session, a facilitator sat next to the user, providing instructions to the
user and taking notes. Users were asked to think aloud as they worked, describing
their decision processes and any positive or negative reactions to the sites.
Study Two
The second study included a diary-based longitudinal study and user testing,
including an eyetracking component.
Research began with the diary-based study. Ten participants from around the United
States were asked to record information in a notebook about their online shopping
experiences for a period of six weeks during the winter holiday shopping season. The
goal was to understand how users shopped online.
Users answered questions including the goal of visiting the site, why they visited that
particular site, and if they achieved their goal. Users were also asked about what
they liked and disliked about the site. Information from this round of research was
used in part to develop tasks for the user testing portions of the study.
The study also included user testing with participants in London, United Kingdom;
Hong Kong, China; Munster, Indiana; Kennesaw, Georgia; and New York, New York.
The New York City component, which was the largest, included eyetracking.
Eyetracking allowed the facilitator to observe and record where the user was looking
on the screen.
Ninety-eight users participated in user testing. Participants included an almost even
split between men and women who ranged in age from 18 to 64. All participants had
purchased online previously, with varied amounts of online shopping experience. The
least experienced user had purchased online once in the past year and 10
participants had made more than 30 online purchases in the past year. Users were
recruited across a range of household income levels and general online experience.
WWW.NNGROUP.COM
11
More than 100 sites were included in the user testing component of the study. Sites
selected for testing included sites big and small, from various industries with varied
product offerings and different design approaches. In addition, users completed tasks
on sites they had previously visited. Participants provided a list of sites during the
recruiting process and were asked to visit one of them during the study. This
expanded the number as well as the types of sites tested.
Tasks were modeled after those in the first study, including directed tasks asking
users to find specific items, open-ended tasks allowing for site exploration, and
customer service related tasks. Users proceeded as far as possible through the
purchase process with fake user information.
Users completed three additional types of tasks in the second study. Users visited
sites they had visited before, which allowed us to observe users returning to a site as
a repeat visitor. Users also completed open-ended tasks where they were given a
goal of something to purchase, but were not directed to any particular website to
make the purchase.
The New York component of the study also included a task where users completed a
purchase. Users selected one of five sites on which to shop and were given a budget.
They could purchase any item or items they wanted from the site within their
budget, send the purchase to themselves, and be reimbursed for the purchase price.
The same facilitator ran all sessions in the second study, except for the Georgia
tests. In all sessions, the facilitator sat next to the user, providing instructions,
observing and taking notes. Users thought aloud as they worked.
12
INFO@NNGROUP.COM
WHATS IMPROVED
We did see improvement in several areas. More sites offered user reviews of
products, which helped answer users questions and gave them confidence in their
purchases. This can help minimize the number of users who end up returning goods
purchased online. When expectations are adequately set, shoppers dont have much
chance to be disappointed.
Additional product images, with close-up images of features and characteristics, as
well as zooming and panning tools, also helped users on many sites, giving them a
much more complete sense of the product than could be given through one static
picture taken from a distance.
Site recommendations of associated, related, or accessory products have also
improved, helping guide users to the products that meet their needs or accompany
those theyve already expressed interest in. Users were interested in these
suggestions and often used them to navigate product inventory, but were more likely
to rely on them if they were highly and clearly related to the products they were
viewing.
IN THIS REPORT
This report starts with behavioral information about why shoppers go online in the
first place, and what users say they are willing to buy online. This is followed by a
discussion of supporting different types of shoppers, information which could be used
to develop personas for site development. We then discuss broader topics of how
users shop.
The Key Findings section summarizes the most important information from the entire
report series. The report ends with numbers success scores and task times from
our latest research, as well as a list of the most common problems users
encountered.
WWW.NNGROUP.COM
13
Price
Convenience
These may seem like obvious reasons, but it behooves websites to have their
design emphasize how they meet these basic consumer needs and wants.
Price
Users were often looking for a bargain online. Some users assumed online prices
would be lower than local prices. One said, Things are generally cheaper when you
buy them online. Another said, Most of the time, items are a lot cheaper than in
the stores.
Shoppers appreciated that they could look around for the best price online more
easily than they could by going store to store. Traveling between stores is much
quicker online than it is in the physical world.
14
INFO@NNGROUP.COM
Many users favorable comments about online stores were about pricing. One user
said of oddballshoe.com: The prices are good and they have a clearance section
with even better deals.
Our diary study participants echoed these ideas when explaining why they were
visiting a particular site over another. Many responses mentioned prices, such as, I
went to this site because of their great prices on brand name products.
A good price could even trump a previous bad experience, though that was rare. One
user visited a site with reluctance because of past problems with shipping. He
purchased a TV stand, cables, and a DVD player because of the huge discounts on
the product prices. He said, The prices were exceptional on these items. I didnt
have any negative experiences this time, but well see how long it takes for these
items to actually be delivered and what shape theyre in when they arrive.
Convenience
Convenience is a huge incentive to shop online. One convenience was delivery
users didnt have to go anywhere to get the items. One user said, The best thing is
its delivered to your door so you can stay there and do nothing.
Time savings was also a benefit. One user said, You dont have to spend time
running around to a lot of stores. Another user said he shopped for movie tickets
online so, I dont have to queue up for movie tickets or waste time walking to the
theater if its sold out.
Another user liked shopping for limited edition prints online. He said, We couldnt go
around to the shops: wed have to spend a year looking. But you go online and find
it.
Further, shoppers could shop as quickly or as slowly as they wanted online. In a
store, some shoppers said they felt rushed. One user said while shed never be
comfortable shopping in the same store for hours, she could spend as much time as
she liked online. She said, I shop quite slowly. I spend my time. I can spend hours
online at the end of the day, hours going through lingerie and clothes.
We saw this leisurely approach to shopping in our studies. Some users enjoyed
browsing the full inventory on a website before making a purchase decision. In
purchase tasks in the study, when users had a set amount of money to spend on a
site, some leisurely perused every possible option before making a decision.
Other users want to shop online to get through the shopping process as quickly as
possible, and we witnessed this behavior in our studies as well. They appreciated
sites that helped them locate products quickly, concisely presented product
information, and led them through a fast and simple checkout process.
Another benefit of online shopping for some users was the lack of salespeople and
other shoppers there was no one to bother you. One user said, You dont get
plagued by the people in the store, who invariably know nothing about the product
anyway. Another said, I buy clothes online. I dont like crowded shops. And I hate
going in changing rooms.
Another explained his process for researching and buying electronics. He said, I
have to spend time to compare. Its better to compare at home because I can spend
more time. A shop may be busy and I dont like to spend so much time.
WWW.NNGROUP.COM
15
Many users preferred finding their own answers on websites, rather than having to
contact the company. One of the benefits of shopping online that users mentioned
was not having to deal with people whether it was cashiers, other customers, or
pushy or uninformed salespeople. These users wanted to be able to find and buy
products without having to interact with anyone.
For example, a user who was shopping for a custom fruit basket searched and ended
up on the Gift Baskets of Pleasanton site, where such baskets were offered.
However, the site did not allow users to customize baskets online a phone call or
email was required. The user said, Ah, you have to email them. I just cant order it.
Lets go back. Having to contact the company was a hurdle in the users shopping
experience.
Sites that required users to call to place an order sometimes made users choose to
shop elsewhere. Many users preferred to place the full order online, as was possible
on Rodnick.com.
16
INFO@NNGROUP.COM
Shopping Is Social
The solitary nature of most online shopping was a detriment for some shoppers.
Some wanted input from friends and family, and a handful even called friends or
family or asked the facilitator for input while shopping during our study. One user
made a phone call during a task, explaining, Shes been looking for a flannel
blanket, too. I needed to know what color she wanted.
Users can always pick up the phone and call someone for input. Its also a good idea
to let shoppers email products to themselves or their friends, either to remind
themselves about a product or to solicit feedback from a friend. It is also important
to save users shopping carts, as they may want to show the items theyre
considering to others and may use the shopping cart as a holding area.
Some users lamented that there was no one to help them when they were shopping
online. One user shopping for a microwave on the Comet site was frustrated because
he didnt understand the terminology used on the site. He said, A situation like that
makes me want to go to the old school style of shopping. Just walking around the
shop.
Users missed the ability to view, hold, or try on items or to ask questions. Sites with
robust product information helped alleviate some of these concerns, and we did see
a handful of shoppers interact with live chat offerings to get assistance at key points
in the shopping process.
WWW.NNGROUP.COM
17
tactile products
expensive products
perishable products
Tactile Products
The tactile nature of shopping in a store versus shopping online was a big
consideration for many users. Users mentioned reluctance to buy clothing, bedding,
pillows, and upholstered furniture things they would like to see, touch, wear or
use before buying. For instance, while a shopper may have been comfortable buying
a sweater like one hed seen in a store, he was more hesitant to buy another one
sight unseen and even more importantly, untouched. As one user said, Anything
like a bed, mattress, sofa: you need to lie on it and get the feeling of it before you
make a decision.
One main concern for shoppers was fit, for items that they would normally try on in
the store. A user said of buying pants from Lands End online, I just dont trust fits
until I try them on. I know Lee fits, so I buy it. But if I went into a store and tried it
on and knew it fit, then I would buy it online. Now that I know about these pants, I
would go and try them on and then get them online. I think Sears carries them.
Another said, Clothes, I never buy online. I like to try them on before I make a
decision.
There is no tactile nature to the Web. Stores will always have that advantage. But
consider what can be done to assuage users concerns about buying items without
having touched or experienced them. Excellent product descriptions can answer
users questions. High quality images, from a variety of angles and showing various
features, can emphasize and clarify product details.
18
INFO@NNGROUP.COM
AnnTaylor.com allowed users to zoom in to see product details, showing fabric and
craftsmanship clearly. The top image shows the default product picture, and the
second shows the highest level of zoom available on the site.
WWW.NNGROUP.COM
19
For items such as clothing, bedding or rugs, a high zoom on product images, or close
up images of details, can help users assess the quality and craftsmanship of the
product. A close zoom can allow the user to inspect a seam or a button. Fabric or
color samples free or low cost can help alleviate users concerns. Such samples
makes sense for more expensive items, such as upholstered furniture, where color
and feel may make the difference to a shopper. This is particularly helpful since it is
difficult to accurately judge color online.
Expensive Items
Some users were hesitant to buy expensive items online. Users couldnt necessarily
assess the value of an item from an online description and picture. One user said,
Its hard to tell the quality of jewelry online. Another said, I wouldnt buy a car
online I couldnt commit to buying it without a test drive. A third said, I would
never buy a big ticket item, like a car or quality jewelry.
In these cases, outside authentication of products was helpful, such as a gem report
for high-end jewelry or an accident and maintenance report for a used vehicle. In
addition, high-end sites require even better customer service, ready to answer a
users question at any point of the shopping or purchase process.
20
INFO@NNGROUP.COM
The added red ovals above show Blue Nile offered a customer service phone
number in the upper corner of the page as well as below product information,
together with information about asking an expert.
Perishable Items
Some users hesitated to buy perishable items because delivery time was key. One
user said, Id worry about something susceptible to temperature in the
summertime. Another said, You cant order fresh items from a website!
Providing clear information about shipping and delivery is essential for perishable
items. Users wanted to know how items would be packaged, how to dispose of
packaging (such as dry ice) or how quickly they needed to open, water, or
refrigerate perishable items.
WWW.NNGROUP.COM
21
22
INFO@NNGROUP.COM
Solutions
Expensive:
Jewelry
Cars
Outside authentication
Good customer services with friendly and knowledgeable
customer support
Perishable:
Food
Plants
WWW.NNGROUP.COM
23
24
INFO@NNGROUP.COM
The chart above shows the 10 diary study participants stated reasons for visiting ecommerce sites during the 6-week study. They reported 263 site visits. Looking for
a product type accounted for 35% of site visits (91). Looking for a specific item
added another 27% (71 visits). 9% (23) of visits were inspired by a sale or looking
for a sale, and 6% were looking for gifts (15). Users visited sites because of an
email message 5% of the time (14 visits), and for general browsing 4% of the time
(11 visits). Customer service or account related activities caused 3% (9) of visits,
and 3% of visits were to check prices (8 visits). Two percent of users were looking
to spend a gift card (4) or because theyd seen a catalog or print ad (4), and 1%
were looking for coupons (2).
Product-focused
Browsing
Researching
Bargain-hunting
One-time shoppers
WWW.NNGROUP.COM
25
Although a good site experience is crucial to all types of shoppers, different elements
of the shopping experience take on more significance depending on the users goal
and approach. Designing with these user types in mind will help the overall user
experience on the site.
Product-focused
Many shoppers go online knowing exactly what they want. They may need a
replacement for something they already have. They may have already researched an
item and know exactly what they want. They may have been to a store and seen the
product they want, but waited to buy it online. Regardless of the reason, these
shoppers are goal-oriented. They know what they need, and they want the site to
give it to them quickly.
In our study, our goal-oriented shoppers needed a James Bond DVD set, a
replacement laptop battery, a Cleveland Browns jersey, a taillight for a car, and
printer ink, among other things. These users werent looking to spend time leisurely
browsing a site, to analyze product information, or to carefully consider a purchase.
They wanted to find what they needed, get in and get out.
These shoppers may know where to get the item in question they may go to an
online store they know that carries it, or the online presence of a store where they
saw the product. They may have purchased the item in the past, or bought
something similar.
They may use search engines to find the product, typing in the exact product they
want and picking a search result. They may even use meta-shopping engines or
review sites, such as CNET, Google Shopping, or Kelkoo to determine who has the
product for the best price.
Once at the site, all these users need to do is locate the right product, confirm that
its the right one, and buy it. Some wont look at product descriptions at all. A quick
look at the name and product picture confirms the product is correct, and theyll buy
it.
The goal here is speed. Get the user to the right product, let them know its the right
product, and let them check out. The user may not be in a hurry, but he isnt in the
mindset to linger and spend quality time with the site. He may notice an upsell
opportunity, but hes more likely to continue on with his intended purchase without
distraction.
One user in our study had a product in mind when she visited FYE.com to spend a
gift card. She immediately searched for the name of the movie Heartburn and
was thrilled to see results. Shed had trouble locating the product previously and was
excited to see it was offered and available. She even ended up buying two copies
one for herself and one for a friend.
26
INFO@NNGROUP.COM
A user was happy when FYE.com carried an item she had trouble finding elsewhere.
The site allowed her to quickly search for, locate, and buy the movie she wanted.
Letting return users easily see items previously purchased for reorders
or accessory purchases
Browsing
Browsers have a much more leisurely approach to shopping online. They may look to
their favorite sites or new sites, for inspiration or to kill time.
One user said, When I dont have time to go shopping, I go online to check out
whats new or on sale. Another said of a visit to iTunes, I didnt buy any music, but
I enjoyed looking for potential songs to download.
Several users in Hong Kong said they looked at websites that they knew did not ship
to Hong Kong, but browsed the sites anyway. They checked the fashions on the sites
and then looked locally for items that were comparable.
WWW.NNGROUP.COM
27
It may seem counter-intuitive, but having browsers on your site is a good thing.
These are people who are choosing to spend time on your site, with your company,
with your brand. They are using the site as entertainment and inspiration, and
theres a great opportunity there to turn these browsers into buyers. If users have a
consistently good experience on your site finding things they like and seeing the
latest products, theyll be more likely to think of your site or even your physical
stores when they are ready to buy.
Browsers are not necessarily looking to make a purchase, but if they see something
they really like, they may turn into buyers.
Browsers may also be looking at the site because they are planning a trip to a store.
One user explained she looked at Banana Republics site: When I dont have time to
go shopping, I check out whats new or on sale. I check it before I go to the store.
Another said of Costcos site: I did not buy a gift. They had a bunch of good stuff,
but I know Ill go in person in a few days and see the items up close.
Make it easy for your customers to see whats new, whats popular and whats on
sale. When shoppers come to the site on a regular basis, its not to see the same
information they saw the week before; its to see whats changed. Browsers are
interested in the latest items, the latest deals, what other people are buying. Related
items and suggested products can help them navigate through the site, leading them
to new areas and new products. Top-selling products, most popular products, and
top-ranked products can all do well for browsers.
28
INFO@NNGROUP.COM
WWW.NNGROUP.COM
29
Researching
Researchers are goal-driven browsers. They plan to purchase, but the purchase may
happen today, tomorrow, next week or in six months. Theyre looking online to
collect information about products and prices, and may be in any stage of research.
Researchers may be educating themselves about unknown product types, either for
a first time purchase or to purchase a gift. Or they may be well-educated about the
products theyre looking for, and trying to find the best price for the best
combination of features.
Shoppers may have a product category in mind and be looking for the best deal or
best product to meet their needs. Research may take place in several in-depth visits
or be a one-time quick decision between options on one site.
Researchers may visit multiple sites to gather information before committing to a
purchase. (And keep in mind that purchase may occur online or in a store.) Users
may also visit your site or others multiple times before making a purchase decision.
They may use one site for researching and another for the eventual purchase.
The goal is to turn these researchers into buyers. Trust is important in online
transactions. If users have seen that your site offers detailed product information,
excellent support, and clear navigation as theyve been researching, theyre more
likely to buy from your site. If your site offers limited or unclear product information,
they wont spend much time researching on it, nor will they think of it when it is time
to buy. The opportunity is to convert researchers to buyers, to become a
knowledgeable and trustworthy source of information and products.
The biggest key to a successful experience for researchers is to allow easy product
comparison. This does not mean creating large, elaborate comparison engines
(though some comparison engines work quite nicely). Facilitating comparisons can
be as simple as providing consistent information about products, so users can easily
determine what the differences are among them.
When sites do not offer comparison tools, users sometimes create their own. A user
on BuyDig.com opened two browser windows to compare product specifications side
by side. He said, When you get close, you want to compare side by side. Id also
open a new window to go to CNET.com to get reviews. That will tell me even more.
Researchers are looking for a high degree of detail in product descriptions and
images. This means these additional sources of information should be available, but
dont offer so much information up front that you scare your product-focused or
browsing shoppers away. Layer the information, but provide sufficient details to
answer the questions researchers have.
30
INFO@NNGROUP.COM
Circuit Citys site provided well-structured layers of product information. The page
started with key features, then had a summary of highlights, followed by tabs for
customer reviews, specifications and accessories.
WWW.NNGROUP.COM
31
Bargain-Hunting
A key reason that users shop on the Web is that they think they can get a better
deal online. Some shopping behavior is motivated by this intention to find the best
deal possible.
Bargain-hunters may or may not have a particular item in mind when they start
shopping. And bargain-hunting behavior may impact any type of online shopper
the product-focused shopper, browser or researcher.
One user admitted she tended to buy things solely because they were a bargain.
When hunting for other items, if she came across a good deal, she found it hard to
pass up.
The most important thing for a bargain hunter is to be able to locate deals. Prices
must be clearly listed. Sale items must not be hidden on the site, but listed alongside
full-price items, with savings highlighted. Available discounts must be easy to use,
such as coupon codes for money off or free shipping.
Some users immediately looked for deals and discounts on sites, checking Sale
sections first. We saw much of this behavior in purchase tasks, where users were
looking to get the most for the amount of money we gave them to spend.
The opportunity with bargain hunters is to turn them into repeat customers. Several
users in our notebook study referred to returning to a site specifically because of
knowledge of a sale, information they learned through catalogs, advertising, or email
messages. Sites should take advantage of bargain hunting behavior by sending
coupons, offering discounts for more expensive purchases, and offering free shipping
with minimum purchases.
Many shoppers may offer their email address if they know they will receive special
discounts or offers in return. One participant in our study who was spending a gift
card on a site signed up for the email newsletter 2 in order to receive a discount, and
used the discount for her purchase. A diary participant advised his nephew to sign up
for an email newsletter because, The site is usually expensive and they dont offer
good discounts unless one has a coupon.
One user said, They often offer $10 coupons that make the prices even better.
Another said, I just went back because they sent me a coupon.
For much more about the design and usability of email newsletters, please see our separate report
on this topic, available at http://www.nngroup.com/reports/email-newsletter-design
32
INFO@NNGROUP.COM
When discounts are available, make them easy to use. One user went through a
saga on the BabyStyle.com site, trying to get free shipping. The site informed users
of free shipping with $50 purchase in the shopping cart, telling them how much more
they needed to spend to quality for free shipping. However, when users reached the
qualifying total, the message, including the coupon code necessary to take
advantage of the offer, disappeared.
One user hunted for more than 10 minutes for an item that was just expensive
enough to push his total over the free shipping threshold. When the free shipping
information disappeared, he assumed it would be automatically applied to his order.
This was not the case. When he reached the order summary page in the checkout
process, he was so outraged at the shipping charge that he canceled the order.
WWW.NNGROUP.COM
33
Shoppers were frustrated when information about discounts that was advertised
throughout the site suddenly disappeared on screens where users had to enter
discount or promo codes, like on Gap.com. The discount code promoted on the
shopping cart page (seen in the first screenshot above) and throughout the site
disappeared on the page where users needed to enter the code.
34
INFO@NNGROUP.COM
Many shoppers tried to take advantage of free shipping offers. One of users
complaints about shopping online is paying an additional shipping charge. When sites
offered free shipping, even when a minimum purchase was involved, users often
tried to take advantage of such deals.
A handful of users in our study looked for coupon codes when making purchases,
leaving the site to do a quick search for any available discounts they could find on
the Web. Many others mentioned doing so when they were shopping on their own at
home or at work.
Keys for success for bargain-hunters are:
One-Time Shoppers
One-time shoppers may be product-focused, browsing, bargain-hunting or
researching. They are often gift card recipients, gift card buyers, or gift buyers. They
may come with a goal in mind, such as a list of products the gift recipient is
interested in. They may simply be browsing to find the best product. Or they may be
researching and comparing across the sites inventory to buy the best item. They
may be looking to spend a gift card or aiming for a certain budget, so may want to
get the most for their money.
These shoppers are not familiar with the site or, possibly, the products it carries.
They have no interest in engaging with the site or learning more about it. They need
clear site navigation to get to products of interest and get a sense of site inventory
and selection. Clear product descriptions help them determine which items best fit
their needs. Company information can help them feel more confident giving an
unknown site their personal and financial information.
A main complaint of one-time shoppers was site registration. When users were
doubtful they would ever return to a site, they did not want to create an account or
have the site remember their personal data. They appreciated sites that allowed
them to make a purchase without requiring them to create an account.
WWW.NNGROUP.COM
35
One-time shoppers didnt want to have to register for sites in order to checkout.
Office Depots site allowed users to checkout as guests.
36
INFO@NNGROUP.COM
WWW.NNGROUP.COM
37
Other users blurred the lines between online and in-store shopping with in-store
pickup of items ordered online or shipping to a local store for free. These options
helped address the online shopping problem of delayed gratification, as well as the
in-store problem of pushy salespeople or crowds. Buying online let the user avoid the
store experience, while picking up at a store avoided delivery concerns or delays.
This also allowed users to save on delivery costs and to get the item at their
convenience.
Another intersection of online and offline commerce is through returns or exchanges.
Users are starting to expect that they will be able to return or exchange at a store if
they buy online. Allowing users to do so eliminates another concern some users have
about online shopping: that they will have to pay return shipping if the item isnt to
their liking.
38
INFO@NNGROUP.COM
Our user base was small in both London and Hong Kong, but we noted some
differences between our participants. One key difference was in patience. Our users
in London were the most patient, waiting for what seemed to be interminable lengths
for pages or content to load, without complaint.
Our participants in the United States were somewhat less patient, waiting for pages
to load while complaining about the delay, or sometimes refreshing pages in an
attempt to speed up the process. Our users in Hong Kong were the least patient,
immediately refreshing pages, opening new browser windows or tabs, or even
visiting other sites to fill the time while slow pages opened.
Users also had regional concerns about shopping, depending on their location. In
Hong Kong, shoppers were concerned that delivery had to be more convenient than
shopping locally. They were particularly concerned that packages would not be left at
their homes if they were not present, and they would have to retrieve the package at
a local post office or from a local carrier. One said, Its quite idiotic: You pay for
delivery cost, but in the end you are the one going to the post office to pick up the
large parcel. Considering how convenient it was for many of our participants to shop
locally, with the wealth of shopping opportunities available in Hong Kong, they had to
have a good reason to want to buy online.
In London, our users voiced concern about convenience would waiting for a
delivery be more convenient or less than driving to a local store. A user said, This is
still quicker than getting in your car and driving to the shop. Another compared
shipping costs to train fare or the cost of petrol. Another said, Things can be quite
traumatic with congestion charges. Better to sit at home and do it on your own
time. Another user complained, however, when she was on a site for an extended
period of time, I could have driven down to the store quicker.
Similarly, users in Georgia and Indiana in the United States sometimes contemplated
the cost, in terms of gas and time, to drive to a mall or a store versus buying an
item online and paying shipping charges. One said, With gas prices high, I dont
mind paying for shipping.
Users in New York, though surrounded with shopping opportunities like shoppers in
Hong Kong, were still likely to want to shop online for the convenience of not having
to carry items home. Many had methods for receiving packages, even when not at
home, through doormen, neighbors, or local stores who would accept deliveries for
them. However, we found our New Yorkers to be much more concerned with who
would be delivering the item which carrier or delivery service. Several of our New
York participants had preferred carriers and would select specific delivery options to
ensure those carriers were used. Many wanted to know which carrier would deliver a
package, and not just when the package would arrive. A handful went so far as to
refuse to shop at sites that didnt use particular carriers or that only offered a
despised carrier.
The only other local difference we noted was specific to New York. We found many of
our New York participants entered NY or NYC as their city name, rather than typing,
New York. Very few sites accepted this as a valid entry.
WWW.NNGROUP.COM
39
These differences led to some guidelines in the report series, as well as some
detailed examples within the guidelines. While we didnt see huge regional or
international differences in behavior, we did note these smaller differences. This
emphasizes the importance of testing with users in your own key markets, allowing
you to identify smaller issues as well as larger ones.
BUILDING LOYALTY
A big part of your business should be building loyalty with customers. A great user
experience is the best way to keep people coming back. When we asked users in our
studies about sites they had good experiences with, they often remembered times
when sites exceeded their expectations. As one user said, I went to Beumo because
their prices are unbeatable, selection tremendously vast, and they often offer $10
coupons that make prices even better. When I lived in California, I shopped there in
person, which has helped to build me into a loyal customer.
Another user said, If I have a good experience with something, Ill stick with it
forever. My in-laws probably get sick of 1800Flowers, Sheryl and Company, Caribou
Coffee. But I stick to the known. I like 1800FLowers because I get points. I joined
their club, so I get points added and get discounts.
Some users even noted instances where the resolution of a problem was so good
that they remembered the good response rather than the initial problem. One user
complained of difficultly using a coupon code on Kohls.com. She had to ask a
customer service representative how to use it, but in the end said, Great store! I
still shop the site!
Many of our diary study participants reported going to sites because of past
purchases or past experiences with the site. Many of these repeat interactions
revolved around discounts, coupons, deals or promotions.
Users visited sites because of email messages about specials, or because they had
loyalty points or discounts due to a credit card associated with the site. For instance,
a user said she went to LLBean because, I received an email that they had new sale
items and I wanted to check it out. I went because of the sale and I have coupons
and free shipping for the site because I have a rewards credit card.
A user on DisneyStore.com said, They send me sale updates and special discount
codes. I usually buy something when I get the discount and then I save what I
bought to give as gifts later.
Good prices and promotions drove users to sites. One user mentioned visiting
BassPro.com because a friend sent me a link for 5 fishing lures for $5 from the site.
I got a great deal on the lures 5 for $5 and free shipping! A user on Ulta.com
said, They sent me a coupon code for $5 off any $10 order, so I went to check out
what they had. I received $5 off my order and also had free shipping, so I really got
a bargain!
40
INFO@NNGROUP.COM
The chart above shows the number of sites users visited during open-ended tasks.
In 52 tasks, users visited only one site 29% of the time, and visited two sites 27%
of the time. The maximum number of sites visited in one task was 27.
WWW.NNGROUP.COM
41
Users visted an average of 3.2 unique sites while completing open-ended tasks. The
lowest number of sites was 1 and the highest was 12, with a median of 2 sites
visited. Twenty nine percent of users visited only one site (15), and an additional
29% of users visited just 2 sites (14) to complete their tasks, accounting for 58% of
users.
Users were approximately evenly split between those who went directly to a known
site to begin the task and those who started the task with a Web search. Users
started with search 24 times, or 48% of the time, and started by typing in the URL of
a known site 28 times, or 52% of the time.
42
INFO@NNGROUP.COM
Users started open ended tasks by typing the URL of a known site 54% of the time
(28), and with a search engine 46% of the time (24).
Of those users who went directly to a known site by typing in a URL (28 users), 15
bought from the first site without visiting any other sites. Five additional users
bought from the first site after visiting other sites as well in other words, they
returned to the first site they visited to complete the task. Eight users, or 29% of
users who went to a site first, ended up completing the task at a site other than their
first choice.
Seventy-one percent of users who started at a known site ended up completing the
task on that site.
WWW.NNGROUP.COM
43
Of the 28 users who went directly to a site when completing open-ended tasks
(rather than to a search engine first), 53% (15) of users completed the task on that
site, without ever leaving it. Another 18% (5) returned to the first site to complete
the task, and 8 users (29%) completed the task on another site.
This is interesting to contrast with users who started with a Web search. Twentyfour users started with search, with 15 of them going directly to Google, 3 going to
Yahoo, 1 going to MSN, three typing inquiries into the browser address bar (resulting
in Live Search results), and 2 using the browsers Search option, which was set to
AOL Search.
Of the 24, eight users bought from the first search result followed without visiting
any other sites. Only one user bought from the first site after visiting another site.
Fourteen ended up completing the task at a site other than the first result visited.
One user did not complete a purchase.
44
INFO@NNGROUP.COM
Of the 24 users who started the open-ended task by going to a search engine, 35%
(8) completed the task on the first search result they visited. Another 4% (1 user)
returned to the first result visited to make a purchase. All other users, 61%,
completed the task on a site other than the first search result visited.
When they started with a search, rather than a known site, it indicated less
familiarity with the product in many cases, so it is not surprising that it took more
research to make a decision.
71% of users who navigated directly to a site stuck with that site, ultimately
purchasing from it. But when users started with a search, they bought from the first
search result visited only 39% of the time.
Of those users who searched first, half clicked on a natural search result first, and
half clicked on a paid search result first.
WWW.NNGROUP.COM
45
Key Findings
The full E-Commerce Report Series includes more than 500 guidelines about making
your e-commerce site easier to use. Here, we summarize the most important key
findings, guidelines and concepts from the report series.
A Welcoming Homepage
The homepage is a crucial page on the site, as it acts as a users introduction to the
company, its products, and the site itself. The page needs to look trustworthy, make
clear what type of products are sold on the site, and invite users to make a
purchase.
A Clear Structure
A clear site structure is important for the obvious reason of letting users navigate to
products of interest. But it is also essential for shoppers who arrive at your site via a
link to an interior page, such as through a search engine, blog, email from a friend,
or other source. Remember that many shoppers will enter the site without seeing the
homepage. For these users, the site structure and navigational options become the
way they are introduced to the site and all it has to offer.
When users dont know what navigational categories mean, or the differences
between them, they are unable to navigate to the right products on the site. Users
cant buy what they cant find.
46
INFO@NNGROUP.COM
Key Findings
A user wasnt sure where to go to find blenders on Cooking.com. She wanted to see
a category called Blenders, but only saw Bar Blenders. She never clicked the
category, and thought her only choices were blenders featured on the first page, a
$500 bar blender or a hand blender. I just want a $50 regular blender.
Cross-Referencing
Products should be cross-referenced as appropriate, so shoppers can find items in
multiple related categories. When users dont find what they want in one category,
they dont necessarily look to another related category. They assume if no item is
shown, no item exists.
WWW.NNGROUP.COM
47
Product Comparisons
Users had their own ways of comparing products. Some took notes on paper. Others
opened multiple windows or tabs. And some used the comparison tools provided by
sites.
The most important thing sites can do to allow product comparison is to provide
comparable product information and equivalent levels of detail about similar items on
the site. If offering a full comparison tool, users must be able to quickly identify the
tool, easily select items to compare, make comparisons of helpful information across
products, and quickly remove items, add items to the cart, or view product detail
pages. Comparison tables should highlight differences. Unclear or incomplete
comparison tables leave users wondering if features exist in a product or not.
48
INFO@NNGROUP.COM
Key Findings
PRODUCT PAGES
Further information about each of the following topics and additional topics can be
found in the Product Pages report in the E-Commerce Report Series.
When a shopper couldnt find the product information he wanted on Flight 001s
site, he looked to Google to find the answers he needed. Search results steered the
user to other sites offering the product at a lower price.
WWW.NNGROUP.COM
49
Users can easily become overwhelmed with too much product information at once.
Layer product information so those who want minimal details or distinguishing
features can find them easily, but so those wanting specifics have access to them as
well.
Product images are incredibly important. Users cant see, touch or hold the item they
are purchasing online. Pictures have to show users as much as possible about a
product. Images from different angles or showing items in context help users
understand more about a product. In our latest round of expert reviews, we noted an
increase in the size of product images, which helps users see product details more
clearly.
The picture of a toaster with a bagel in it reassured a user on HSN.com that the
slots were big enough to toast bagels.
Product prices and product availability are also crucial. Some sites hid product prices
due to manufacturer restrictions. This was incredibly frustrating to users. Some
understood the practice, but it bothered them. Others didnt understand why they
needed to take another step just to see a price. Others didnt realize a discounted
price was available; they just skipped items without a clearly listed price. One user
said, A lot of products need to be put in the cart to see the discounted price. This
drives me nuts, because this is a needless extra step.
50
INFO@NNGROUP.COM
Key Findings
Hidden prices, such as this one on NewEgg.com, frustrated users. They did not want
to have to add an item to the cart to see the price.
WWW.NNGROUP.COM
51
52
INFO@NNGROUP.COM
Key Findings
A user was skeptical of favorable reviews on the Nordic Track website because she
doubted manufacturers would publish poor reviews of their own products.
They also sometimes doubted the trustworthiness of the site itself if the site offered
reviews, but only some products actually had them. If too many items had no
reviews, users sometimes worried that meant the products were not good.
WWW.NNGROUP.COM
53
Subtle page changes, such as the line of text above the product information on
JanieAndJack.coms product page, shown above, were often overlooked by
shoppers.
When sites didnt provide adequate feedback, some users thought they had added an
item to the cart when they had not, and others added items multiple times. While
subtle page changes may be designed to keep the shopper in the shopping
environment, they actually often resulted in the user leaving the product page to
investigate the shopping cart and try to determine what, if anything, had been added
to the cart.
Shoppers didnt necessarily need to see the entire cart on each page of the site. But
including an indication of the number of items in the cart or a subtotal for the items
in the cart was helpful to users. This prevented them from having to check the cart,
particularly if they were shopping within a budget.
54
INFO@NNGROUP.COM
Key Findings
WWW.NNGROUP.COM
55
Optional Registration
Shoppers dont want to register. They are tired of usernames and passwords. They
dont want to join sites they dont intend to visit frequently. They worry registration
will cause unwanted email or physical mail. They often see registration as a benefit
to the site (keeping their personal information) rather than for them (making future
purchases or package tracking easier.)
One user said, I dont like having to register on every single website for every single
purchase that I make. Id rather do it as a guest and then Im not subject to their
constant emails. I just prefer to get my item and go.
Users appreciated optional registration that was part of the checkout flow.
Registration can be as simple as adding optional password fields to the existing
purchase process. Listing the benefits of registration from the shoppers point of
view, rather than the sites point of view, helped. Users liked to know they could
save time or track orders.
Emphasizing the ability to save information for quicker future purchases is important.
In our first study, users often complained about providing personal information
because of security concerns. In our second study, shoppers were tired of entering
the same information repeatedly on each site they visited. Remind users that
registration means quicker checkout and less data entry.
56
INFO@NNGROUP.COM
Key Findings
Money Matters
Users didnt want to be surprised with additional charges or fees at the end of a
checkout process. They appreciated knowing the full price early.
They also wanted easy ways to save money. They wanted specials that were
advertised on the site to be automatically applied to an order, rather than having to
remember a coupon code. They wanted to see how discounts or savings were applied
before entering payment information. And they wanted to see the full breakdown of
their costs before entering that payment information.
Shipping Options
One of the changes in recent years has been the ability to go to a store to pick up an
item purchased online. Such options bypassed many of users complaints about
shopping online: shipping charges, waiting for delivery, and being home to accept a
package.
Regardless what the shipping options were, users wanted to know associated costs,
estimated delivery timeframe, and, in some cases, which carrier would deliver the
items. Some users, particularly in our New York City research, had a strong
preference for certain carriers over others.
Shipping costs needed to be easy to find. Some users comparison shopped for the
best deals on shipping, to get the most for their money. Others looked for free
shipping offers. Users complained about shipping charges as one of the big
downsides of online shopping, so free shipping offers were enticing and appreciated.
One user assumed her $150 purchase on Cooking.com would qualify for free
shipping (though the site did not mention any such special.)
When she saw a shipping charge of $21, she said, If its $150, it should be free
shipping. That would be a plus. When Im shopping online, I particularly look for free
shipping. And because theres a shipping cost, I probably wont buy it. What I would
do is take the name and the maker and check Amazon and Overstock prices. And
different sites, like Target and Walmart, and do a price comparison to see if I could
get free shipping. I would not purchase it if shipping is not free. I do my best to find
free shipping. I can go out my door and drive to Target. The purpose of shopping
online is convenience or cost. If the price point is cheaper with shipping, I might
purchase it, but with a shipping charge, I definitely have to shop around.
WWW.NNGROUP.COM
57
When a shopper saw a $21 shipping charge on Cooking.com, she decided to shop
around.
SEARCH
Further information about each of the following topics and additional topics can be
found in the Search report in the E-Commerce Report Series.
Search Behavior
Eighty-three percent of users in the eyetracking portion of our second study
searched on at least one site. Users searched to see the variety of products on a site,
to locate a product category quickly, after site navigation failed, to locate a specific
product, to locate products with a specific attribute, or when product descriptions
didnt answer their questions. Users searched if guided navigation failed, or to
narrow product options on sites with expansive inventory. Some searched to return
to an item they had seen previously, and others to find a piece of information on the
site, such as a return policy.
Sometimes search was an alternate way to get to products when navigation failed.
One user said on Targets site, Some sites dont list an item, but you can search for
it and find it. So sometimes its helpful to search, even if it looks like the site doesnt
have the item youre looking for.
Within a website, the most common type of query at 34% was a combination of a
product category and at least one product criterion, such as women ski pant.
Twenty-two percent of queries were for criteria alone (such as peanut) and 20%
were for categories (such as shredders). Within a website, the average search
query was 14.5 characters long, with 2.3 words. Two-word queries were most
popular, accounting for 41% of searches.
58
INFO@NNGROUP.COM
Key Findings
Search as Feedback
All sites can benefit from regularly reviewing search logs. The search box is the
easiest way for users to talk to the site. Searches can reveal problem areas in the
navigation, gaps in selection and, most importantly, the language visitors use to
describe your products and their needs.
Scoped Search
It is generally better to let users narrow results rather than ask them to scope the
search, or set the scope yourself, when they submit the query. When users
accidentally or unknowingly run searches with a category, rather than across the
site, they often think selection on the site is limited.
WWW.NNGROUP.COM
59
When done well, faceted search helped guide users to the most relevant product
choices.
Such options can be great when they work. But there are many instances that are
poorly implemented. A key problem is categories that dont match shoppers
interests or needs for that particular product. Sites also suffered when they
incorrectly categorized items, so users searches didnt return all products that met
their requirements or returned items that didnt match users needs. Users needed to
be able to easily notice and use options, combining criteria when relevant and easily
removing criteria.
60
INFO@NNGROUP.COM
Key Findings
CUSTOMER SERVICE
Further information about each of the following topics and additional topics can be
found in the Customer Service report in the E-Commerce Report Series.
Easy to Find
The most important aspect of providing customer service information is making the
information easy to find. Users often looked to the top or bottom of the page when
looking for information. They looked for links to a customer service section, or
directly to the policy of interest. Common information requests, such as shipping or
returns, can be separate links to lead users directly to the information of interest.
Users expected support information to be included throughout the site, in relevant
areas. They expected to see information about shipping or returns as they were
shopping and adding items to the shopping cart.
Users also looked at and responded to mentions of customer-friendly policies on
sites. Information about free shipping, free returns, and satisfaction or price
guarantees were worth advertising throughout the site.
Getting in Touch
When shoppers needed an answer to their question, some wanted to help
themselves through the website and others wanted a way to contact the company
directly.
Even users who did not need to contact the company appreciated seeing an easilylocated toll-free phone number. This indicated to users that the company was easy
to contact if they encountered a problem.
Some shoppers preferred calling for service, because they would have an immediate
response rather than having to wait for a follow-up email. Others preferred email, so
they wouldnt have to wait on hold.
Live help, via chat, was also used by a handful of users in the study. Users had high
expectations for these interactions, expecting the representatives to provide more
details or insight than they could find on the site on their own. However, many users
found live chat to be a hindrance because popup windows promoted assistance at
inappropriate times or too frequently, disrupting their shopping.
WWW.NNGROUP.COM
61
62
INFO@NNGROUP.COM
Key Findings
SELLING STRATEGIES
Further information about each of the following topics and additional topics can be
found in the Selling Strategies report in the E-Commerce Report Series.
Clear Pricing
Online shoppers are often price-conscious. The value of items must be clearly
communicated, so users know what they are getting for their money. Product prices
need to be clear, and savings and discounts need to be reflected. All additional
charges should be listed and explained as early as possible in the process.
Shoppers also wanted easy ways to see sale items. A Sale section was helpful, but
shoppers frequently also wanted to see sale items interwoven with the main site
inventory, seeing full-price and sale items side by side.
Free Shipping
As mentioned previously, free shipping was a good incentive for many shoppers.
Shoppers often complained about paying for shipping, especially when many users
shopped online in order to get a better price on a product. They often compared the
online price to the cost and effort involved in buying the same item from a local
store. Whether offers were constant on the site, or available for a limited time or
with a minimum purchase, many shoppers found such offers enticing. We watched
many users change their orders or find additional items on a site so they could reach
the minimum total to receive free shipping. They wanted to spend their money on
products, not on shipping.
Welcome Back
Sites need to accommodate both new and returning customers. Sites can support
returning shoppers not just through personal information saved via registration. The
site can highlight new or discounted products, letting shoppers know whats changed
since a previous visit. Information from previous visits can be used to promote
products, and shopping carts can be remembered.
One user said of United.com: I like United because I have used it before and when I
log in, they remember the airports I use most often.
WWW.NNGROUP.COM
63
Users appreciated product listings that explained why a product was recommended.
Labels explaining that items were related, recommended accessories, or products
other customers purchased helped shoppers know why an item was being shown.
One user said as he viewed a list of popular products, Im sure other people buy
good things. Ill look at these.
They were open to such offers on product pages, but did not appreciate offers that
interfered with the shopping or checkout process.
Appearance is Everything
Users tended to put more trust into sites that looked clean or professional, rather
than sites that looked haphazard or dated. Adequate white space, consistent fonts,
professional quality images and clearly designed logos all contributed to creating a
good first impression.
Shoppers also occasionally checked information about a company when assessing
whether to purchase from a site. A reliable About Us section, with information about
the companys history and physical location, as well as contact information, helped
reassure shoppers that sites were legitimate.
64
INFO@NNGROUP.COM
Key Findings
Added features can enhance the users experience, but they have to work perfectly.
Users expected features to work instantly and as promised. In-page changes could
help users when they worked well, but in other instances, they caused long delays or
errors that disrupted, rather than streamlined, users experiences. If an in-page
change takes as long to load as taking the user to another page, it is not an
enhancement to the user experience. On some sites, such interactions slowed
performance and impeded users progress. In other instances, such as when moving
the mouse over a product image resulted in a zoomed view or made buttons appear,
users moved the mouse carefully to avoid such unintended actions.
Even when users quickly realized what the site was doing and what action was
causing it, they frequently retriggered the action unintentionally.
Availability
Users were frustrated when sites did not make it clear if items were backordered or
out of stock. They spent time picking the exact products they wanted, only to
discover an item could not be purchased. Availability needed to be indicated as early
as possible in the process, on product listing as well as product pages, and not only
as users added items to the cart. Similarly, if limited inventory is available, warn
users of the potential for items to be gone.
One user said, I didnt know about the item being out of stock until I added it to my
cart. Which made me frustrated. It should have come up right away and said This
item is backordered but can be purchased and delivered in 8 to 9 weeks right on the
page where theyre selling stuff. Thats a frustrating thing when you want to buy
something and now you cant, and you have to start all over.
WWW.NNGROUP.COM
65
Only when an item was added to the users cart did the site indicate the item was
backordered for 8 to 9 weeks.
INTERNATIONAL PURCHASERS
Further information about each of the following topics and additional topics can be
found in the International Purchasers report in the E-Commerce Report Series.
No Local Support
Some sites would ship items internationally, but provided little support for
international shoppers. The lack of free methods of contact deterred some shoppers,
and others worried about the hassle of dealing with international returns or
exchanges, particularly on sites with strict policies. Other users complained when
they did not qualify for discounts or special offers based on their location.
66
INFO@NNGROUP.COM
Key Findings
Number of tasks
Success Rate
Study One
496
56%
Study Two
507
72%
For each task we gave users in the second study, we measured success, task time,
and users subjective satisfaction. For this study, we gauged success on a 0 to 4
scale, with partial credit given for partial success in completing a task. Zero meant
the user didnt achieve any part of the task and 4 indicated complete success. One,
two or three indicated part of the task was completed, such as finding an appropriate
item and adding it to the cart, but being unable to complete the checkout process.
Subjective satisfaction scores for confidence in completing the task, satisfaction
completing the task, and frustration completing the task were judged on a 1 to 7
Likert scale, with 7 always being the most positive response. 3 Users filled out their
subjective satisfaction ratings on a paper questionnaire following each task.
A complete description of the tasks used in the study, as well as the tasks
themselves, are included in the E-Commerce User Experience Methodology report.
The table below shows a comparison of task times, success rates, and subjective
satisfaction ratings by task type. Each task type is discussed further in the following
pages.
That is, a user rating of 7 would indicate the highest level of satisfaction or confidence, but the
lowest level of frustration.
WWW.NNGROUP.COM
67
Customer
Service
Criteria
Purchase
Known
Site
OpenEnded
Task Time
9:27
3:23
11:36
23:08
9:28
10:13
Success
78%
85%
88%
98%
94%
87%
Confidence
5.6
5.9
5.9
6.8
6.7
6.1
Satisfaction
4.7
5.4
5.1
6.1
6.4
5.4
Frustration
4.8
5.3
5.0
5.7
6.2
5.3
Average
Subjective
Score
5.0
5.5
5.3
6.2
6.4
5.6
(Confidence,
Satisfaction and
Frustration)
Specific Product
We asked users to find a specific item on a particular website. The intent was to see
if users could find the item we described, or an item meeting particular criteria. For
this task, there was a correct answer (or a small set of correct answers).
9:27
Success
78%
Confidence
5.6
Satisfaction
4.7
Frustration
4.8
68
INFO@NNGROUP.COM
Although shoppers were fairly fast when they needed to find a specific product,
completing their tasks in 9:27, they were successful only 78% of the time. This was
the lowest success rate in the study. That left 22% of users without the desired
product, when they went to a specific site looking for a particular item. Subjective
scores were the lowest for this task type, as users were annoyed on sites where they
knew an item was available, but either could not locate or could not purchase it.
When we looked at what went wrong for this task type, most problems were caused
by users purchasing the wrong product. Users had trouble with incomplete product
information, and some never found the product. Unclear or easy-to-overlook error
messages accounted for additional problems, and four users ran into problems with
the item they wanted was out of stock.
Customer Service
We asked users to find customer-service related information on sites. We also
observed their use of customer service information in other tasks, but the numbers
below are specific to tasks where the end goal was finding the answer to a customerservice related question.
3:23
Success
85%
Confidence
5.9
Satisfaction
5.4
Frustration
5.3
Customer service tasks were quick, taking users only 3:23 on average. However,
users were only 85% successful finding the answers they needed. In 20 instances, or
16% of the time, users said they would call or email the company because they
couldnt find or understand the information available online. Nine users didnt
understand policy information and six more guessed about policies based on related
information. Three users read the wrong information and three didnt find policy
information at all and left the site.
Criteria Tasks
We gave users tasks looking for items that met particular criteria on a specific site.
In most cases, we provided users with general product characteristics to consider
without steering them toward any one product. The goal was to see how users make
purchase decisions between products, giving us insight into product descriptions and
product comparisons.
WWW.NNGROUP.COM
69
11:36
88%
Confidence
5.9
Satisfaction
5.1
Frustration
5.0
Criteria tasks took users about 2 minutes longer than specific product tasks, as they
needed additional time to review several products and make the best selection. They
succeeded 88% of the time. Subjective satisfaction scores were the second-lowest of
the bunch, as users were frustrated trying to compare and select items.
Twelve users were stymied by unclear or hard to notice error messages. Four didnt
like their product choices. Three ran into issues with site registration and two
stopped their purchase when a special offer was not applied.
Purchase Tasks
Only users in the New York eyetracking portion of the study completed purchase
tasks. For these tasks, we gave the user a list of five sites with brief descriptions of
the type of items the sites sold. Users selected one site and made a purchase for
themselves on the site within a specified budget.
Users shopped with their own credit cards and were reimbursed immediately after
the purchase. We asked users during the screening process if they were willing to
use their own information. If not, they used a gift card for the purchase instead.
Users had increased motivation to pay attention to product details because they
were buying items for themselves.
70
INFO@NNGROUP.COM
Make a Purchase
Task Averages
63 tasks on 22 sites
Task Time
Success
23:08
98%
Confidence
6.8
Satisfaction
6.1
Frustration
5.7
The purchase task was the longest and most successful of the tasks. It is important
to note that task times may not mean much on e-commerce related tasks. Long task
times can indicate problems with the site, or engagement with the site.
The purchase task was by far the longest task in the study, as users pored over site
inventory trying to find items they really wanted. Seven users spent more than 40
minutes on the task, with three of those spending more than 50 minutes. When
evaluating task time in your own studies, it is important to note how much time is
spent finding products and how much is spent in the checkout process. A long
checkout time is not indicative of engagement it is indicative of a problematic
checkout process.
Users were 98% successful on the task, as they had a good incentive to keep trying
to use sites, even if those sites were difficult to use. They wanted to complete the
purchase and be reimbursed. We wanted them to succeed as well for the 2% of
users who did not receive complete success for the task, we watched them as far as
they could go and noted the failure, and then assisted to help them complete the
purchase and receive their selected item or items. Users rated this task second
highest in terms of subjective satisfaction, second only to known sites.
Of the 2% of users who werent successful on the task, two users ran into errors
they didnt know how to fix in the checkout process, and one had a site error where
the site unexpectedly emptied the shopping cart.
Known Sites
During the recruiting process, we asked users about sites where they regularly
shopped or had previously shopped. During the study, we asked users to complete
tasks on those sites, looking for items that fit particular criteria or needs.
The purpose was to see user behavior on sites they were already familiar with. It
also expanded the types, number and variety of site used in the study. For instance,
a task about coin collecting or knitting might have been too difficult for users
unfamiliar with or uninterested in those activities, but we could include these types
of specific-interest sites when users were already familiar with the topic.
Not all users completed this task.
WWW.NNGROUP.COM
71
9:28
Success
94%
Confidence
6.7
Satisfaction
6.4
Frustration
6.2
On known sites, users shopped as quickly as they did for specific products, taking an
average of 9:28. They were 94% successful on sites they were already familiar with.
Two users ran into unclear error messages, one bought the wrong quantity of items,
one ran into registration problems, and one wouldnt move past an Internet Explorer
security alert.
Users were most satisfied on this task. This is not surprising the relatively quick
task time, high success rates and high subjective scores all make sense. Users told
us these sites were some of their favorites or most frequently visited. They were
familiar with the inventory and design, and many had information saved in user
accounts on the sites making checkout processes more streamlined.
Open-ended Tasks
Some users completed an open-ended task, where we gave them a goal or a need
and let them approach the task however they wanted. We told them a product or
type of product to buy, but let them go to any site to purchase or research it. This
helped us see how users decided where to go when they had a product in mind, as
well as how they evaluated sites they reached via search engines.
Open-Ended Tasks
Task Averages
52 tasks
Task Time
Success
10:13
87%
Confidence
6.1
Satisfaction
5.4
Frustration
5.3
72
INFO@NNGROUP.COM
Open-ended tasks took users an average of 10:13 to complete. This was not very
long, considering users had to decide on both a site on which to complete the
purchase as well as find the desired product. Users were 87% successful on these
tasks, locating the wrong product or in some cases, being unable to locate it. Two
users didnt understand the shipping charge on sites, and others shipped to the
wrong address, had the wrong product quantity in the cart, or saw an unclear error
message.
In this task, 56% of users completed the task on the first or second site visited. In
some cases this was because they knew and trusted a site that sold the product, but
in other cases it was because they wanted to finish the task quickly in a study
setting, rather than take the time they would on their own to truly evaluate site and
product quality. (See more about their decision making processes on page 41 of this
report.)
WWW.NNGROUP.COM
73
74
Problem
Number of
Instances
Percentage
29
20%
Error message
26
18%
23
16%
Wrong product
18
13%
15
10%
Selection
6%
Adding to cart
5%
Registration
4%
Technical problem
2%
1%
1%
1%
International issues
1%
INFO@NNGROUP.COM
WWW.NNGROUP.COM
75
Acknowledgments
The first edition of this report was researched and written by Jakob Nielsen, Rolf
Molich, Carolyn Snyder and Susan Farrell.
We would like to thank all the individuals who participated in each round of user
testing for their time and feedback.
Also, thank you to Celeste Buckhalter for her assistance with the Georgia studies, to
Susan Pernice for her help with recruiting for and coordinating the studies, and to
Luice Hwang for her work coordinating the international studies.
76
INFO@NNGROUP.COM
Acknowledgments
Conducted countless diary studies, focus groups and remote user tests
Our
collective
experience
will
save
you
time
and
money
Making
technology
easier
to
use
is
no
longer
a
nice-to-have.
Useful,
usable
products
make
money.
And
our
expertise
can
help
your
team
achieve
their
design
goals
quicker
and
easier
than
going
it
alone.
Choosing
NN/g
means
you
benefit
directly
from
our:
Finely
tuned
methodology:
We
have
an
arsenal
of
proven
tools
at
our
disposal
and
know
how
and
where
to
apply
each
one,
taking
the
guesswork
out
of
how
to
achieve
the
optimal
design
solution
to
meet
your
business
goals.
Comprehensive
body
of
knowledge:
Weve
taken
the
results
of
our
decades
of
research
and
testing
and
distilled
it
down
into
actionable
guidelines,
best
practices
and
proven
methodologies.
Our
research
library,
containing
over
50
published
reports,
X
books
and
an
email
newsletter
archive
dating
back
to
1995
is
unrivaled.
Practical
approach:
Our
approach
is
100%
practical,
useful
and
actionable.
Whether
you
attend
one
of
our
Usability
Week
events
or
invite
us
to
consult
at
your
place
of
business,
the
training
you
will
receive
can
be
put
into
action
immediately
so
that
you
can
see
the
results.
Our principals are considered pioneers in the fields of user research and interface design.
Our
researchers
and
consultants
tackle
the
most
recent
and
relevant
topics
in
usability,
from
evergreen
challenges
such
as
information
architecture
and
intranet
usability
to
emerging
trends
in
social
media
and
mobile
usability.
Stay
Informed
Jakob
Nielsens
Alertbox
Newsletter
Summaries
of
our
latest
research
and
insights
published
twice
per
month.
To
subscribe:
http://www.nngroup.com/articles/subscribe
TRAINING
Usability
Week
Events
Usability
Week
training
events
are
offered
in
the
U.S.,
Canada,
the
U.K.,
Europe,
Asia
and
Australia.
Each
week-long
event
features
full-day,
immersive
training
courses
where
attendees
learn
practical
skills
directly
from
experienced
practitioners
so
they
can
solve
complex
UI
problems
and
create
better
interface
designs.
In-house
Training
Many
of
our
courses
can
be
taught
at
your
location
and
customized
to
fit
your
unique
offerings,
methods
and
resources.
In-house
training
is
ideal
for:
Large
teams
that
want
to
spread
user
experience
perspective
throughout
the
group
Teams
working
on
large
projects
that
need
to
kick
start
the
creative
process
and
head
in
the
right
direction
In-house
training
information:
www.nngroup.com/consulting
REPORTS
NN/g
has
published
over
60
reports
that
detail
thousands
of
evidence-based
design
guidelines
derived
from
our
independent
research
studies
of
websites,
intranets,
application,
and
mobile
interfaces.
Over
60
reports
addressing
these
topics:
Agile
Applications
Audience
Types
(e.g.,
children,
college
students,
seniors,
people
with
disabilities)
B2B
Websites
Corporate
Websites
Ecommerce
Email
Information
Architecture
Intranets
Mobile
&
Tablet
Non-Profit
Websites
User
Testing
Social
UX
Strategy
Web
Usability
CONSULTING
The
same
experts
who
conduct
our
research
and
teach
Usability
Week
training
courses
are
available
for
custom
consulting
including:
Evaluating your website, application, intranet or mobile interface (average cost $38,000 USD)
On-site training with your team (average cost $9,000 USD per day)