Vous êtes sur la page 1sur 34

Memo

Date:
To:
From:

Subject:

December 13, 2016


Dr. Elizabeth Sanocki, Senior Lecturer at the
University of Washington, Seattle
Kurt Blancaflor, HCDE Undergraduate
Luis Gonzales, HCDE Undergraduate
Tsuki Kaneko-Hall, HCDE Undergraduate
Neha Nuguru, HCDE Undergraduate
Recommendation Report for TIDAL Usability Study

Attached is the full report for our usability study, Evaluating the Usability of TIDAL: A
Recommendation Report. As of November 22nd, we completed the four tasks associated with
our study which included: identifying TIDALs iconography, navigating to a specific song and
listening to it, creating a playlist with previously unheard holiday music, and finding similar
artists based on a favorite artist.
To perform these tasks, we conducted heuristic evaluations individually and then collectively
as a team. We followed these heuristic evaluations with a preliminary usability study plan after
receiving critique and feedback we produced a final usability study plan. Similarly, we created a
preliminary usability test kit and once we received feedback created a final version of our
usability test kit. At this point we conducted our usability study with eight participants followed
by a preliminary analysis report. After presenting our study to a group of our peers we created
the final recommendation report which can be found enclosed.
Our findings concluded there were three key areas TIDAL should focus on to improve the
usability of their web-based music streaming service. The first being a general confusion of
what the iconography found on TIDALs web-based platform represented. Icon
misidentification from our participants ranged from 38% to 100% depending on the ambiguity of
the given icon. The one exception was the video icon which had a zero percent
misidentification rate from our participants. The second key area identified for improvement
was the My Music section which confused participants as they did not completely understand
what My Music represented, purchased music, favorite music, etc. This section of the service
also had two Playlists sections which further confused participants as they were unsure as to
why two sections had this same label. The third key area of improvement was identified as a
general mismatch between the platforms information architecture/navigation and users
mental model. This was identified as participants looked for information where they expected
to find it but were disappointed to find that information was found elsewhere on the service.
Based on our findings, we recommend TIDAL to introduce more intuitive and consistent icons,
provide greater differentiation of My Music from the rest of the left navigation menu, and
providing the ability for users to find content through multiple click paths and not only one click
path.

Abstract
Evaluating the Usability of TIDAL:
A Recommendation Report
Prepared by:

Kurt Blancaflor, HCDE Undergraduate


Luis Gonzales, HCDE Undergraduate
Tsuki Kaneko-Hall, HCDE Undergraduate
Neha Nuguru, HCDE Undergraduate

On October 5th 2016, Dr. Elizabeth Sanocki, Senior Lecturer at the University of Washington,
Seattle, approved our proposal to evaluate the usability of TIDAL by taking participants through
a series of tasks focused around previously identified usability heuristics. To perform this
research, we created a usability study plan, a usability test kit, conducted participant field
studies, and ultimately presented our findings to a group of our peers. These findings included
unintuitive iconography, unclear My Music section on the left navigation menu, and a
mismatch between participants mental models and TIDALs content and/or navigation.
Specifically, we found icons that yielded an identification error rate of 38% for the Playlist
icon, 38% for the Article icon, 50% for the Artists icon and 100% for the Genre icon. In
terms of the unclear My Music section we found participants were not sure if this section was
reserved for purchased music or favorite music. All of the participants also had a problem with
the two Playlists sections on the left navigation menu and could not identify why there would
be a need to have two or how the two were differentiated. We recommend TIDAL to utilize
more intuitive and consistent iconography throughout its platform to ensure easy
understanding of what each icon represents. Moreover, we recommend TIDAL further
differentiate the subsections of My Music to facilitate easy understanding of its main
purposes. Lastly, we recommend TIDAL to provide multiple click paths to reach important
content such as Similar Artists instead of the current single click path as this makes it difficult
for users to find and explore everything TIDAL has to offer.
Keywords: TIDAL, usability, mental model, iconography, sub-genres, breadcrumbs, music
streaming, navigation,

Table of Contents
List of Illustrations
.......4

Executive Summary
........5

Introduction
.......6

Research Methods
.......7

Results
....1 2
Iconography

......1 2
My Music

.....1 5
Mental Model Mismatch .....1 7
Backwards Navigation ......2
0
Subgenres

.....2 2
Conclusion
.....2
4
References
.....2
5
3

Appendix A: Study Script


..2
5
Appendix B: User Reports
....2
7

List of Illustrations
Figure 1: Featured Panel
..1 2
Figure 2: Illustration of Icons
.....1 3
Figure 3: Display of Genre Icon
............14
Figure 4: Highlight of Duplicate Playlists Sections
.....16
Figure 5: Highlight of Duplicate Albums
....1 9
Figure 6: Navigation Bar
.........20
Figure 7: Christmas Music Search Results
...2
3
4

Executive Summary
On October 5th
2016, we, a group of four University of Washington students, obtained approval
to conduct a usability study of TIDAL, the music streaming service. TIDAL is a subscription
based music streaming service that combines lossless audio, HD music videos, and curated
editorials to provide a unique music streaming service. TIDAL has struggled as a service to
increase and retain its user base, our study looked at various aspects of the service to identify
the greatest issues affecting TIDALs user base. Some of these aspects included the ambiguity,
organization and accuracy of TIDAL through an evaluation of its web-based platform.
To perform this research, we familiarized ourselves with the service and began evaluating how
the service approached navigation, content and music information. Then, we formally
conducted heuristic evaluations to identify the specifics of the services usability problems.
We found one of the biggest usability problems participants faced initially was false
identification of the iconography used throughout the music streaming service. Specifically, the
genre icon had a participant identification error rate of 100%, the artist icon had a 50% error
rate, the playlist icon had a 38% error rate as well as the article icon. The only icon that was
accurately identified was that of the video icon which also seemed to be the only intuitive icon
5

depicting a video camera which certainly helped participants accurately identify it. We also
found a significant mismatch between users mental model and various navigation and content
elements on TIDAL such as the two Playlist sections on the left navigation menu, the Similar
Artists tab being at the top of an artists page vs the bottom where participants expected it to
be.
Based on these findings, we recommend more intuitive and consistent icons be utilized
throughout the music stream service. We also recommend a greater differentiation between
the My Music section and the rest of the left navigation menu. Lastly, we recommend
important content such as Similar Artists be found through various click paths and not strictly
one to provide users a better chance of finding this important content.

Introduction
Product and Feature Overview
TIDAL is a music streaming service that provides High Fidelity sound quality, along with High
Definition music videos and music reviews curated by music journalists. The purpose for this
study was to evaluate the ambiguity, navigation, and organization of the desktop (website)
version of TIDAL. We did this by providing tasks to build a playlist and prompt navigation of
different sections of the site.

User Group Overview


The target user group for Tidal are audiophiles, who want a more personal connection
to their favorite artists. Tidal has multiple target user groups. Outside of pure
audiophiles target user groups include, music journalists, music journalist-followers,
millennials, and music buyers.
In this study, we worked with college-aged people with a familiarity to music streaming
services, because this group was the most accessible for our project.

Key Tasks
We analyzed TIDALs interface by asking users to browse through the web apps main
pages. We developed tasks that took participants through the main features and
functionality of TIDAL. For example, we asked them to identify the icons on TIDALs
home page, we asked them to choose a song from a specific artist, we had participants
create a holiday playlist of songs, and finally we had them look up artists that they liked
and listen to artists that TIDAL suggested for them based on their preferences.

Usability Questions
Our tasks and our study as a whole revolved around three main usability questions. These
questions were:

How effective is TIDAL in curating personalized music experiences to users?


Does content layout make for more efficient search of preferred music?
Do features line up with user expectations of a music streaming service?

Research Methods
Our group previously identified in our heuristic evaluations that there were many problem
areas with TIDAL concerning its interface including extraneous registration screens, ambiguous
icons, information organization, behavioral bugs, etc., and we wanted to test these aspects with
potential users to validate/invalidate our findings. We conducted this study to come up with
design recommendations for improving the way people navigate and discover music on
TIDALs online web platform. We are providing these recommendations to TIDAL stakeholders
in order to help TIDAL become a rising contender in the competitive music streaming market.

Research Questions
1.

Ambiguity: How well can users recognize iconography? Will they correctly interpret the
icons on the Featured section?
2. Organization: Is Tidals content organized in a way that matches users mental model?
Will users be able to effectively navigate to their destination?
3. Accuracy: Will users effectively discover music that appeals to their preferences as part
of their music streaming experience on TIDAL?

Participant Characteristics
7

We looked for participants that were both familiar and unfamiliar with using music streaming
services. Unfamiliar users were defined as those who listen to music streaming services less
than 5 hours/week, while Familiar users were individuals that use a music streaming service
more than 5 hours/week). We recruited 4 participants for each group, leading to 8 participants
total. We also made sure to find users that listened to artists featured on TIDAL in order to test
the validity of TIDALs artist suggestion function.

Study
We used Morae and Morae Observer to record user sessions and to gather data on the amount
of time to complete tasks, number of screens to complete tasks, etc. Screen recording was a
main method of recording data. It was used to gather the efficiency of navigation of our
participants by counting the number of pages it takes for the participant to complete a task.
The recordings were also used to measure the efficiency of tasks by recording the amount of
time it took participants to complete a task and recording the amount of time a the participants
spent on each page. Time was disregarded for tasks that did not measure navigation
efficiency, such as when users are asked to interpret icons or count the number of suggested
artists that they like.

Screening
1.

Participants were recruited based on if they fit the characteristics that we discussed in
the Participant Characteristics section, and we set up a meet time that works for them
and the group.

Welcome
1. Upon arrival, participants were be greeted and eased into the evaluation area.
2. They were be reassured about the nature of the evaluation, more specifically, that it is
the product they will be using that is being tested, rather than them.
3. We explained to them about how the session will play out. Namely, that they will be
given separate note cards with different tasks on them. We then had them complete
these tasks and then talk about their experience with them in a post-session interview.

Tasks
Post-Test Interview

Task Lists
1.

Exploration of Icons: Explore the home page and take in the icons. As you go, identify
the icons you find.
a. Prompted to main Page.
b. Scroll over Features.
c. Notice that all features have icon on the top right.
d. As you scroll, name the icon you see on each feature and what you think the
icon indicates. You do not need to repeat naming and identifying an icon if it
shows up multiple times in the cue. Only once is fine.

2. Your friends are all raving about a Beyonce song that was released last year. They all
insisted that you go and listen to Beyonces Hold Up. You finally give in and decide to
go listen to the song.
a. Navigate to the Tidal website then,
b. Find Hold Up by Beyonce (example song).
c. Play Hold Up by Beyonce (example song).
3. Your friend was playing Christmas songs when you were visiting their place. You didnt
like the Christmas songs being played. Create a playlist of three of your prefered
Christmas songs and play them.
a. Use the site to find your preferred songs
b. Add songs to a playlist. Name this playlist Xmas Faves
c. After all songs are added, play the playlist.
4. You are beginning to become bored of your music, but you are interested in finding
similar songs. You decide to stretch out to find some new music.
a. Begin from the artist page that corresponds to your favorite artist mentioned in
screening.
b. Find Similar artists.
c. Count how many suggestions for similar artists there are, and tell us the number.
d. How many of the artists prompted have you listened to and enjoyed? Tell us the
number.
Study Design - Users carried out the tasks in the same order. The tasks do not necessarily
build upon each other, but participants may have become more familiar with the platform as
they continued to use it. For example, we asked users to identify icons first before they were
exposed to them throughout the site. To avoid similar issues that may come up, we prioritized
basic tasks first.

Background Questions:
1. Ask what music streaming services they have experience with/currently use.
2. If they currently use music streaming services, ask them how many hours they use them
per week.
3. Find out what kind of music they listen to, including genres, artists, songs, etc. Develop
a list of content to verify that it is on TIDAL later.

Post-Test Interview Questions:


1.
2.
3.
4.
5.
6.

Ask them to rate their experience with each task and with TIDAL overall (on a scale of
1-10) in terms of satisfaction.
Ask if there were any tasks or moments where they were confused about what to do or
where to go.
Ask about how it was finding songs and accessing their playlists.
Ask about their thoughts on the icons they identified and saw during their session.
Take them back to some of the pages that they navigated to and ask about their
thought process when going through the pages and carrying out the tasks.
Ask about what they think about the content layout of the main page, sidebar, and
subpages.

Test Environment(s), Equipment, and Related Logistics


For the purposes of this study, we rented HP laptops from the LUTE (Laboratory for Usability
Testing and Evaluation) for users to use TIDAL on since we are analyzing TIDALs desktop
version specifically. We booked booths and study rooms at Odegaard Library to conduct our
study and we used the screen recording software, Morae, to track and record the participants
navigation paths. We also measured efficiency and accuracy by timing users and counting the
number of screens they explored as they completed each task. We also used Morae Observer
from a remote laptop, in addition to our notebooks to take notes throughout the sessions and
for the post-test interviews. These interviews helped us to collect information about user
experiences and their thoughts about TIDALs layout.

Facilitation Approach(es)
We had users test the product individually. We seated users at the PC and gave them their first
task to complete. We then started recording their interaction and timed how long it took them
to complete the task once they were ready to begin. We recorded their interaction time and
observe the route they took for each task. We did this for each task and ended each session by
talking to users about their thoughts on the experience. We asked them about any
10

observations we made during their session and had them share their opinions about certain
parts of TIDALs features and UI. This helped us to obtain qualitative information about the
motives behind their actions and the factors that influenced their thoughts. In combination with
the rest of the data we collected, we gained a better understanding of how TIDALs layout
impacts the user experience.

Data Collected
Through our study, we collected various forms of data including both quantitative and
qualitative data. The quantitative data we collected includes: time on each task, page
click-throughs, number of errors in icon recognition exercise, similar artist suggestion accuracy
percentage, and likert scale ratings concerning the effectiveness of TIDALs UI. In terms of
qualitative data, we obtained demographic information, familiarity with other streaming
services, pain points they experienced during the usability study, what users enjoyed while
using the service and their overall thoughts of using TIDAL. By aggregating all of this data we
were able to get a more complete picture of TIDALs usability.

Data Evaluation
We then evaluated how successfully users, both familiar and unfamiliar with streaming music
applications, found content within the TIDAL desktop application. Symbol ambiguity was
assessed based on each users ability to correctly interpret TIDALs icons. Organization
success was determined by the number of screens users navigated to and the time taken to
complete each task. And finally, TIDALs content association accuracy was evaluated based on
how many similar artist suggestions were in line with user preferences. Success was
determined by the number of screens users navigated to while completing navigation tasks,
the amount of time taken on the each task, and correct recognition of icon functionality.
Information from post-test interviews was used to gather qualitative data from each user. We
then combined our qualitative and quantitative user data to determine how well users were
able to navigate TIDAL, as well to identify certain issues with TIDALs interface.

Reporting
We utilized the structure of the class for most of our reporting which includes: a project
declaration, project proposal, heuristic evaluation, usability study plan, usability test kit,
preliminary analysis, final presentation and final report. Each of these items are intended to
achieve specific usability study goals. The project declaration was intended to give us a
general idea of the problem space we were thinking about working within. The project
proposal was a more in depth look at the problem space and the specifics regarding our
plan/approach in addressing TIDAL as a service. The heuristic evaluation allowed us to define
our users and their goals along with defining the tasks they would attempt. The heuristic
11

evaluation also gave us the opportunity to complete walkthroughs, taking tasks step-by-step
through the users point of view to help us identify any problems based off a set of
predetermined heuristics.
The usability study plan was a detailed plan outlining the specifics of our study, so much so,
that another researcher could use it to execute a study comparable to the study our team will
be doing. The usability test kit includes the complete set of non-product items we will use to
interact with participants during our study. The preliminary analysis includes information
regarding our study once they have been completed along with brief descriptions of the
product tested, participants and preliminary analysis of our findings. The final presentation and
report include a complete synthesis and analysis of our study from beginning to end,
aggregated in a visually compelling and clear format to best depict our findings.

Results
After conducting the studies, we synthesized our data and identified the main issues that
existed across the usability sessions. We combined our notes and observations and coded
them by severity to figure out the most important and actionable problems to address. From
this process, we concluded that participants had issues with specific features on TIDAL.
Namely, participants were unable to identify the meanings of icons in TIDALs Featured Panel,
they had trouble interacting with TIDALs My Music section, the organization of content did
not match the Mental Model of several users, TIDALs navigation menu often went
unidentified and unused, and it was often difficult for participants to find music they liked due
to a lack of subgenres.

Iconography
Iconography is used throughout TIDAL to mark different sections of the main menu for
navigation, and used to mark media on the Featured Page. For the Featured Page, icons are
shown on the right side of each content panel, without any text describing what the icon is
(Figure 1). In order to assess how intuitive these icons were at categorizing TIDALs content, we
had users manually scroll through the features panel, and verbally identify what they thought
each icon meant and why.

12

Figure 1. Featured Panel in TIDAL including icons displayed on the top right of every panel.

Issue Statement: Users had trouble identifying what icons in the Featured Panel
stood for, and sometimes categorized multiple icons as the same thing.

Iconography Observed Behavior


When trying to identify icons, there was a clear discrepancy between what the user expected
the icon to stand for and what it actually stood for. The icon that was misidentified by all 8
participants was the Vinyl disks Icon that characterized Genre Playlists. Participants
assessment of this icon ranged from songs, albums, vinyls, and CDs. The second frequently
misidentified icon, with 4 out of 8 participants identifying it incorrectly, was the Artists icon
(Figure 2). The mic visualization of this icon made participants suggest that it either stood for
karaoke or songs.

Figure 2. Illustration of Icons on Featured Panel, with their actual meanings above and error rates and subject
identification below

The other two icons, Playlist and Article, had 3 out of 8 participants incorrectly identify the icon
meaning. Because both of these Icons had a similar visual of a document, people often
identified these icons similarly. 2 participants thought that the Playlist icon could be an article,
and visa versa. The music note on the Playlist icon seemed to cause confusion as to what
exactly it contributed, give that TIDAL is a music streaming site.
The icon that all eight participants correctly identified was the Music Video icon. The music
video icon was noted by a video camera (shown above). All participants tried to use context
clues by reading the information displayed on each panel before identifying the icon meaning.

13

Iconography Cause and Theory


The theory as to why the iconography was hard to read was due to a lack of intuitive
symbolism and presence of redundant iconography meanings. For example, on featured, two
vinyl disks could really symbolize anything related to music, since there are no tangible vinyls
that TIDAL itself sells or incorporates into its service.
The mic icon is also vague, especially when signifying Artists, which is traditionally noted as a
person icon to represent a human figure. People tried to identify the mic icon directly to what it
is traditionally associated with, including karaoke or songs. By using vague symbolism for
iconography, users were confused in finding the actual meaning of the icon. The only one that
reduced any ambiguity was the Video Camera icon for Videos, since that was a familiar icon
that was intuitive based on a direct representation.
There was also a mismatch on what the content labeled with the icon stood for. ALthough the
Genre icon should have been used for only Genres, there were four participants who thought
that it meant albums, due to the fact that it was displayed alongside Panels that displayed an
album (Figure 3).

Figure 3. Display of Genre icon alongside an actual Album Title on Featured Section.

With this kind of inconsistency, participants were confused about the Genre icons actual utility,
especially since the visual panel informed them of an Album and not any Genre related
material.

14

Since the Playlist and Article icons looked similar, this was also cause for redundant
identification responses. Both icons had a document format visual to distinguish it from other
icons, and because of this both gave way to user error.

Iconography Recommendations
The main recommendation would be to redesign icons so that the meanings are more intuitive
with user expectation. We can do this by looking at other music streaming such as Spotify,
iTunes, and Pandora, and seeing how aspects like Genre and Artists and commonly portrayed.
Icons should also only be used with content it is associated with. So Genre icons shouldnt be
used to categorize albums, only genre-related information. Also finding a way to distinguish
Playlist from Article visually would also minimize redundant identification. If all of these are
incorporated, it would limit misinterpretation of icons and the content that is identified through
these icons.

My Music
The My Music section on TIDAL holds music the user favorites. The My Music section has
five subsections: playlists, albums, tracks, videos, and artists. Each of these subsections begin
empty and filled by the user adding content to them by favoriting content in a number of ways.
The My Music is located at the bottom of the left navigation area of the home page of TIDAL.
Our study revealed misunderstandings with the My Music section that lead to user errors in
navigation.

Issue Statement: 6 out of 8 participants found the My Music section to be


confusing.

My Music Observed Behavior


The misunderstanding of the My Music section was one of the most severe issues we found
in our study. Six of the eight participants found the My Music section to be confusing in either
task 2, task 3 or task 4. We found visual hierarchy used to designate the My Music section to
be too subtle for participants to distinguish the My Music section apart from the rest of the
navigation located above it (See Figure 3). During task 3 participants were confused by there
being two playlists in the left navigation bar. Two out of the eight participants clicked on the
wrong playlists button to find the playlist they previously created. Three participants hovered
over the wrong playlist button for a few moments before deciding to click on the correct playlist
button in the My Music section. While thinking aloud, participant 2 described there being two
playlists listed in the left navigation bar as, confusing While hovering over the wrong
playlist button participant 4 questioned, why is there two playlists? Thats weird."

15

Figure 4. Highlight of duplicate Playlists on TIDALs toolbar.

Our study also identified the information that was stored in the My Music section to be
ambiguous to our participants. The ambiguousness of what was in the My Music section was
explored in task 3 and our post study interviews. Participants were confused by the option to
click the star located on the album art and the right side of a track. Clicking the star brings up
an alert box that simply says the item starred has been added to My Music. But for our
participants it was unclear where in My Music the starred selection was added. There are five
option as to where the item could be located; six if you include the play queue.

My Music Cause and Theory


The My Music sections visual hierarchy could be enhanced to designate the My Music
section more clearly. Further enhancements to the My Music section would help users better
understand what and where things are being added to the My Music section.
The visual hierarchy of the My Music section did not stop participants from completing their
tasks, but it did slow the participants down. Our study found the labeling and location of the
My Music section confusing; trying to locate their previously created playlist was not as
intuitive as the participants thought it would be.
The music and artists being put into the My Music section was also not as intuitive as our
participants found it should be. The lack of direct feedback, telling the user where starred
information was being put led to our users being confused about what information each button
in the My Music section would hold.
16

My Music Recommendations
For the My Music section as a whole, the location was not the biggest detractor and main
cause of confusion. The location fits within the design scheme of the website well. Moving the
My Music section would immediately differentiate it from the rest of the navigation bar
located on the left of the page, but such a move would ultimately have the main navigation
located in two different areas of the page. Thus, moving the My Music section is not
recommended. We recommend three options: renaming the My Music section, indenting the
My Music section, and making the My Music section collapsible. The first two options are
the most important. Renaming each of the buttons in the My Music section to include the
word My before each categorical name will address the confusion with there being two
playlists in the left navigation area. This would differentiate the two playlists, one being the
playlists of TIDAL and the other being the playlists belonging to the user. Secondly, indenting
all of the text for the buttons in the My Music section would help the user to intuitively
differentiate the My Music section at a glance. This will help users more quickly understand
what is on the page without having to read the text in the buttons. The third option, was to
make the My Music section collapsible. Two out of the eight participants mentioned they
would like this capability. Making the My Music collapsible is not an immediate need to help
distinguish the My Music section of the navigation bar, but it can help users navigated the site
better by not overloading the user with extra information. Therefore, a collapsible My Music
section is a secondary recommendation to renaming the buttons to include the word My
before each category and indenting the text of each button in the My Music section.
In connection to renaming the My Music buttons mentioned previously, the alert boxes that
pop up when music has been starred can be more descriptive to tell users where exactly
information can be located will help to eliminate confusion with what is being held in each of
the My Music categories. We recommend the alert boxes say directly where information is
being stored. Instead the alert boxes simply saying, Added to My Music, the alert should say,
Added to My Tracks or Added to My Artists, depending on which categorical button the
information will be stored. The direct wording of the alert box will tell the users where their
music is going and help build a strong mental model of the website.

Mental Model Mismatch


Mental Models are preconceived ideas a person has that are applied to how things work. The
mental model of a person tells them how something should work. A mental model mismatch is
when a person expects something to work one way, but in fact that something works in a
different way. For example, if I expect to go to a grocery store and buy a gallon of milk. My
mental model tells me what I should expect next; go to the register and pay. A mental model
mismatch in this situation would be if I was asked to pay on entering the store (not likely).
Confusion and frustration are likely to stem from this situation. The Nielsen Norman Group
describe mental models as one of the most important concepts in human-computer
17

interaction. And they also identify many of the usability problems they see are from
mixed-up models. We are using mismatch to describe the mixed-up models of the Nielsen
Norman Group.

Issue Statement: Participants expected to find related artist information near the
bottom of the page.

Mental Model Mismatch Observed Behavior


Our study elicited an interesting behavior when the participants were looking for similar artists
in task 4. When users searched for their favorite artists and wanted to find similar artists, the
participants would immediately scroll down to the bottom of the page to order to find similar
artists. This behavior was interesting because it shows the participants were expecting to find
similar artists and additional artist information at the bottom of the page; the mental model of
the participants did not match that of the actual website information. After searching for an
artist and navigating to their page, there was a navigation tab located just above the center of
the page labeled as Similar Artists. Even with that tab located directly in front of the
participant, they would still scroll to the bottom of the page after immediately navigating there.
Nearly all of the participants displayed this behavior, either when searching for similar artist or
when they were looking for more information on the current artist they were listening to. It took
one of the participants nearly five minutes to find similar artists because the Similar Artists
area did not match their mental model of where such information should be found. Participant 3
described this behavior while they were looking for similar artists, saying, I was looking
down I expected it to be there. From the users that exhibited this behavior there was a mix
of novice music streamers and expert music streamer; of the expert music streamers there was
a mix of different platforms (Spotify, SoundCloud, Pandora) they currently use.
Another mismatch in our participants mental model of information and the actual model
displayed on the page was the display of search results. In some cases, there were duplicated
information and in other cases and the hierarchy of the results did not conform to the actual
search. In the first case, searching for a song or album, our participants did not expect to find
two of the same album listed in the Album area. Sometimes there was a small E near an
album to designate explicit content. Other times there was nothing to distinguish between the
two albums (See Figure 4). But the small E did not help the participants know the difference
between the two albums. The mismatch in the participant's mental model and the actual search
results caused the participant to guess which album the wanted. The participants did not
expect there to be two options for the same album. The other case of the search results not
matching the user expectations was, when a participant would search and artist name and an
album name. In this situation, the search results were displayed with the same hierarchy each
time; artists, albums, videos, playlists. The participants were expecting to see the artists track
to be at the top of the list. After seeing the results the participants would do a second search

18

refining their search terms. This did not stop users from completing their tasks but it did add
unnecessary steps for them.

Figure 5. Highlight of duplicate albums on artist page.

Mental Model Mismatch Cause and Theory


From our heuristic evaluation we found there to be only one way to navigate to a similar artist
area, which is from the tab located near the center of the screen. Our participants were not
stopped from completing their task but their preconceived ideas of where things s hould be,
slowed them down in completing their task. The participants mental model compared to what
was readily displayed on the page was a mismatch that made nearly all of the participants
scroll to the bottom of the page in search of similar artists, related tracks and single tracks.
Currently, located at the bottom of the page has an area for songs the artist appears on. In post
interview questions one participants said, I was expecting a list of tracks at the bottom. It is
clear that our participants had certain expectations on what was to be found on an artists
page.
The less severe issue connected to the mismatch in the mental model of our participants was
the display of search results. Participants did not understand why there was two of the same
album listed in most cases. When questioned about why they chose one result over another
one participant 5 said, because it was first. The participants in this situation were merely
19

guessed as to which option was the one they wanted. In the secondary situation, search results
were not tailored to match a specific search. Instead, the results followed a rigid hierarchy.
Matching the mental model of users can eliminate the thinking currently needed to sift through
search results.

Mental Model Mismatch Recommendations


The Similar Artists tab is located centrally for users to find and explore nicely, but our study
found users expect similar artist to be located at the bottom of the page. Our design
recommendation is to add a similar artists area at the bottom of the artist pages to match the
mental model of the users. Adding a Similar Artists area, the bottom of the page would also
add a second way of navigating to the similar artists. Using two ways to navigate to the user
lower frustration for new TIDAL users and bend their current mental model to fit the current
TIDAL desktop interaction as they become more proficient. In addition to adding a Similar
Artists area at the bottom of the page, lists of related tracks and single tracks by the artist
should be added to the bottom of the page as well. These additions to the bottom of the page
will match some of what is now convention in not only music streaming but also on news sites;
related content found in a list at the bottom or on the side of the current topic.
The second design recommendation to help match the participants mental model of
information and the model of information on TIDAL is to tailor search results to what users
would expect. Our participants were not expecting to find duplicated albums or the results to
always be displayed in the same way. Our recommendation is to make the search results more
dynamic and match what is being searched. Adding separated areas in the search results for
explicit albums and radio versions of albums would remove the guessing out of choosing which
result is the right choice. The explicit albums can be displayed higher or lower based on
previous searches and/or the age information of the user. Overall, separating duplicate albums
into categories would better fit would the users are expecting. A second recommendation for
displaying search results, is to display search results that are more closely connected to what is
being searched higher. For a search of an artist name and an album name the results returned
should show albums first. Currently, the search results will have the same order; artists, albums,
videos, playlists. Making the results better match what is being searched will help users find
what they are looking for more quickly, reducing the need for subsequent searches.

Backwards Navigation

20

FIgure 6. Example of TIDALs navigation bar.


Users were often confused about how to go back to previous pages that they visited. TIDAL
offers a text-only navigation bar that shows the page that the user is currently on, in addition to
breadcrumbs of the previous pages that the user visited. For example, in Figure 5 TIDALs
navigation bar is highlighted and it shows that the user is currently in the Hip Hop/Rap page.
Previously the user was on the Genres page, and if they wanted to go back to the Genres
page they could simply click on Genres in the navigation bar.

Issue Statement: Users could not figure out how to utilize TIDALs navigational
breadcrumbs to go to previous pages.

Backwards Navigation Observed Behavior


The participants of this study often ran into instances in which they wanted to go back to pages
that they previously visited, but they did so through several different means. Some users
retraced their steps until they got to their desired page, and some hesitantly used the
browsers back button and were unsure about where the browsers button would take them. In
particular, 4 of the participants mentioned that they were looking for if TIDAL provided some
way to visit previous page. While some of the participants noticed TIDALs navigation bar none
were able to successfully use it. The extra navigation that some users went through slowed
them down during their tasks. Some of the participants even said that they were looking for
some sort of back button in TIDALs website, which may explain why none of them committed
to using the text-only navigation menu.

Backwards Navigation Cause and Theory


TIDALs navigation menu, while aesthetically consistent with the rest of the website, may have
blended in too much with the rest of the text on the screen. It was not differentiated from the
rest of the content on the web page and users only knew they could interact with it if they
hovered their cursor over a section in the menu that leads to a previous page. Additionally,
while providing a text-only history of pages that the user navigated to is similar to how
21

computers display folder-traversing history, it may not be natural or expected for a music
streaming service. Users did look in the top-left corner for some way to go back to a previous
page, so the placement of the menu is intuitive, but the way the menu itself is presented is not.

Backwards Navigation Recommendations


Based on the experiences of the participants, we recommend that TIDAL add more to the
navigation menu to make it easier to identify as an interaction feature. To accomplish this, they
could differentiate the text of the navigation menu to make it stand out, and highlight the text
for the page that the user is currently on to help users understand the difference between the
sections. Making this highlight color light blue to match the rest of TIDALs accents could set
the navigation menu apart from the rest of the standard white text on all of TIDALs pages, and
providing an underline underneath each section before users even hover over them could
provide more of an indication that they are clickable.
Additionally, while we were working with the web version of TIDAL, an additional back button
on the top-left corner accompanying TIDALs navigation menu could clear navigation-related
confusion for users. This feature exists with several web-based and mobile apps, and if TIDAL
were to utilize a similar mechanic users may intuitively pick up on it. While it is true that the
browsers button did take participants back to the page that they had previously visited, the
participants that did use this back button were worried that using the browsers feature would
take them to an unexpected page since it is not a part of TIDAL itself. If they were provided a
back button feature that is native to TIDAL itself they may be more confident in its behavior.

Subgenres
A genre is a category used to group similar media based on certain characteristics. In the case
of TIDAL, music is categorized by the normal categories like, Jazz, Hip Hop/Rap, R&B/Soul,
Classical, Rock, Metal, etc. A subgenre is a subcategory of the first categorization of media.
Currently, TIDAL does not support subgenres. Subgenres can help users parse through larger
categories in order to find specific content.

Issue Statement: Lack of subgenres prevented participants from finding specific


music.

Subgenres Observed Behavior


In task 2 of our study, participants were asked to make of holiday music. On this task, half of
our participants navigated to the genres section of the left navigation bar to find holiday music.
Participant 1 described the results that were displayed as, a little overwhelming. Participant 1
was overwhelmed by a screen full of holiday albums, like that seen in Figure 7. Participant 3 ran
into the same issue and exhibited the same behavior as their three counterparts; with an
aimless up and down scroll. Participant 5 chose the first album listed. When questioned about
22

why they chose that particular album the participant, much like before, responded by saying
that it was first one listed. Participants had no way to break down this large holiday music
category.

Figure 7. Search results for Christmas music.

Subgenres Cause and Theory


Participants were shown more than a full page of albums when searching for holiday music
with no way to parse through them except by the artist name or by clicking on the album and
sampling the music from the album. The overload of albums on the page without any way to
separate the different types of holiday music caused our participants to scroll up and down
without a goal or aim. It was clear the search was too broad and caused our participants to
rethink their search. Two of the four participants that displayed this aimless scroll tried to refine
their search by typing Christmas into the search bar; the subsequent search elicited even
more results than before. The participants that refined their searches displayed the aimless
scroll, because their search did not narrow their search. Participant 2 remarked after task 2 that
they did not like the lack of control in the search. Participant 1 echoed the same sentiment
saying they wanted the results to be sorted into sub-genres. The lack of subgenres in TIDAL
affected our participants ability to find the particular music they were looking for, negatively.
The albums shown after searching for holiday music can be broken down into sub-genres like
Holiday Rock, Holiday Soul, etc.

Subgenres Recommendations
The main recommendation for TIDAL is to add sub-genres to help users find the type of music
they are looking for. The addition of sub-genres in general album search results can minimize
the subsequent searching for users, which would also create better flow through the site.
Participant 1 even mentioned after task 4 that they would have like to see subgenres of listed
tracks in order to decide for themselves if the music was similar to their favorite artist. Although
23

adding subgenres does not give users direct control over the search results being displayed, it
does give the users control over the content they explore. The simple addition of sub-genres
will help TIDAL users feel empowered when navigating the site.

Conclusion
From our studies, we were able to determine key usability findings related to TIDALs UI and
specifically its organization, accuracy, and ambiguity issues. Our key findings involved icon
ambiguity, redundancy with TIDALs My Music section, the organization of content was
inconsistent with users Mental Model. Additional findings included that TIDALs navigation
menu often went unidentified and unused, and there was difficulty for participants to find music
they liked due to a lack of subgenres.
For the iconography, it was recommended that TIDAL look at existing music streaming services
to find more intuitive icons for labeling their content, and also find a way to distinguish
redundant looking icons. Distinguishing the My Music menu from the main menu through
highlighting or collapsable capabilities could help users distinguish which menu has their
content, and which one contains TIDALs inventory. Additionally, Adding My to all of the
subcomponents of the My Music menu could also help visually indicate a difference to users. In
order to be consistent with users mental models, Similar Artists should also be located in the
bottom of the page so it is in line with user expectations. Also search results should aim to be
tailored to specific user preferences and search frequencies. Other key recommendations
include differentiating the navigation menu from the rest of TIDALs content on their website
and also incorporating various click paths for navigation, as well as including sub-genres to
help user easily navigate a plethora of music genres and suggestions.
By incorporating our design recommendations to address their organization, accuracy, and
ambiguity issues, TIDAL can improve the user experience of their service and allow for a more
streamlined UI. With these improvements, TIDAL can be a standout competitor in the music
streaming market, and potentially attract a wide variety of users as well.

24

References
Nielsen, J. (2010, October 18). Mental Models and User Experience Design. Retrieved December
13, 2016, from https://www.nngroup.com/articles/mental-models/

Appendix A - Study Script


Before introducing participants to the study

Open Google Chrome on the test computer.


Clear recent browsing history and cache from the computers memory.
SIgn into TIDAL using the test account and navigate to the home (Whats New) page.
Clear any existing playlists and favorites from the test profile.
Welcome participants, introduce team members on location, offer refreshments.

Start Time: ____________

SCRIPT
Thanks again for agreeing to participate in our study. Ill be guiding you through the session
today along with __________, who will also be taking notes as we go along. Ill be reading off
of this opening script to ensure that every participant is introduced to the procedure in the
same way.
The purpose of this study is to see what people think about TIDAL, an online music streaming
service that you may or not be familiar with. One important thing to understand with is that we
are not testing you and your ability to go through the tasks, were just studying TIDAL itself. So
you shouldnt feel pressured as you use the site because theres no wrong way to do it.
None of us had any part in designing the product so we wont be offended if you find it difficult
to use. We are students trying to analyze TIDALs design and find ways to improve it so we
encourage you to share your honest thoughts.

25

If you have any questions during the study feel free to ask us. We may not be able to help
immediately during the study, since were interested to see how people use TIDAL without
guidance, but we can try to answer them in-between tasks or after the session. Also, if you
need to take a break at any time during the study just let us know.
In case youve noticed we do have a microphone on and we will be recording what you say
during the sessions and in an interview afterwards. We will also be recording your screen with
your permission. If you are ok with this, we have a consent form for you to sign. The data we
collect will only be viewed by the people working on this project for reporting purposes. There
are four people on the team including me and ___________, and the other two will be
watching the session from another screen. Before I explain how the session will work, do you
have any questions?

Give them the consent form.


Once the consent form is signed, start the webcam and microphone.
Get Morae set-up to record the screen.
Get phone timer ready.

This is how we will go through the session:

Well give you a notecard relating to a single task. These cards will have scenarios and
instructions on them for you to complete.
You are allowed to read the information on the notecard before you start, and let us
know when you are ready to begin the task.
Let us know when youve completed each task so that we can give you another
notecard with another task to complete.
After youve completed all of the tasks we will then have an interview about your
experience throughout the session.

As you perform each task we encourage you to describe your thought process aloud. This
practice, known as think aloud, will help us to learn a lot more about your experience than
your actions can. Are you comfortable with doing this?
To practice this, wed like you to go through a quick thought exercise for us. Are you ready?
Ask them to count how many windows are in their home, and to take us through their
mental process.

Thank you. Hopefully that helped you to warm up. If you forget to think aloud during the
exercise, we may remind you every now and then.
Do you have any questions before we get started?

26

Appendix B - User Reports

27

28

29

30

31

32

****NOTE: Participant 4 did not fill a post-test ranking sheet.

33

Vous aimerez peut-être aussi