Heuristic Evaluation of EdX Discussion Page

By April Dreeke

Introduction
A heuristic evaluation can be an efficient way to identify usability errors in a system. This
evaluation is based on 10 heuristics, or broad guidelines, created by Jakob Nielsen. I reviewed the
discussion page on the EdX website by making several posts, utilizing all available options, looking for
help documentation and clicking on links to evaluate the action response. Below are the top five
violations of Nielsens heuristics. Severity is measured on a scale from 0 4, from Nielsens Heuristic
Evaluation chapter, Table 2.3 (1994):

0. I dont agree that this is a usability problem at all

1. Cosmetic problem only need not be fixed unless extra time is available on project
2. Minor usability problem fixing this should be given low priority
3. Major usability problem important to fix, so should be given high priority
4. Usability catastrophe imperative to fix this before product can be released

Finally, solutions are given in the form of recommendations. This is only the key findings page of a
report.

Key Findings
Finding 1: "How to create useful text alternatives" link results in a loss of a users post
Severity: 3/4
Heuristic Violated: User control and freedom; Match system and real world

When including a photo, users are required to include a textual description of the photo. There is a short
explanation as to why and then there is a link called, "How to create useful text alternatives." The link
takes the user to a technical description, which opens in the same screen. To go back to the post, the
user must hit the back button in the browser. It goes back to a blank post page and all of the users post
content is gone. This violates Nielsens heuristic, User Control and Freedom, which states that users
should be able to recover from their mistakes. People often use a trial and error approach and this
does not allow them to try the link and return to their work.

The language in the document is also very technical. Nielsen recommends that language and concepts
be familiar to the user rather than system-oriented terms (Nielsen, 1995).

April Dreeke
 Fig: Insert image screenshot from EdX.

Recommendation: The link should open a separate page and the post should automatically save
periodically. The page should be updated with real world language and step-by-step instructions.

Fig: Example of an automatically saved post from OKCupid. (Yes, I use OKCupid!)

Finding 2: Links in the body of the message will open in the same page and erase the post
Severity: 3/4
Heuristic Violated: User control and freedom, Error prevention

Users can include links in their discussion posts. When checking a link in the body of the post, the new
webpage opens in the same page. If the user hits back on the browser, it returns to the home post page
and does not return to the user's post. All of the users work is lost. This error is similar is to finding
number one: users should be able to recover. In addition, heuristic number nine states, Either eliminate
error-prone conditions or check for them and present users with a confirmation option before they
commit to the action (Nielsen, 1995).

April Dreeke
Recommendation: Include an error message stating that the action will take the user to a new page and
the post will be lost. Give them the option to stay or proceed.

Finding 3: Icon for inserting code is not easily recognizable

Severity: 1/4
Heuristic Violated: Consistency and Standards

On the discussion post page in the formatting bar, the code icon is not easily recognizable, at least not to
a novice user. The icon does not fit with standards used by other systems; it does not utilize users
memory schemas.

Recommendation: Change the icon for the code to a variation of the more recognizable icon in the
image below.

Fig: Common code icon

Finding 4: No confirmation that a post was made, ambiguous follow-up page

Severity: 2/4
Heuristic Violated: Visibility of system status

After posting, there is no immediate feedback that the post was made. Theres a short pause and it goes
to a screen with the original post and an empty box underneath it. There is a moment of confusion to
determine whether or not the action was successful. The user must scroll up to see the original post.
The message states discussion posted less than a minute ago by the author, which does indicate it was
posted, but it is not immediately clear. Nielsen indicates the necessity to provide users feedback within
reasonable time. Users lose attention within one second.

April Dreeke
 Fig: Test post shows no clear confirmation

Recommendation: Create a popup message: Post successful. The user can click out of the
confirmation popup. The new page should also jump to the top of the page, where the message is.

Fig: Example from iOS App Store

Finding 5: List items are not continuous and the list icon is required to be hit with each item
Severity: 2/4
Heuristic: Flexibility and efficiency; Consistency and standards

Numbered and bulleted items do not allow the user to continuously create a list by hitting return. The
user must keep hitting the icon for each item. Based on Nielsens heuristics, this is not efficient. Many
users are also used to using enter in other systems.

April Dreeke
Recommendation: Allow users to select enter at the end of each item to create a new list item. At the
end of the list, the user can select enter twice to get back to a paragraph format.

April Dreeke