SuiteX Mobile UX Study Report

Outlines
Key Takeaways Recommendations Study Overview Research questions Participants Methodology Findings SuiteX Navigation Consistence Experience Mobile Phone Note Management How Miles takes notes on mobile How Miles likes to be reminded on phone Next steps Contributors

Key Takeaways
Navigation for SuiteX: Swipe Participants like swipe navigation significantly more than back button. The preference on Swipe navigation is across Windows Phone (WP) users & NonWP users Participants think drill down & back button navigation is simple but not a best navigation model for touch phone

Consistency: App across Platform > Platform Participants prefer to have consistent SuiteX experience across devices (desktop, mobile phone & tablet) compared to phone platform Participants expect user interface designs customized for devices

Note Management A big call for reminder/alarm Search is not the top 1 need currently for users who dont have notebooks on phone

Recommendations

Swipe for SuiteX hierarchy navigation Design within app navigation for SuiteX & use Windows phone back button as the 2nd option Use tap, scroll, swipe rather than button when possible. These 3 gestures are what users do naturally on touch phone. Commands which can leverage the 3 gestures help improve discoverability compared to buttons on the bottom menu bar on Windows Phone for new users. Design visual cues for SuiteX hierarchy indication to help users know where they come from and where they go Integrate Note reminder with calendar only as an OPTION Design strikethrough (e.g. buy tickets for Sounders) for checked off notes

Study Overview Research Questions

The study goal was to understand how different navigation models (swipe vs. drill down) work for SuiteX mobile design, what are pros & cons for each navigation model and how to design the consistent SuiteX experience across devices
Research Questions include: Navigation: What are user experience for SuiteX swipe & SuiteX drill down navigation Consistency: What are users expectations for SuiteX experience across devices (mobile phone, tablet, and desktop) Note Management: How do users find notes & set up reminders

Study Overview Who are Participants

SuiteX Desktop Users (n=6+3) Windows Phone Users (n=8) SuiteX Mobile Users (n=2+3) Non-SuiteX Users (n=9)

55%
Non-Windows Phone Users (n=12)

Study Overview - Participants

Total 20 participants: 8 WP users & 12 Non-WP users ( 7 Android users, 3 iPhone users, 1 Blackberry user & 1 Pam / Web OS user) Gender: 16 Male, 4 Female Job roles: Sales, Small Business Owner, Marketing Manager, Event planner, students, Home mom, .

Demographic Information Age (years old) Notes Experience (times/week) Mobile Note Experience(times/week) Phone Usage (hours/day)

N 20 19 14 14

Mean 36.4 20.3 12.3 2.5

Range 22-57 1-105 1-38.5 1-5

7

Study Overview Methodology

Semi-Structured Interview:
19 participants were asked to view the SuiteX on a device during the free play exploration phase of the study. The only task participants were asked to do was to check the notes on the Notebook. Later in the study participants were then asked to interact with two prototypes of two new SuiteX navigation designs. With these prototypes participants were tasked with checking notes and viewing the notebook, sections & pages. The order of presentation of WP and two prototypes was balanced. Participants were requested to focus on navigation only rather than visual design or contents. 19 participants were asked to view SuiteX on Device Y during the free play exploration. Then participants were asked to evaluate the navigation similarity between the Oproduct on Device Y vs. product on WP & the two prototypes. Interviews about the consistency experience were followed up after the evaluation At the end of study, 20 participants were interviewed for the product navigation inconsistent with WP assumption. This is not a usability testing. This is an exploratory study to understand product navigation & consistency experience.
Interview for mobile notes management experience

Participants play SuiteX Swipe model & Drill down model, interview for the navigation experience

Participants play App A on Win Phone, interview for consistency

Participants play

SuiteX on Device Y, interview for consistency

Interview for the Swipe vs. WP inconsistency

8

Results- Navigation (1): Summary

Navigation 17 swipe vs. 2 back button 17 participants prefer swipe over back button
Users perception on different navigation models Participants like swipe significantly more than back button (F [1, 17] = 21.4, p < .000) Participants think swipe significantly more efficient than back button (F [1, 18] = 5.7, p = .03) Participants think swipe significantly more clear than back button (F [1, 12] = 7.2, p = .02) Participants think swipe significantly more smooth than back button (F [1, 14] = 28.4, p < .000)

Results Navigation (2): Users Perception

What participants think about the swipe & back button navigation models? Back button: Simple Swipe: Intuitive <video link removed>
Back Button very simple but I dont like it feel jump back & forth by clicking back button take me out of the app sometimes by clicking back button Doesnt work for touch phone though it makes more senses for computer tap & swipe is what people naturally do on touch phone I use back button when I get stuck and cant figure out in the app Swipe: feel stay on the screen to do more able to see whats coming & where I am from more nature/intuitive dont need to learn it
10

Results Navigation (3): Users perception

Participants like swipe significantly more than back button (F [1, 17] = 21.4, p < .000)

Likeness
Like it very much

3 2 1

0 -1 -2
Dont like it at all

-3

Swipe

Back Button

Descriptive Statistics Mean Swipe Back Button 1.9 -0.1 Std. Deviation 1.0 1.3 N 18 18

11

Results Navigation (5): Users Perception

How do users describe a good navigation experience? What are important for a good navigation experience? What are crossed out for navigation experience?

Results Navigation (5): Users Perception

How do users describe a good navigation experience? What are important for a good navigation experience? Efficiency: Access quickly & easily; know where I am; flow well; Natural, Clear, Smooth What are crossed out for navigation experience? Fun: 3 out of 19 participants think its important Pleasant: 4 out of 19 participants think its important not the word which I associate with note)

Importance
Very 7 Important
N efficiency importance

Descriptive Statistics Minimum Maximum 15 5.0 7.0 Mean 6.567 Std. Deviation .6230

5 3
Very Unimportant 1 6.6 6 5.7 5.5

smooth importance
natural-importance clear-importance

14
13 12

4.0
4.0 4

7.0
7.0 7

5.464
6.038 5.67

1.2780
.8771 .985

Efficiency

Natural

Clear

Smooth

13

Results Navigation: Users Perception

Participants think swipe significantly more efficient than back button (F [1, 18] = 5.7, p = .03)

Efficiency
Very Efficient

3 2 1

0 -1 -2
Very Inefficient -3

Swipe

Back Button

Descriptive Statistics Mean Swipe Back Button 0.6 -0.7 Std. Deviation 1.7 1.4 N 19 19

14

Results Navigation: Users Perception

Participants think swipe significantly more clear than back button (F [1, 12] = 7.2, p = .02)

Clear
Clear

3 2 1 0 -1 -2

Confusing

-3

Swipe

Back Button

Descriptive Statistics Mean Swipe Back Button 1.0 -0.2 Std. Deviation 0.7 1.4 N 14 14

15

Results Navigation: Users Perception

Participants think swipe significantly more smooth than back button (F [1, 14] = 28.4, p < .000)
Smooth

3 2 1 0 -1 -2

Smooth

Rough

-3

Swipe

Back Button

Descriptive Statistics Mean Swipe Back Button 1.1 -0.6 Std. Deviation 0.7 1.4 N 14 14

16

Swipe creates inconsistency Not supported

Conflict with WP: 18 Swipe vs. 2 Back button 18 participants still prefer swipe (after understanding how its different from WP): Whats the difference? the difference is not obvious I dont care: it seems dont feel very different It doesnt matter much: I like to stay on screen, within the app Swipe is more natural/intuitive which makes the difference invisible I dont need to learn swipe I dont care the difference because I prefer consistency for application across devices than the phone platform (similar to ON desktop/tablet is more important than it works same as phone or other apps on phone)

17

What is the bar for WP UX

Swipe Back button
I like it
It works
Usability Task completion time Task success rate Learning time Steps / clicks to complete task Can also be subjective Easy Simple Quick
18

Desire Yes, you should buy it

Personality ...

User Experience Desirability Emotion connection Customer loyalty (meeting needs, easy to work with, enjoyment)

Results - Consistency: App across platform > Platform

Structure, Content & Visual Presentation: Participants prefer to have consistent SuiteX experience across devices (desktop, mobile phone & tablet) compared to keep it consistent with the phone platform. They expect to have the consistent data/content, information architecture, flow, user interface layout, icons for key commands across devices for an application so that the learning of an application on different device is minimal. Physical Navigation: Participants expect the physical interactions with the devices should be customized to take advantage of the devices. Touch phone should use tap/gesture rather than button when possible. Button: NOT modern, feel old, not designed for touch phone When & What to break the consistent principle: Participants have the expectation that apps work differently on different devices. They expect less options, customizations, less icons & menus on phone and different physical interactions for difference devices, such as swipe for touch phone & button for desktop

19

Results Notes Management (1)

Search is not TOP 1 need currently for users who dont have notebooks on phone People have limited notes (2- 20, exclude SuiteX users) on their mobile phones and keep it updated timely. People usually take notes on mobile for things they need to do today or this week. They go through their mobile notes to always check it. They use the gothrough as a way to remind themselves. The amount of notes on mobile doesnt reach the critical mass for searching
Integrate Note reminder with Calendar only as an option Notes just are something which they should do but actually dont block time on calendar Users sync their calendar on mobile with outlook and they dont want personal reminders on business calendar. Miles has 3-8 notebooks, 4-5 sections for each notebook and around 40-50 pages on his phone Use mobile phone to take notes/ unfiled notes, then sync it with their ON desktop, put those notes under different sections/pages
20

Follow-up research
Windows Phone Task Analysis Desirability / Emotion: SuiteX vs. Experience Consistency: When to break the consistency & to what extent Android Phone W1 scorecard usability benchmark

21