Understanding Yes/No Questions in French: A Usability Test

Last updated June 22, 2016 by Carol McKay

Link to RLO : http://publish.myudutu.com/published/launcheval/65840/Course136069/Launch.html

Goals/Objectives
*To
*To
*To
*To

assess the ease of use of the RLO

identify areas in need of improvement for better user experience
determine if information is clear and accessible
gauge user acceptance of this method of learning content

Users
*Novice language learners [vocabulary of ~100 words/ level A1 of CECC], or higher
*Public school students ages 13-18
*Users above Novice level (A1) may use as a resource or review

Scenario
*Initial users will have less than six months experience learning French.
*Users will not have any experience using CBT and self-paced learning within educational context.
*Users may be assigned this CBT as initial instruction outside of the classroom, with in-class time
used for extension or strengthening of learning.
*Users may continue to use the RLO as a personal learning resource.
Tasks
*Locate and open the RLO from a web browser
*Complete the training, noting the difficulties
*Assess the learning experience: the visual experience, the auditory experience, the navigation
*Make recommendations

Please perform the following:

Task 1: Access and open RLO from a web browser. Note any difficulties.
Task 2: Complete training: view videos, complete listening exercises, record yourself. Note nonfunctioning or difficult aspects of the training.

Task 3: Rate your experience (thoughts as you complete the training, feelings associated with the
exercises and overall experience) and make recommendations

Post-Task Survey and Short-Answer Questionnaire:

Upon completing the training, please complete the

survey and questionnaire about your experience.

Survey: Select the response that most appropriately reflects your experience with this Reusable Learning Object.
Completely
disagree
It was easy to locate and open the
RLO
All links worked well and led where I
expected
The illustrations and text work well
together to support the learning
The information was consistent and
easy to understand throughout
I wish there were more examples
and/or practice exercises
I would need to learn a lot more
French before getting started with this
RLO
I would need additional support to
complete this training
Tasks can be performed in a
straightforward manner

Strongly
disagree

Disagr
ee

Neutr
al

Agre
e

Strongly
agree

Completely
agree

The amount of time to complete this

training is reasonable
I found that learning a language this
way was unnecessarily difficult or
ineffective
If relevant, I would recommend this
RLO to other language learners

Post-Task Short Answer Questionnaire: Please respond to the following questions after completing the
computer-based training, Understanding Yes/No Questions in French: Part 1: Intonation.
1. How would you describe this product to a friend?

2. What made the strongest impression on you?

3. How likely and how often would you see yourself using CBT like this?

4. What was frustrating or unsatisfactory about this RLO ?

5. Name one thing that you wish were included in the RLO .

6. Do you feel that there should be audio narration throughout the entire RLO ?

7. Did all audio and videos function properly?

8. Comment on the overall design of the training module. Were any aspects difficult to
navigate, e.g. the Maurice scenario?

9. Please give your thoughts about the images. Do they support the message of the screen
text. Do they all load properly?

10. Do you think that adding a How to use this training module at the beginning would
benefit the users?
11. Does this RLO need a glossary? If so, what would you suggest be included?

12. How did the timing of the activities overall feel? Do any activities stand out as being too
long or too brief?
13. Comment on the number of clicks to complete the RLO: did you find it to be too many
(burdensome)?

14. If additional narration in English were added to the introductory and review screens, would
it be an advantage or a disadvantage to have the same voice as for the French audio portions?

15. Please give your thoughts on the scenario portion of the RLO (Maurice tlphone). Was it
engaging? Was it too long? Not long enough? Supportive of the learning objectives?
Additional Notes: