LANGUAGE ASSESSMENT

TSL3123 LECTURE 3

LEARNING OUTCOMES
Define practicality, objectivity, washback
effect, authenticity and interpretability
Describe positive and negative effects or
washback of tests
Demonstrate an understanding of the
features of authentic test items and
discuss its importance
Discuss how interpretability can be
ensured in language testing
TSL3123 Lecture3_yhh

Objectivi
ty

Practical
ity

Washbac
k Effect

Characteristi
cs of a Test

TSL3123 Lecture3_yhh

Authentici
ty

Interpretab
ility

Principles of Language Assessment

Practicality
Objectivity
Reliability
Lecture
16)
Validity
Washback effect
Authenticity
Interpretability

(Week

TSL3123 Lecture3_yhh

Practicality
Not expensive,
Within appropriate time constraint,
Relatively easy to administer,
A scoring/evaluation procedure that
is
specific and time-efficient.

TSL3123 Lecture3_yhh

Example of Practicality Checklist

1. Are administrative details clearly
established before the test?
2. Can students complete the test
reasonably within the set time frame?
3. Is the cost of the test within budget limits?
4. Are all materials and equipment ready?
5. Is the scoring/ evaluation system feasible
in
the teachers time frame?
TSL3123 Lecture3_yhh

Objectivity
The fairness of a test to the testee, bias
test does not portray objectivity and
hence is not reliable.
A test that is objective has high
validity and reliability
A test is objectively scored if everyone
scoring it arrives at the same score.
Tests like essay examinations, though,
will obviously fall short of this ideal.
TSL3123 Lecture3_yhh

How to ensure practicality and

objectivity in test design
Practicality

Objectivity

Proper training of scorers

Cost-effective
proper monitoring of scoring
Time frame i.e. can produce essay
examinations total
not too long to
evaluate, takes a objectivity
the interpretation of essay
few hours to
test results, or of the results
complete
of any test - should include
Appropriate scoringconsideration of statistical
analysis of its objectivity.
procedures.
TSL3123 Lecture3_yhh

Authenticity
The language - as natural as possible.
Items - contextualized rather than
isolated.
Topics - meaningful (relevant,
interesting) for the learner.
Some thematic organization to items is
provided, e.g. a story line or episode.
Tasks represent, or closely approximate,
real-world tasks.
TSL3123 Lecture3_yhh

Example of Authenticity
Contextualized

Decontextualize
d

Going to
1. There are three
1. What _______ this
countries I would like
weekend?
to visit. One is Italy.
a. you are going to do
a. The other is New
b. are you going to do
Zealand
c. your gonna do
and other is
Nepal
b. The others are
New
Zealand and
Nepal
TSL3123 Lecture3_yhh
c. Others are New

Example of Authenticity
Contextualized

Decontextualize
d

2. Im not sure.
_______ anything
special?
a.Are you going to
do
b.You are going to
do
c.Is going to do

2. When I was
twelve
years old, I
used
______every
day.
a. swimming
b. to swimming

TSL3123 Lecture3_yhh

Washback effect
The effect of testing on teaching and
learning (Hughes in Brown, 2004).
Generally refers to the effects tests
have on instruction in terms of how
students prepare for the test (Brown,
2004).

TSL3123 Lecture3_yhh

Washback in testing.
washes back to students useful
diagnoses of strengths and weakness
Challenge to teachers create tests that
serve as learning devices.
Suggest strategies for success
coaching role
Enhances basic principles of language
acquisition: intrinsic motivation,
autonomy, self-confidence etc.
TSL3123 Lecture3_yhh

Washback in testing.

TSL3123 Lecture3_yhh

Interpretability
Test interpretation encompasses
all the ways that meaning is
assigned to the scores.
Interpretability consideration is
especially important when
persons other than the designers
of the test are to interpret the
results.
TSL3123 Lecture3_yhh

 In order to be interpretable, the

measuring instrument must be
supplemented by the following:
detailed instructions for
administering the test,
scoring keys,
evidence about the reliability, and
guides for using the test and
interpreting results.
TSL3123 Lecture3_yhh

References
Brown, H.D. (2004). Language
assessment: Principles and
classroom practices. New York:
Longman
http://www.ux1.eiu.edu/~cfcge/respo
ftestusers.htm
http://blog.reseapro.com/2013/02/test
-of-practicality-of-a-measuring-instr
ument/
TSL3123 Lecture3_yhh

Tutorial #3
Pairwork:
Study some commercially produced
tests and evaluate the authenticity of
these tests/ test items
Discuss the importance of
authenticity in testing.

TSL3123 Lecture3_yhh