Assessing Speaking

It is simply the ability to parrot back a word or phrase or a sentence.

It is the production of short stretches of oral language. Examples include directed response tasks, reading aloud, sentence and dialogue completion, limited picture-cued tasks.

The tasks include interaction and test comprehension but at the limited level of short conversations, standard greetings, small talk, requests, and comments.

The length and complexity of the interaction are more in interactive tasks than in responsive ones. The task sometimes includes multiple exchanges and/or multiple participants.

The tasks include speeches, oral presentations, and story-telling. Oral interaction from listeners is either highly limited or ruled out altogether.

 What

tasks to assess imitative speaking?

Typical listen and repeat.

What

kinds of prompts would you use? Examples: TestTest-takers hear:

beat/bit bat/vat I bought a boat yesterday. The glow of the candle is growing.

Test-takers

repeat the stimulus.

 How

would you score these tasks? Example scoring scale:

2 1 0

acceptable pronunciation. comprehensible, partially correct. silence, seriously incorrect.

 Typical:

Directed Response Tasks Examples: Test-takers are directed to respond:

Tell me he went home. Tell me what do you like. Remind him what time it is.

 Reading

a scripted dialogue. Reading sentences containing minimal pairs.

Examples: The man beat his dog. The man bit his dog.

Reading

information from a table or chart.

 Two

of the major elements of speech to assess. Typical:

Pronunciation Fluency

 Pronunciation:

what scale would you design

for scoring? Example:

0.00.4 frequent errors and unintelligible. 0.51.4 occasionally unintelligible. 1.52.4 some errors but intelligible. 2.53.0 occasional errors but always intelligible.

 Fluency:

what scale would you design for

scoring? Example:
0.0 0.4 slow, hesitant, and unintelligible. 0.5 1.4 non-native pauses and flow that interferes with intelligibility. 1.5- 2.4 non-native pauses but the flow is intelligible. 2.5- 3.0 smooth and effortless.

What are the advantages? Comparisons between students are quite simple. Tests are easy to prepare and to administer. Predictable output, practicality, and reliability in scoring.

 It

is not really authentic.

Exceptions

A parent reading to a child, sharing a story (news) with someone giving a scripted oral presentation.

It

is not communicative in real contexts.

How do these relate to the 5 criteria? Clear administrative PRACTICAL procedures Focusing the questions and VALID probes on the purpose of the assessment Biased for best AUTHENTIC & WASHBACK performance Creating a consistent, RELIABLE workable scoring system

Questions eliciting open-ended responses. 1. What do you think about the weather today? 2. Personal questions:
a. b. c.

Have you ever been to the Perlis before? What other states have you visited? Why did you go there? What did you like best about it?

Scoring: based on (1) Comprehensibility (2) Specified grammatical/discourse categories.

Role play It is a popular pedagogical activity in communicative language-teaching classes. The teacher must determine the assessment objectives of the role play, then devise a scoring technique that pinpoints those objectives. Examples on how the scoring can be made: -vocabulary -communicative competence

 Extensive

speaking tasks are frequently variations on monologues, usually with minimal verbal interaction. Oral Presentations:

Example: presenting a report.

Rules for effective assessment: (a) specify the criterion, (b) set appropriate tasks, Elicit optimal output, and (d) establish practical, reliable scoring procedures. Oral presentation checklist
Content: The purpose

3 excellent 2 good 1 fair 0 poor

or objective of the presentation was accomplished. The introduction was lively and got my attention. The main idea or point was clearly stated toward the beginning. The supporting points were clearly expressed and supported well by facts and argument. The conclusion restated the main idea or purpose.

 Delivery The speaker

well. The speaker maintained eye contact with the audience. The speakers language was natural and fluent. The volume of speech was appropriate. The rate of speech was appropriate. The pronunciation was clear and comprehensible. The grammar was correct and didnt prevent understanding. Used visual aids, handouts, etc., effectively. Showed enthusiasm and interest. Responded to audience questions well.

used gestures and body language