Académique Documents
Professionnel Documents
Culture Documents
Prepared By:
ARWINA SYAZWANI BINTI GHAZALI 820403-11-5560
ADVERSARY-ORIENTED EVALUATION
Adversary-oriented evaluation is based on the judicial metaphor. It is assumed here that the potential for evaluation bias by a single evaluator cannot be ruled out, and, therefore, each side should have a separate evaluator to make their case.
ADVERSARY-ORIENTED EVALUATION
Purposes of Evaluation: Providing a balanced examination of all sides of controversial issues or highlighting both strengths and weaknesses of a program.
ADVERSARY-ORIENTED EVALUATION
Distinguishing Characteristics: Use of public hearing, use of opposing points of view, decision based on arguments heard during proceedings.
GUBA [1965]
OWENS [1971]
WOLF [1973]
WOLF [1975]
STENZEL [1976]
OWEN [1971]
WOLF [1975]
10
11
12
THE CHARACTERISTICS OF The Judicial Evaluation Model and other Pro and Con Adversary Hearing
1. Procedural rules must be flexible 2. There are no strict rules for the assessment of evidence. 3. The only requirement is that the judge(s) must determine before hand whether evidence is admissible or not. 4. The parties may be asked before the hearing to present all relevant facts, pieces of evidence and names of witnesses/experts to the judges 5. A copy of the complaint must, before the public hearing takes place, be committed to the judge(s) and the defence. The defence may plead guilty to some charges and deny others.
THE CHARACTERISTICS OF The Judicial Evaluation Model and other Pro and Con Adversary Hearing
6. Witnesses are able to speak freely and may be subjected to cross-examination. 7. Experts may be summoned for a statement before or during the hearing. 8. Meetings of all parties involved with the judge(s) prior to the public hearing tend to soften the debate and can be conducive to a joint striving to get to the truth of the matter on the basis of relevant facts. 9. Besides the two parties involved, other stakeholders may also be allowed to participate.
13
Wolf (1979) and Thurston,propose the following four stages for adversary evaluation: THE ISSUE GENERATION STAGE THE ISSUE SELECTION STAGE THE PREPARATION OF ARGUMENTS STAGE
14
At this stage, a broad range of issues are identified. Thurston recommends that issues which reflect those perceived by a variety of persons involved in, or affected by the program in question, are taken under consideration in the preliminary stages. 15
This stage consists of issue-reduction. Wolf (1979) proposes that issues on which there is no debate, should be eliminated. Thurston states that this reduction may involve extensive analysis (inclusive of content, logic and inference). The object of debate should also be defined and focused during this stage ( Wolf, 1979)
16
CON
This stage consists of data collection, locating relevant documents and synthesising available information. The data or evidence collected should be relevant to the for and against arguments to be deployed in the hearing (Wolf, 1979)
17
This stage may also be referred to as the clarification forum and involves public presentation of the object of debate (Wolf, 1979). This is followed by the presentation of evidence and panel or jury deliberation.
18
THE CHARACTERISTICS OF Adversary Hearings With More Than Two Opposing View
1.
Some of the review panels discussed in chapter 8 may hold public hearings to collect information pertinent to their charge Appointed commission charged with the resolution of controversial issues frequently hold hearings to obtain evidence and opinions relevant to their mission.
2.
19
THE CHARACTERISTICS OF Adversary Hearings With More Than Two Opposing View
3.
House (1980) has cited as one example the frequent use in England of commission and councils headed by prominent citizens to provide guidance to government policymakers. Several types of committee hearings are structured to identify and explore all the points of view represented in particular context.
4.
20
THE CHARACTERISTICS OF Adversary Hearings With More Than Two Opposing View
5.
a. b.
they reflect multiple viewpoints they frequently use hearing processes, questioning, cross-examination, interaction concerning alternate viewpoints and summary statements of the various positions.
21
THE CHARACTERISTICS OF Adversary Hearings With More Than Two Opposing View
6.
examination, and summary statements The hearing method consists of public, verbal, face to face interaction. A process of communication and education occurs, and evaluation makes its impact as it is happening.
22
Several approaches that qualify as adversary-oriented do not employ hearing processes. Kourilsky (1973) proposed that pro and con arguments be presented to a decision maker. ( who would examine the evidence and question the presenter, ultimately arriving at the decision that seemed fair given both positions)
2.
23
Levine (1974) proposed that a resident adversary or critic might be assigned to a research project to challenge each bit of information collected, searching for other plausible explanations.
The Stake and Gjerde (1974) strategy of having two evaluators prepare separate reports summing up opposing positions for and against the program- yet another variant adversarial approach that does not depend on hearing format.
5.
25
Donmoyer (undated) proposed deliberatively approach to evaluation which focused on assessing and balancing alternative conceptions of reality and the differing value positions underlying these conceptions.
Nafziger and others (1977) described an adversary evaluation design employing a modified debate model of presenting data collected in a comprehensive evaluation to ensure that both sides of controversial issues were illuminated.
7.
26
Summative evaluation Formative evaluation Social Science making Policy analysis and debate School governance and local decision making Issue resolution and policy formation
27
28
data (inclusive of statistical fact, opinions, suppositions, values and perceptions), it is argued to do justice to the complex social reality which forms part of the evaluation.
3. The judicial nature of this approach may reduce
29
platform which allows for cross-examination, permits public access to various interpretations of the evidence introduced into the evaluative context .
30
logical way in order to persuade the jury. Dependent on the jury in question, this can make the data presented more accessible to the public and other stakeholders involved in the evaluation.
9. Finally, this approach is suitable for meta-evaluation
and may be combined with other approaches which are participatory or expertise- oriented. 31
The object of the evaluation affects many people Resources are available for additional expends required by adversarial strategies Controversy about the object of the evaluation has created wide interest
SUMMARY
Administrators understands the intensity Decisions are summative
32
33
35
36
Crabbe and Leroy contend that an adversary approach to evaluation should be beneficial when: 1. The program being evaluated may affect a large group of people; 2. when the issue in question is one of controversy and public attention;
37
38