U1 Stakeholder Identification

Clearly identify the evaluation client

Engage leadership figures to identify other stakeholders
Consult potential stakeholders to identify their information needs
Use stakeholders to identify other stakeholders
With the client, rank stakeholders for relative importance
Arrange to involve stakeholders throughout the evaluation
Keep the evaluation open to serve newly identified stakeholders
Address stakeholders' evaluation needs
Serve an appropriate range of individual stakeholders
Serve an appropriate range of stakeholder organizations

9-10 Excellent 7-8 Very Good 5-6 Good 3-4 Fair 0-2 Poor

U2 Evaluator Credibility

Engage competent evaluators

Engage evaluators whom the stakeholders trust
Engage evaluators who can address stakeholders concerns
Engage evaluators who are appropriately responsive to issues of gender, socioeconomic status, race, and
language and cultural differences
Assure that the evaluation plan responds to key stakeholders concerns
Help stakeholders understand the evaluation plan
Give stakeholders information on the evaluation plans technical quality and practicality
Attend appropriately to stakeholders criticisms and suggestions
Stay abreast of social and political forces
Keep interested parties informed about the evaluations progress

9-10 Excellent 7-8 Very Good 5-6 Good 3-4 Fair 0-2 Poor

U3 Information Scope and Selection

Understand the clients most important evaluation requirements

Interview stakeholders to determine their different perspectives
Assure that evaluator and client negotiate pertinent audiences, questions, and required information
Assign priority to the most important stakeholders
Assign priority to the most important questions
Allow flexibility for adding questions during the evaluation
Obtain sufficient information to address the stakeholders most important evaluation questions
Obtain sufficient information to assess the programs merit
Obtain sufficient information to assess the programs worth
Allocate the evaluation effort in accordance with the priorities assigned to the needed information

9-10 Excellent 7-8 Very Good 5-6 Good 3-4 Fair 0-2 Poor

U4 Values Identification
 Consider alternative sources of values for interpreting evaluation findings
Provide a clear, defensible basis for value judgments
Determine the appropriate party(s) to make the valuational interpretations
Identify pertinent societal needs
Identify pertinent customer needs
Reference pertinent laws
Reference, as appropriate, the relevant institutional mission
Reference the programs goals
Take into account the stakeholders values
As appropriate, present alternative interpretations based on conflicting but credible value bases
9-10 Excellent 7-8 Very Good 5-6 Good 3-4 Fair 0-2 Poor

U5 Report Clarity

Clearly report the essential information

Issue brief, simple, and direct reports
Focus reports on contracted questions
Describe the program and its context
Describe the evaluations purposes, procedures, and findings
Support conclusions and recommendations
Avoid reporting technical jargon
Report in the language(s) of stakeholders
Provide an executive summary
Provide a technical report
9-10 Excellent 7-8 Very Good 5-6 Good 3-4 Fair 0-2 Poor

U6 Report Timeliness and Dissemination

Make timely interim reports to intended users

Deliver the final report when it is needed
Have timely exchanges with the programs policy board
Have timely exchanges with the programs staff
Have timely exchanges with the programs customers
Have timely exchanges with the public media
Have timely exchanges with the full range of right-to-know audiences
Employ effective media for reaching and informing the different audiences
Keep the presentations appropriately brief
Use examples to help audiences relate the findings to practical situations
9-10 Excellent 7-8 Very Good 5-6 Good 3-4 Fair 0-2 Poor

U7 Evaluation Impact
 Maintain contact with audience
Involve stakeholders throughout the evaluation
Encourage and support stakeholders use of the findings
Show stakeholders how they might use the findings in their work
Forecast and address potential uses of findings
Provide interim reports
Make sure that reports are open, frank, and concrete
Supplement written reports with ongoing oral communication
Conduct feedback workshops to go over and apply findings
Make arrangements to provide follow-up assistance in interpreting and applying the findings
9-10 Excellent 7-8 Very Good 5-6 Good 3-4 Fair 0-2 Poor

Scoring the Evaluation for UTILITY

Strength of the models provisions for UTILITY:
Add the following:

Number of Excellent ratings (0-7) x4= 26 (93%) to 28: Excellent

Number of Very Good (0-7) x3= 19 (68%) to 25: Very Good

Number of Good (0-7) x2= 14 (50%) to 18: Good

Number of Fair (0-7) x1= 7 (25%) to 13: Fair

0 (0%) to 5: Poor

Total score: = _____ (Total score) 2 = _____ x 100 = _____