EVALUATION OF DETERMINING INSTRUCTIONAL PURPOSES TRAINING PROGRAM

A Proposal Submitted to Far West Laboratory for Educational Research and Development by Evaluation Consultants (fictitious company) Vertoria Lagroon, Student at Boise State University Susan Shannon, Student at Boise State University Introduction On September 28, 2010, Far West Laboratory for Educational and Research Development (FWL) issued a request for proposal (RFP) for an evaluation of its Determining Instructional Purposes (DIP) training program. This document is a proposal from Evaluation Consultants (fictitious company), submitted in response to the Far West Laboratory RFP. FLWs Determining Instructional Purposes (DIP) Training Program The DIP training package was developed by FWL to better enable administrators and graduate students to prepare effective school programs. The DIP training package consists of four components which are a coordinators handbook and three training units, which include four-to-six modules of training materials a piece. The three units are broken down as follows: Unit 1 Setting Goals, Unit 2 Analyzing Problems, and Unit 3 Deriving Objectives. Each unit contains reading materials, group activities, and feedback provided on practice activities. The practice activities are developed in a manner that requires participants to apply skills in hypothetical situations. Individuals units are designed to be comprehensive, providing for complete attainment of desired outcomes after a step-by-step progression through the materials. The units are developed in a flexible manner, allowing participants to focus on an area that is of personal concern. Units may be administered through condensed workshops or individual sessions completed over a period of several weeks. The estimated time frame for the respective units are as follows: Unit 10 to 15 hours, Unit 2 12 to 18 hours, and Unit 3 10 to 15 hours. A key component of the DIP training package is the coordinators handbook to be used by an overseeing training coordinator that has previously worked through relevant units. Using the coordinator handbook as a guide, the coordinator will organize, guide, and monitor the activities in which participants use the materials and procedures outlined in the units. A hard copy of the Coordinators Handbook ($4.50) is provided with units ranging in length from 155 to 259 pages. The cost for each unit is $8.95 or $24.95/set of three units. Evaluation Method The purpose of this evaluation is twofold. First, the information and recommendations from the evaluation will be used to determine likelihood and potential methods of dissemination. Second, the information will be provided to administrators to aid in the purchasing decision. This evaluation will provide senior management at FWL with information necessary to

determine whether or not they should create and market the DIP training package. In order to collect the data required to make such decisions, the following processes will be completed. Table 1 outlines these methods. Interviews will be set up with FWL to collect background information directly from the creators of the training program. Understanding the intent, purpose and legwork that has already been completed on the project will provide a stronger base from which to build on. These interviews will determine the extent to which pilot programs have been completed with the DIP training package. Interviews will occur with representatives from at least 10 state departments of educations. These focus groups will help to identify the need for such a program to aid with the education of administrators and graduate students. Surveys will be used to evaluate the attitudes of teachers and graduate students that have participated in programs piloting the DIP training program. If pilots have not been implemented to date, it will be necessary to put the training program into action with a total of at least 10 participants from at least 2 different institutions and survey the coordinators, participants, school board, students, and teachers connected to the pilot. This will provide valuable information about the program that will be use to determine marketability and will be useful when promoting to prospective customers. Determining how graduate students and administrators become aware of the program as well as how they perceive related costs for services can be accomplished through interviews, focus groups and surveys. The source for this information will be collected at conferences attended by educators and through groups and organizations catering to educators. At total of at least 20 individuals will be involved from at least 2 groups. Table 1 Evaluation Methods Information Needed Background Method Interview Source/Stakeholder Far West Laboratory for Educational Research and Development Representatives from a sample of state departments of education Representatives from a sample of state departments of education Coordinators, Participants, School Board, Students and Teachers

Does the DIP training package meet a continuing education requirement? Do similar programs exist?

Interview

Interview Public Docs. Surveys

Attitudes from Pilot program

How should the information be disseminated? Cost Implications?

Interviews Focus Groups Surveys Interviews Focus Groups Surveys

Educational Groups and Organizations Educational Groups and Organizations

TASK SCHEDULE EVALUATION OF DETERMINING INSTRUCTIONAL PURPOSES TRAINING PROGRAM

The task schedule for this evaluation is indicated in Table 2a and 2b. This project can be completed in three months from beginning to end if prior pilot programs of the DIP training program have been implemented. If pilots have not been implemented, the evaluation of this project will take six months. Table 2a Task Schedule (with prior Pilot 3 months) A beginning date of January 1 is used, however work may begin at any time. Task Meet with FWL staff to discuss evaluation proposal and FWL-desired modifications, if any. Submit plan for collecting information and draft copies of aligning documents for FWL review. Provide feedback on collection plan and draft documents. Modify collection plan and documents as necessary. Submit final copies to FWL Select and meet with representatives of state departments of education Report state department findings to FWL Public Document Collection Report public doc. findings to FWL Educational Groups and Organizations Interviews and Surveys Report survey results from pilot (as necessary) and January 3 January 3 Beginning Date January 1 Ending Date January 3

January 1 January 1 January 1 January 3

January 3 January 3 January 3 February 3

March 1 March 1 March 15 February 15

March 15

results of interviews and surveys of ed. groups and orgs. Pilot Program Complete Survey and/or evaluate results of prior surveys Analyze data and Write report Deliver final report to FWL Table 2b Task Schedule (without prior Pilot 6 months) A beginning date of January 1 is used, however work may begin at any time. Task Meet with FWL staff to discuss evaluation proposal and FWL-desired modifications, if any. Submit plan for collecting information and draft copies of aligning documents for FWL review. Provide feedback on collection plan and draft documents. Modify collection plan and documents as necessary. Submit final copies to FWL Select and meet with representatives of state departments of education Report state department findings to FWL Public Document Collection Report public doc. findings to FWL Educational Groups and Organizations Interviews and Surveys Report survey results from pilot (as necessary) and results of interviews and surveys of ed. groups and orgs. Pilot Program - Initiated Find Participants January 3 January 3 January 3 January 3 Beginning Date January 1 Ending Date January 3 January 3 March 1

March 15

March 30 April 1

January 1

January 3

January 1 January 1 January 3

January 3 January 3 February 3

March 1 March 1 March 15 February 15

March 15

February 1 February 1

Initiate Pilot Survey Report survey results of pilot to FWL Analyze data and Write report Deliver final report to FWL

February 1 March 1

April 1 May 1 June 1

June 1

June 30 July 1

Project Personnel Evaluation Consultants will work with you to provide results that directly meet your needs. You will be able to make confident decisions based on our findings. We will supply you with two consultants who have over 10 years of collective experience in providing sound evaluation reports. Budget

The proposed budget for the evaluation of DIP is $32,800. A breakdown of the proposed budget and the payment schedule are shown in Table 3. Table 3 Personnel Project Manager 67 days @ $300/day Assistant 50 days @ $150/day Travel and Expenses Air fare (East Coast to West Cost) = $500/ ticket X 2 consultants X 2 visits
Hotel = $200/3 days (2 for 1st visit and 1 for final visit) X 2 consultants

$27, 600 $20,100

$ 7,500

$3,700 $2,000

$1,200 $500 $1,500 $1,500 $32,800

Daily Per Diem for each consultant = $50/day X 2 consultants X 5 days Operations printing, office supplies, mail, phone, etc. Total Budget

Personnel Travel Operations Total Cost

$27,600 $ 3,700 $ 1,500 $32,800 (This cost doubles if prior pilots have not been completed.)

Requested Payment Schedule payment requested upfront payment requested on day of report delivery