DSCG

Evaluation of Far West Laboratory’s Determining Instructional Purposes

Training Program

A Proposal Submitted to Far West Laboratory for Educational and Research Development
By
The Davis and Sellers Consultant Group

Farnoush H. Davis
Evan Sellers

1
Introduction

This document is a response to the request for proposal (RFP) for an evaluation from Far

West Laboratory for Educational and Research Development (FWL) of their Determining

Instructional Purposes (DIP) training program. The Davis and Sellers Consultant Group has

prepared this proposal to detail the evaluation process, requirements and outcomes.

Determining Instructional Purposes Training Program

The Determining Instructional Purposes, or DIP, training program was designed to be a

complete course of instruction in educational administration for school administrators and

graduate students. The course is intended to be a self-contained, packaged instruction that could

be completed as a whole course, or in sections determined by the needs of the district.

DIP consists of a coordinator’s handbook, and three units of instruction. Each unit of

instruction is further divided into modules, which contain reading material, individual or small

group activities, and appropriate tools for feedback. Many modules are given in a scenario which

models an actual school district, which makes the exercises practical and realistic for the

participants.

The materials are designed to be conducted with the supervision of a coordinator. The

developers intended the instruction to require little prior knowledge of the content area, and the

coordinator should be able to facilitate the class with only having worked through the material as

a member of a training group. The coordinators main purpose is to organize, guide, and monitor

the activities where the participants use the supplied materials in group activities.

2
 All DIP materials are in print form, with lengths between 155 and 259 pages depending

on the unit. Costs are minimal at $8.95 per single unit, or $24.95 for the set of three. The

Coordinator’s Handbook is an additional $4.50.

Evaluation Method

The request for proposal from the Far West Laboratory (FWL) indicates that they are

looking for specific information and data to assist them in determining the future of the

Determining Instructional Purposes (DIP) training program. A need for recommendations

regarding the dissemination of the units and information that may persuade school administrators

to purchase DIP build to one overarching question: should FWL invest the capital and resources

to create and market this program?

While this explanation may seem to focus on budgetary and logistical issues, in fact, the

answers to all of these questions depend on the effectiveness of this program. Decisions on

investment, distribution, and application must be based on data related to the ability of the

materials to effectively and efficiently meet the goals of the program and impact the participants

so that they are able to improve their particular focus areas.

The purpose of our evaluation will be to provide the management team of FWL with the

data and recommendations they need on the overall effectiveness of the DIP program.

In initial conversations with FWL directors, an explanation of the importance of having a

thorough course evaluation led to the decision that the goal-based model was the most

appropriate. The goal-based evaluation model tests effectiveness, efficiency, and impact. From

that determination, we identified three main areas of evaluation which will also be the focus of

our three objectives:

3
 1. Measure the effectiveness of the program through participant improvement

2. Assess the performance of the coordinators based on course delivery objectives and

expectations

3. Determine the effectiveness, appropriateness, and user-friendliness of the program

materials

In order to measure the effectiveness of the program we will use several different sources

and methods of data collection. Since this program has not been conducted in a real situation

before, it needs to be evaluated in a practical context. FWL has provided DSCG with a test group

of educators and administrators at West Florence High School in Florence, SC. West Florence

High School has agreed to perform the training with 24 participants and two coordinators

between the dates of January 17 through January 28, 2010 and will be provided all DIP materials

by FWL. To identify if this training program has been delivered efficiently, it must be observed

by the evaluators. DSCG will observe and evaluate DIP as it is administered to the West

Florence test group. In addition, DSCG will use pretests and posttests given to the participants to

measure the improvement of the participants quantitatively. Pretests will be delivered on the first

day of instruction to gauge the participant’s knowledge level of the subject matter prior to the

DIP training. Posttests will be administered on the last day of training in order to assess the

impact of the training. Structured observations of the three units and every module will be used

to gather accurate information on the delivery of information and instruction procedure. To

assess the course materials we will use surveys given to participants and the coordinators for

feedback on the quality and ease of use at the conclusion of the training.

4
 All surveys, tests, observation sheets, etc. will be created upon the initial meeting/in-

briefing with the FWL project team. This step is critical, as we need to know the areas of most

importance for FWL so that our evaluation addresses each of their specific concerns.

5
Task Schedule

According to the goal-based model the evaluator’s tasks are to collect data, analyze the

data, and interpret the data from the evaluation, and create a final product in the form of

recommendations to assist FWL as they determine the course they wish to pursue regarding the

DIP program.

Evaluation of FWL’s Determining Instructional Purposes Training Program

Task Agency Deadline

Responsible

1) Meet with FWL management and designers to Both November 1,

discuss DIP 2010

2) Create surveys, pretests and posttests, DSCG November 15,

observation sheets 2010

3) Submit all data collection instruments and DSCG November 30,

materials for review 2010

4) Review data collection instruments and FWL December 15,

provide feedback 2010

5) Make any revisions necessary on data DSCG December 30,

collection instruments 2010

6) Observe DIP training, administer pretest, DSCG January 17 - 28,

posttests and surveys 2010

7) Analyze and summarize observations and DSCG February 10, 2010

posttests

8) Provide FWL with results of DIP training DSCG February 15, 2010

9) Prepare, and submit summative evaluation to DSCG February 28, 2010

FWL

6
Bidder Qualifications

The Davis and Sellers Consulting Group was organized in 2010 in response to a lack of

consulting and evaluation firms that specialized in educational settings. The principle partners,

Farnoush Davis and Evan Sellers, have combined their years of experience with the goal of

assisting educational institutions in their quest to provide successful programs that are efficient,

effective, and have positive impacts. DSCG strives to provide their clients with thorough and

detailed evaluations based on extensive qualitative and quantitative data and utilizes the latest

research and methods to provide the highest level of service to its clients.

Project Personnel

Farnoush Davis, Co-Director

Mrs. Davis is a (soon-to-be) graduate of Boise State University’s Educational Technology

Department, and (will) hold(s) a Masters in Educational Technology (MET). Farnoush has

received a BA from Azad University in English Instruction, and is also a court interpreter

and refugee agency volunteer. She is the co-designer of the surveys and observation data

collection forms, as well as the facilitator between her company and the contracted parties.

Evan Sellers, Co-Director

Mr. Sellers is a graduate of Francis Marion University with a BS in Political Science. He is

currently pursuing his Masters in Educational Technology at Boise State University. Mr. Sellers

has been teaching in the public school system for over 10 years and specializes in collecting and

cataloging data using various technologies.

7
A.K. Sarvis, Administrative Assistant

Mr. Sarvis will be in charge of overseeing the direction of the office and communication. He will

also perform various other duties as assigned by the co-directors.

8
Budget

The total budget for the evaluation of FWL’s DIP is (new total here). A detailed

breakdown of the budget on the next page.

Proposed Budget

Personnel

Farnoush Davis, Co-Director (45 days at $300) $13,500

Evan Sellers, Co-Director (45 days at $300) $13,500

A.K. Sarvis, Administrative Assistant (30 days at $100) $3,000

Total $30,000

Travel and per Diem

Round trip travel and lodging expenses to Florence, SC (includes $1,800

per diem)

Estimated mileage (300 miles at $0.45 per gallon) $135

Total $1,935

Communications

Telephone (4 months at $210 per month) $840

Postage $200

Total $1,040

Supplies, Material, and Photocopying

Supplies and Photocopying $650

Total $650

Total $33,625
Budget