Evaluation for Determining Instructional Purposes (DIP)

- a Training Program -

Submitted To: Far West Laboratories

For Educational Research and Development

Submitted by: Karen L. Cameron

EdTech 505: Evaluation of Educational Technology
Spring 2014

Introduction
The following proposal is submitted to Far West Laboratories (FWL) by CamEval Inc., an
evaluation company located in southwest Idaho. CamEval Inc. was hired to evaluate the
Determining Instructional Purposes (DIP) program. The main purposes for this request is to
provide information and recommendations in making decisions regarding marketing and sale of
units, to provide useful information to school administrators about the purchase and use of units,
and finally to determine whether or not FWL should continue to financially support the program.
CamEval Inc. will use data to determine how each goal is being met.
Program Description
FWL developed the DIP training package for the purpose of training school administrators in
planning effective school programs. The DIP program contains a coordinators handbook and
three units. The units are designed to stand on their own or be presented together. Each unit has
between four and six modules attached to it. The units included in the package are: Unit 1
Setting Goals, Unit 2 Analyzing Problems, and Unit 3 Deriving Objectives. Each unit
contains the necessary reading material aligned to the skills taught, activities to practice the new
skills and feedback from the activities; typically trainees are divided into small teams for the
activities. The design of the units allows for flexibility in execution, giving districts the
opportunity to run short sessions once a week after school or during day long professional
development days; the design of the course allows districts to make this call. FWL estimates
training time for the units as ten to fifteen hours for Units 1 and 3 and twelve to eighteen hours
for Unit 2.
FWL suggest the training coordinator work through the Units during a training group, but
stipulate no other background knowledge is required. The coordinators role is to organize,
guide and monitor activities as the new trainees use the material. The outline, procedure and
relevant information to implement a successful course is provided in the Coordinators
Handbook; which is included as part of the training package.
Evaluation Method
The request for an evaluation on DIP came from FWL. In the request, FWL provided specific
goals. The most important goal is to help them decide if it is financially smart for FWL to
continue funding for the program with marketing and sales. The evaluation will also be used to
inform school administrators about the DIP program and how it can benefit their school and/or
district.
In order to ensure a comprehensive evaluation is performed, CamEval Inc. will consider the
following questions.
Is the training material sufficient for the target audience?
Is the training material relevant for the target audience?

How will the three units meet the learning objectives?

How will the participants be affected by the training sessions? And, how will their
practices change?

Data will be gathered from multiple sources in order to answer the above questions. It is
important to not only give multiple choice surveys, but also conduct interviews of the desired
sample group. This will provide a complete overview of the program and give CamEval Inc. the
opportunity to provide FWL with the best guidance. The following will be conducted:
Survey and interview training coordinator before their first presentation.
Survey and interview training coordinator half-way through one unit.
Survey and interview training coordinator at the end of the unit.
Survey and interview training participants and school administrators before first training
session of one unit.
Survey and interview training participants and school administrators after final training
session of one unit.
Survey and interview training participants and school administrators before first training
session of second unit, if applicable.
Survey and interview training participants and school administrators after final training
session of second unit, if applicable.
Survey and interview training participants and school administrators before first training
session of third unit, if applicable.
Survey and interview training participants and school administrators after final training
session of third unit, if applicable.
Survey and interview training participants and school administrators three months after
completing the final training session.
FWL is the major stake-holder in this evaluation. CamEval Inc. will meet with FWL in order to
retain specific information regarding their marketing practices. Once their marketing plan is
understood, CamEval Inc. will create unique data collection tools; surveys will be given through
an online survey tool, such as Survey Monkey and interviews will be conducted in person when
possible or over the phone. CamEval Inc. recommends multiple sample groups be used, each
containing at least fifteen participants. CamEval Inc. recommends three groups to train in one
unit each and another group to receive training in all three units of the program. Also, CamEval
Inc. recommends extensive interviewing and surveying of the training coordinator because,
according to the overview of DIP provided by FWL, very little training is provided for the
coordinators. We feel that delivery of the material from the coordinator will be the foundation of
success for the program participants. Therefore surveys and interviews will be given to the
training coordinator at the beginning, multiple times throughout and at the end of the program to
determine their comfort with leading the multiple modules and units. As data is collected
recommendations will be made to FWL to adjust the DIP program to assist in meeting the

learning outcomes. At the end of the evaluation, a final recommendation will be given to ensure
continued success, if the program is found to be a viable recipient of funding; otherwise a
recommendation to cease financial support will be given.
Task Schedule
Task

Responsible
Party

Proposed
Deadline

Meet with FWL and discuss the objectives of the

proposal. These meetings will last 2 days. FWL staff will
FWL
meet with CamEval Inc. representatives and formulate the
outline and strategies for the evaluation

8-Jul-14

Conference between CamEval Inc. and FWL

representatives to modify and approve survey and
interview questionnaire for the evaluation of DIP.

CamEval Inc.

31-Jul-14

Provide copies of learning materials, survey questions and

interview questions to our SME to review and make
necessary adjustments.

CamEval Inc.

10-Aug-14

Final approval of survey and interview questionnaire

needed from FWL.

FWL and
CamEval Inc.

17-Aug-14

Provide Training Coordinator with online survey

questionnaire, as well as interview the Training
Coordinator

CamEval Inc.

31-Aug-14

Collect and summarize data from Training Coordinator

CamEval Inc.

8-Sep-14

Meet with FWL and discuss findings from Training

Coordinator interview and questionnaire. Offer
suggestions to make in the handbook and other training of
Training Coordinator. A decision will need to be made at
this point to continue with the evaluation or not.

CamEval Inc.
and FWL

15-Sep-14

Begin sample group evaluations at multiple sites. Site #1

trains with Unit #1, Site #2 - Unit #2, Site #3 - Unit #3
and Site #4 - All three units.
Pre-Surveys and will be conducted before training starts.
Weekly surveys will be given to follow trainee progress
and understanding of material.

Site #1, #2,

#3 2 hr.
session/week
for 8 weeks
CamEval Inc.
Site #4 - 1,
2hr.
Sessions/wee
k for 24
weeks

Once site trainings begin, training coordinators will be

surveyed weekly to check their comfort level with the
material and overall satisfaction with training others.

10

Develop Post-Survey questionnaire and interview

questions

11

Meet with FWL and discuss Post-Surveys and interviews.

Make any necessary revisions

Post surveys and interviews given to all training

coordinators and site participants and the end of their
12
sessions. Follow-up surveys and interviews with site
participants 3 months after their last class.
13

Summarize and analyze data. Meet with FWL to discuss

data findings

14 Submit final report to FWL

CamEval Inc.

ongoing
throughout
the sessions

CamEval Inc.

1-Oct-14

CamEval Inc. &

FWL

15-Oct-14

CamEval Inc.

Time will
vary
depending on
which site is
being
surveyed

CamEval Inc.

15-May-15

CamEval Inc.

30-Jun-15

Project Personnel
Karen Cameron is the president of CamEval Inc. She has a bachelors degree in mathematics
education and masters degree in business marketing and sales. She has played an integral part
in similar evaluations. Jessica Elsner is the CEO and holds a masters degree in educational
technology, she is a leader in evaluating education-based programs and Joseph Edwards, our
administrative assistant has a bachelors degree in business administration. Our subject matter
expert is Dr. Robin Cruz, a professor at the College of Idaho. She is on the forefront of creating
meaningful trainings for school leaders and administrators.
Budget
Personnel
Ms. Cameron: 40 days at $525/day

21,000

Ms. Elsner: 40 days at $425/day

16,000

Mr. Edwards: salary

4000

Dr. Robin Cruz: compensation

2500

subtotal

$44,500

Travel and per Diem

3 flights from Boise to Portland for 2
Hotel Accommodations
Estimated mileage hotel to FWL,
300 miles @ $0.56/mile
subtotal

948
1750
168
$2866

Materials
Paper

525

Printing

275

Stationary

200

subtotal

$1000

Program Supplies
Coordinator Handbooks

49.5

Unit Handbooks

1582.5

subtotal

$1632

TOTAL

$49998