Evaluation Instrument

Level 1: Participants’ Reactions

Following the first coaching session, participants will be given a questionnaire to gauge their
reactions. This could be administered on paper at the end of the session, or digitally the next
day using Google Forms, while the session is fresh in their minds. The questionnaire would
include the following rating scale items and open-ended question.

On a scale from 1-5, 1= Strongly Disagree, 2= Disagree, 3= Unsure, 4= Agree, 5= Strongly

agree, please rate the following statements:

1 2 3 4 5
1. My time was well spent.
2. The content and material made sense.
3. The activities were well-planned.
4. The activities were meaningful.
5. I found the information useful.

In a few sentences, please describe what stands out to you from what you learned from the
session today.

Level 2: Participants’ Learning

In order to measure knowledge gained, participants’ prior knowledge must first be measured.
Prior to the coaching session, participants will take a pre-assessment to measure their
understanding of the technology that will be addressed during the coaching session(s).
Using this information, the coach may adjust the pace or content of the upcoming sessions to
meet the needs of the participants.

This survey would be emailed prior to the first coaching session using Google Forms.

Pre-Assessment Survey

Have you ever heard of [technology tool]? Yes No

Have you ever used [technology tool]? Yes No
On a scale from 1-5, with 1 being the lowest
and 5 being the highest, rate your 1 2 3 4 5
understanding of [technology tool]:

In order to measure knowledge or skills gained during the coaching sessions, a post-
assessment survey would be emailed after the coaching session(s).
Post-Assessment Survey

On a scale from 1-5, with 1 being the lowest

and 5 being the highest, rate your 1 2 3 4 5
understanding of [technology tool]:
On a scale from 1-5, with 1 being the lowest
and 5 being the highest, how comfortable do 1 2 3 4 5
you feel about using this technology in your
classroom?

Would you like to learn more about this technology tool? Yes No

If yes, explain what else you would like to learn about this tool below:

Level 3: Organizational Support and Change

In order to evaluate organizational support and change, the coach will conduct separate
interviews with teachers and school administrators by teams to gather this information from
multiple viewpoints, without influence. The coach may take notes while conducting these
interviews.

Teacher interview questions

1. Did the professional learning promote changes that were aligned with the mission of the
school?
2. Were changes at the individual level encouraged and supported at the building and district
levels?
3. Were sufficient resources made available, including time for sharing and reflection?
4. Were problems addressed quickly and efficiently?
5. Were successes recognized and shared?

Administration interview questions

1. What has changed for you since your teachers took this professional development?
2. Did the professional learning promote changes that were aligned with the mission of the
school?
3. Were changes at the individual level encouraged and supported at the building and district
levels?
4. Were sufficient resources made available, including time for sharing and reflection?
5. Were problems addressed quickly and efficiently?
6. Were successes recognized and shared?
7. Are you doing anything differently in the school to accommodate community partners?

Level 4: Participants’ Use of New Knowledge and Skills

To evaluate participants’ use of new knowledge and skills, participants will be asked to share
their lesson plans and/or student work to demonstrate their use of the technology in their
classroom.
Level 5: Student Learning Outcomes
Initially, student assessment scores or portfolios may be used to measure student learning
outcomes. The coach may also conduct teacher and student interviews for further insight.

Teacher interview questions

1. How has your implementation of the technology affected student performance?

2. What has been your students’ response to the new technology?

Student interview questions

1. How has the technology affected your learning?

2. How has the technology been helpful to your learning process?

Plan
Using the data acquired from the instruments described above at each level of Guskey’s
framework, which includes participants’ reactions, participants learning, organizational support
and change, participants’ use of new knowledge and skills, and student learning outcomes, the
coach can determine the impact of the professional development and outcomes on multiple
levels school-wide. This includes outcomes for administration, teachers, and students. The
data and results will help guide the coach in planning for future instructional technology
professional learning programs. For example, the coach could continue any activities or
practices that received a positive response from teachers on surveys or interviews. Using data
that refers specifically to the technology, the coach can determine whether to continue
professional development using this technology and other aspects of this technology, or move
on to introducing new technology and skills.

References

Guskey, T. R. (2000). Evaluating Professional Development. Thousand Oaks, CA: Corwin

Press.

Guskey, T.R. (2016). Gauge impact with 5 levels of data. The Learning Professional, 37(1),
32-37.