Evaluation Plan for:

New State Standards for Mathematics and Problem-based Learning

A Grant Funded Project

FRIT 7237

Addy Baker
Meagan Harrelson
Victorie Penn
 Implementation Evaluation

This implementation evaluation is intended to evaluate the implementation project

between Great Southern University and Braxton County Schools. The project intends to prepare

teachers from Braxton County Schools to implement the New State Standards for Mathematics

(NSSM). In order to properly evaluate the project the following questions must be answered: P1:

Were the initial experience and follow up activities implemented as planned? P2: What is the

quality of the initial program activities? P3: Who are the program participants and how were they

recruited? P4: What is the quality of follow up and support activities? These questions will be

answered using a variety of means including focus groups, surveys, interview, observations, and

questionnaires. Using a comprehensive approach will ensure the ability to form a complete idea

of the strengths and weaknesses of the project and highlight areas for improvement.

Data
Implementation Collection
Procedures Schedule
Questions Methods
And Sources

P1: Were the initial *Focus Group *A focus group will be formed *Mid project- October
experience and follow *Survey of randomly chosen participants 2015
up activities *Observation to collect their personal *End of Project- January
implemented as with lesson experiences with the 2016
planned? plan collection implementation of activities.
*All participants will complete
a survey asking questions on
their implementation
experience.
*Teacher lesson plans will be
collected and evaluated based
on the qualities of PBL and
adherence to the NSSM. These
lessons will be observed by a
trained evaluator.

P2: What is the *Survey *Participants and project *During and immediately
quality of the initial *Observation administrators will receive an following initial program
program activities? exit survey on their view of the activities
 quality workshop and additional
activities.
*An evaluator will be present to
observe and evaluate the initial
program workshop.

P3: Who are the *Interviews *Upon finalization *Within the first 2 weeks
program participants *Questionnaire of selections Ms. Carla Lawton of selection finalization
and how were they and the Project Director will be
recruited? interviewed in person about the
procedure with which they
chose participants.
*A questionnaire will be
distributed by email to all
eligible teachers and
administrators.

P4: What is the *Survey *A focus group will be formed *Mid project- October
quality of follow up *Focus Group of randomly chosen participants 2015
and support activities? to collect their personal *End of Project- January
experiences of follow up and 2016
support activities.
*All participants will complete
a survey asking questions about
follow up and support activities.

Summative Evaluation

The summative evaluation report is represented by 4 objectives within 2 different

questions. The first question, To what extent were teachers able to develop PBL modules that

were connected to local business and industries, aligned with NSSM, and incorporated

appropriate uses of technology, is associated with objectives 1,2,3 and the second question, To

what extent were teachers able to implement and evaluate those modules, is associated with

objective #4.

The project will begin on the date of June 25th. At this point, the introduction of new

standards to the Great Southern faculty and Braxton County teaching staff will be presented and

this will lead to the two staffs working through a PBL refinement period which will be the dates
of July 2nd through July 20th. During the refinement period, the faculty of Great Southern

University will help the teacher staff from Braxton County to refine their PBL modules using

electronic communication. The data that will be observed will come from post and pre-project

surveys, student work samples, basic observation rubrics, alignment of standards checklists, and

module rubrics.

During the fall term of the school year, the Braxton County teachers will implement their

modules and meet with the Great Southern faculty for a mid-year implementation meeting. Once

the mid-year meeting is completed the Braxton County teachers will have a self-evaluation

period.

Evaluation Questions Objective Indicator Data Source

To what extent were Using local business Modules refined *Module Rubric
teachers able to develop numerical data create a and uses *Pre-Project
PBL modules that were PBL module that would information from Survey
connected to local business use the given data. local businesses.
and industries, aligned with
NSSM, and incorporated
appropriate uses of
technology?

To what extent were Using NSSM Standards Task and *Standards

teachers able to develop to align PBL modules. assessment Alignment
PBL modules that were refined and Checklist
connected to local business aligned to NSSM
and industries, aligned with standards.
NSSM, and incorporated
appropriate uses of
technology
To what extent were Create PBL Modules Local business *Observation
teachers able to develop that align with NSSM aid in using Rubric
PBL modules that were standards and integrate technology *Activity Portfolio
connected to local business these modules into the effectively *Teacher
and industries, aligned with technology of local during PBL Walkthroughs
NSSM, and incorporated businesses module.
appropriate uses of
technology

To what extent were Self-evaluation of Post survey data *Post-Project

teachers able to implement modules implemented and Surveys
and evaluate those during course. walkthroughs to *Student Work
modules? determine the Samples
overall use of
technology

Data Collection Schedule and Summary

Instrument
Data Set Date of Collection Already Data Collected By
Developed?

Pre and Post Surveys June 25, 2015 and No Great Southern
January 2016 Faculty

Observation of Workshop June 29, 2015 No Outside Evaluator

Teacher Observation and January 2016 Yes Great Southern

Self-Evaluation Faculty and Teachers

Focus Group October 2015 No Great Southern

Faculty

Interviews with Ms. Lawton Following selection No Great Southern

and Project Director of participants Faculty

Student Work Samples January 2015 Yes Teachers