Experts (evaluator) make decisions and judge the program being evaluated Standards are set Improvement encouraged through self-study Valuing the product or program is central Valuable information given because it relies on professional judgment Personal bias May increase product cos t
PROGRAM-ORIENTED EVALUATION APPROACHES
Simplicity (easy to understand, follow and implement) Results are relevant and legitimate Purpose of objectives are specified Focuses on how the objectives are achieved Single-mindedly focused only on stated program outcomes or objectives Other outcomes or findings are ignored Judgments may be incomplete Neglects gaining understanding
DECISION-ORIENTED EVALUATION APPROACHES
Addresses problems and helps stakeholders make decisions It focuses on decisions Social equity and equality are not values directly addressed (basically neglects the those with less power) Inability to respond to questions or issues that may be significant
PARTICIPANT-ORIENTED EVALUATION APPROACHES
Flexibility Encourages dialogue with powerless stakeholders Greater use of results and improved validity Increase in understanding Encourages multiple data collection methods
Manageability Credibility of results to non-stakeholders Stakeholders may be bias or may have difficulties being objective when evaluating their program Increased time and cost Competency of stakeholders
Explain your choice of model for your program evaluation: I have decided to go with a program-oriented and participant-oriented evaluation approach. Its straightforward procedure of using objectives to determine a programs success or failure and to serve as a foundation for program improvements, maintenance, or termination of program activities has proved an attractive prototype (Fitzpatrick, Sanders, & Worthen, 2011 pp.165). This type of approach will help to determine if the objectives of the combined curriculum being tested is obtaining the goals set as a success or a failure. It can also help determine where improvements need to be made or if terminating the program is the best solution. I will also use the participant-oriented evaluation approach to help encourage dialogue and help improve the validity of the program. The stakeholders involved will be able to understand and determine best practices because of their direct experience and wanting to do what will help them be able to build the program on a firm foundation. Combining the two
approaches will help balance out the limitation of using stakeholders in a program-oriented approach and the involvement of using too many stakeholders in the participant-oriented approach.
Running Head: Program Analysis 1
Program Analysis Walden University Program Evaluation
Montrice Lucas 11/10/2013
Program Analysis 2
The name of the organization is Calvary Resurrection Christian Academy, (CRCA). It is a private Christian school in Birmingham, Alabama that has been using the A Beka program to educate their students since the school began. In previous years they have serviced students from the age of 18 months up to five years. This school year they have decided to advance to kindergarten and first grade by using the combined A Beka classroom curriculum program. This combined classroom approach has been used by the Pensacola Christian Academy and has worked in the past. This year Calvary wanted to test this approach because they want to advance each year until they are a fully incorporated Fine Arts Christian School that goes all the way to Twelfth grade. The program that I will be evaluating is the combined Kindergarten and First grade A Beka classroom curriculum approach that this organization is using for the first time. This program is Christian-based and it combines two different age groups of children in the same classroom, but each grade level has its own lesson plan or curriculum to follow. There are also some portions of the curriculum that can be combined to teach both grade levels. The educational approach is founded on biblical principles that address the nature of the learner and learning, the nature of truth and authority, and what is important to learn and know(A Beka, 2013). Drill, repetition, and memorization are the approaches taken to help students learn using this curriculum. The teacher guides gives specific directions on what to do, what materials to use, and exactly what and how to say something when presenting different lessons. The student books are very appealing, and they include drills and activities for the students to complete. Program Analysis 3
The purpose of the program as stated by A Beka is that, Todays students need to be taught the accumulated wisdom of the past from a biblical worldview so they will have a firm foundation from which to evaluate the present and make proper decisions for the future (A Beka, 2013). Calvary Resurrection Christian Academy (CRCA) also states its reasons or purpose for why it uses the A Beka curriculum as well. The A-Beka Curriculum provides a basic program of study designed to result in students having increased self-esteem, self-awareness, and high levels of competence in the use of communication skills that include reading, writing, speaking and listening. The A-Beka curriculum also provides development of study habits that can lead to success and test taking skills that enable students to perform well on standard tests CRCA, 2013). Over the years that CRCA has used the traditional A Beka program and it has been successful. The students are pushed to excel above their grade level academic standards, and they enjoy the way the lessons are presented as well. The task at hand will be fitting all the lessons into the allotted time frame provided in each day, and following the directions when presenting the lessons. The materials that have been purchased are for general traditional classrooms, and the goal is to adapt the materials and lessons to fit the combined curriculum schedule. The purpose of the evaluation will be to reveal any weaknesses or things that need to be revised to make the program better, and ensure that it will be successful in the upcoming years as more grade levels are added.
Program Analysis 4
References Pensacola Christian Academy. (2013). A Beka Book: Our Foundation. Retrieved from: http://www.abeka.com/OurFoundation.aspx CRCA. (2013). Calvary Resurrection Christian Academy: About Us. Retrieved from: http://www.crcawarriors.com/#!about/cjg9
Running head: EVALUATIVE CRITERIA
Evaluative Criteria Walden University Montrice Lucas December 1, 2013
1 Evaluative Criteria The main purpose of the program evaluation is to determine whether or not the combined A Beka curriculum is the best choice for building the Calvary Resurrection Christian Academy (CRCA) program into a toddler through twelfth grade performing arts school. The school currently services toddlers through first grade students. The current plan is to advance to twelfth grade through the combining of two grade levels in one classroom with two different curriculum formats each year. Five Evaluation Questions 1. What are the advantages of combining two grade levels using the A Beka curriculum? 2. Will the combination of the grade levels be an asset or disadvantage to any of the stakeholders (students, teacher, Director)? If so, how? 3. Is advancing to twelfth grade by combining grade levels a realistic goal for CRCA and are stakeholders open to other options for getting to the goal of servicing students up to twelfth grade? 4. Is the combined curriculum just a cost-efficient way of advancing or are learners needs truly being considered and met through this combination? 5. How can CRCA increase the number of students attending as the grade levels increase? These evaluative questions will impact the evaluation by giving guidance on what to look for and how to get the best results from the evaluation. The Pastor, Director, teacher/staff, parents, and students are the major stakeholders in this evaluation, and the overall goal is to do what is best for everyone that will be affected by the program. The Pastor, Director, and teacher/staff will play the role of the SMEs because they know the program and have been using it, as well as, get to see the advantages and disadvantages of the program first-hand.
2 Evaluative Criteria They can use their knowledge to answer questions about benefits and disadvantages of the program. The parents of CRCA students can be used to brainstorm ideas on how to get more students to come by being advocates for the program and expressing what made them bring their children and why they will continue to bring their children to CRCA. This evaluation should be conducted in order to ensure that the advancement of the program will be a success. It is needed to ensure that students will still be able to learn and function appropriately with each other although they will not be learning the same content. It is also needed to show the Director and teacher what needs to be done to improve efficiency, increase the number of students, and ensure that as CRCA advances, it will not be a burden financially or in any other aspect. The A Beka curriculum has been proven to be an effective curriculum that has been used by CRCA for many years, which is why the usefulness of the curriculum is not being evaluated. We know for a fact that the students do learn and excel in their academics from using this program. What we will be evaluating is, the logic of combining two grade levels of students in one classroom using the A Beka combined curriculum to advance to twelfth grade, and how parents and students will be encouraged to come and become a part of the school. There has to be a plan set to acquire more students because the more students that come, the more financially stable CRCA will be and it would also give them a purpose for advancing beyond first grade.
3 Evaluative Criteria Evaluation Model Advantages Disadvantages
EXPERTISE AND CONSUMER- ORIENTED APPROACHES
Experts (evaluator) make decisions and judge the program being evaluated Standards are set Improvement encouraged through self-study Valuing the product or program is central Valuable information given because it relies on professional judgment Personal bias May increase product cost
PROGRAM-ORIENTED EVALUATION APPROACHES
Simplicity (easy to understand, follow and implement) Results are relevant and legitimate Purpose of objectives are specified Focuses on how the objectives are achieved Single-mindedly focused only on stated program outcomes or objectives Other outcomes or findings are ignored Judgments may be incomplete Neglects gaining understanding
DECISION-ORIENTED EVALUATION APPROACHES
Addresses problems and helps stakeholders make decisions It focuses on decisions Social equity and equality are not values directly addressed (basically neglects the those with less power) Inability to respond to questions or issues that may be significant
PARTICIPANT-ORIENTED EVALUATION APPROACHES
Flexibility Encourages dialogue with powerless stakeholders Greater use of results and improved validity Increase in understanding Encourages multiple data collection methods
Manageability Credibility of results to non- stakeholders Stakeholders may be bias or may have difficulties being objective when evaluating their program Increased time and cost Competency of stakeholders
Explain your choice of model for your program evaluation: I have decided to go with a program- oriented and participant-oriented evaluation approach. Its straightforward procedure of using objectives to determine a programs success or failure and to serve as a foundation for program improvements, maintenance, or termination of program activities has proved an attractive prototype (Fitzpatrick, Sanders, & Worthen, 2011 pp.165). This type of approach will help to determine if the objectives of the combined curriculum being tested is obtaining the goals set as a success or a failure. It can also help determine where improvements need to be made or if terminating the program is the best solution. I will also use the participant-oriented evaluation approach to help encourage dialogue and help improve the validity of the program. The stakeholders involved will be able to understand and determine best practices because of their
4 Evaluative Criteria
Reference Fitzpatrick, J., Sanders, J., Worthen, B. (2011). Program Evaluation: Alternative approaches and practical guidelines (4 th ed.). Upper Saddle River, NJ.
direct experience and wanting to do what will help them be able to build the program on a firm foundation. Combining the two approaches will help balance out the limitation of using stakeholders in a program-oriented approach and the involvement of using too many stakeholders in the participant-oriented approach.
Reporting Strategy Stakeholder Reporting Strategy Implications Stakeholder Involvement Pastor
Personal Discussion- This person would want to know in-depth information about outcomes of the program to ensure that the expansion will be successful to all parties involved or that will be affected through the program. The results of the report could affect this person because she may have to determine a new way of expanding the school if the combined curriculum is not sufficient. These stakeholders can be involved in the reporting process by helping determine results. They can all work together in order to determine best practices and decide what can be done to help improve the program because they have more knowledge of the practices involved with the program. They can reflect on the analysis together and engage in meaningful dialogue, which help the evaluator learn the stakeholders reactions and get an understanding of how to communicate the results. Director
Personal Discussion-This person would also want in-depth information for the same reasonings as the Pastor, but she would want more information and would also like to engage in dialogue about best practices and what can be done ensure success. The results of the report would affect this stakeholder the same as the Pastor and would have her trying to determine how to expand the program successfully without exhausting all the resources. Teacher/Staff
PowerPoint Presentation-The teacher would want information on what is working/or not working and a PowerPoint would be a great way to briefly show this type of information and can also show information on what can be done to ensure that the learners are benefiting from the combined curriculum. Potential implications of this report would affect the teachers/staff by causing them to have to research more ways of reaching learners and making sure that they are being afforded the information that is needed for them to be successful learners. Parents
Photography and video presentation- I think this would be beneficial to parents because they can see how the program works or is working through videos and photographs of their child engaging in the classroom. Parents the program resources are very good and are beneficial to your children. It requires a lot of organization, time, resources, and patience to ensure that your children are getting exactly what they need to be successful. This program has been proven to work, but it requires that the curriculum is followed precisely. I Parents really just want to know that their child is receiving a great quality education, so I would involve this stakeholder by providing them with the information they desire to have and by letting them express what they think can be done better. believe that as long as the CRCA teachers are doing what the curriculum requires the program will work and your children will not lack in his/her education. Students
Cartoons or Drama- These types of strategies will grasps students attention, and will also help explain information simply so that students will not get confused and will see the benefits of the program. Being in the classroom with children that may be younger or older than you can be fun. Learning from each other and mentoring each other are just some of the possibilities of being in a combined classroom. This stakeholder would be involved by the test that will be given to determine how much they know. The results of the test will help determine the programs outcomes and feasibility.
Values, Standards, and Criteria: When interpreting data to ensure openness I will ask stakeholders if they have any questions or concerns and will try to provide insightful information to help improve weaknesses. I will begin by discussing the strengths of the program and what parts seem to be effective. Then I will provide opportunities to discuss ways of improving the problematic areas of concern.
Potential ethical issues: Potential ethical issues may arise because if the results of the evaluation are not what the Director and Pastor expect, then they may become defensive and they may not accept the results. They also may reprimand staff and teachers if they do not receive the desired results of the program evaluation. Other ethical issues may include teachers and staff not being honest to keep from being reprimanded, and improper reporting techniques being used if the evaluator does not understand the audience being reported too. Sometimes evaluators might try to scale back on reporting imperfections because they may not know how stakeholders will react to negative results. Not allowing stakeholders to participate in interpreting data can be an ethical issue because the evaluator is may not be an expert in the program but the stakeholder can help by providing valuable knowledge. (Adds to the validity of the results)